Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

StepFun: Step 3.5 Flash vs Xiaomi: MiMo-V2-Omni

Last updated at: 2026-03-21

Metric Step 3.5 Flash Step 3.5 Flash medium Release: 2026-02-01 Free Available MiMo-V2-Omni MiMo-V2-Omni medium Release: 2026-03-18
Score 7.9 7.9
Rank #24 #22
Consistency 9.1 10.0
Tests Correct
Attempt pass rate 70.6% 64.7%
Flaky tests 2 0
Total Runs 49 17
Cost per result 0.000 0.763
Total Cost $0.000 $0.084
Input Price $0.100 / 1M $0.400 / 1M
Output Price $0.300 / 1M $2.000 / 1M
Output Tokens 71,904 663
Reasoning Tokens 155,607 39,001
Response Time (avg) 26.78s 13.71s
Response Time (max) 170.45s 158.78s
Response Time (total) 294.58s 233.06s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Step 3.5 Flash 10.0 10.0 100.0% 0 13.56s 14,376 17,668
MiMo-V2-Omni 10.0 10.0 100.0% 0 2.11s 112 402
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Step 3.5 Flash 10.0 10.0 100.0% 0 29.57s 1,176 12,984
MiMo-V2-Omni 10.0 10.0 100.0% 0 19.29s 131 2,807
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Step 3.5 Flash 10.0 10.0 100.0% 0 15.01s 600 13,886
MiMo-V2-Omni 10.0 10.0 100.0% 0 2.29s 87 323
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Step 3.5 Flash 5.3 7.2 44.4% 1 170.45s 45,350 90,436
MiMo-V2-Omni 3.0 10.0 0.0% 0 55.12s 13 33,279
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Step 3.5 Flash 5.5 10.0 0.0% 0 6.54s 2,214 2,584
MiMo-V2-Omni 10.0 10.0 100.0% 0 2.86s 58 202
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Step 3.5 Flash 8.5 6.8 83.3% 1 4.98s 2,284 3,412
MiMo-V2-Omni 8.3 10.0 50.0% 0 4.92s 35 201
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Step 3.5 Flash 5.3 10.0 33.3% 0 7.72s 5,629 10,835
MiMo-V2-Omni 6.5 10.0 33.3% 0 3.88s 126 481
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Step 3.5 Flash 10.0 10.0 100.0% 0 11.91s 275 3,802
MiMo-V2-Omni 10.0 10.0 100.0% 0 11.07s 101 1,306

Quick Compare

Switch Comparison Pair