Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

xAI: Grok 4.20 vs Xiaomi: MiMo-V2.5

Summary

Grok 4.20 vs MiMo-V2.5 benchmark comparison: Grok 4.20 leads on average score with 7.3 vs 6.7. MiMo-V2.5 has the lower benchmark cost at $0.063 vs $0.609. MiMo-V2.5 is faster at 27.11s vs 27.68s, with pass rates of 63.5% vs 69.8%.

Recommended model: MiMo-V2.5 - Its score stays close to the best score here (6.7 vs 7.3), while costing about 9.8x less than Grok 4.20.

Last updated at: 2026-06-18

Metric Grok 4.20 Grok 4.20 medium Release: 2026-03-31 MiMo-V2.5 MiMo-V2.5 medium Release: 2026-04-22
Score 7.3 6.7
Rank #53 #76
Reliability 10.0 10.0
Consistency 8.8 8.1
Tests Correct
Attempt pass rate 63.5% 69.8%
Flaky tests 3 5
Total Runs 63 63
Cost per result 8.309 2.966
Total Cost $0.609 $0.063
Input Price $1.250 / 1M $0.140 / 1M
Output Price $2.500 / 1M $0.280 / 1M
Total Input Tokens 44,433 41,838
Output Tokens 1,819 2,827
Reasoning Tokens 219,524 198,898
Response Time (avg) 27.68s 27.11s
Response Time (max) 199.66s 162.44s
Response Time (total) 581.26s 569.38s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#53 xAI: Grok 4.20

medium
Cost
$0.041
Time
110.3s
Tokens
16,336 tok

#76 MiMo-V2.5

medium
Cost
$0.002
Time
54.8s
Tokens
5,247 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 8.2 7.9 83.3% 1 3.95s 2,010 287 8,312
MiMo-V2.5 10.0 10.0 100.0% 0 4.14s 621 281 1,739
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 6.3 6.6 55.6% 1 109.93s 8,307 268 103,150
MiMo-V2.5 6.2 4.7 66.7% 2 97.14s 7,422 557 81,977
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 10.0 10.0 100.0% 0 17.40s 12,909 232 9,556
MiMo-V2.5 10.0 10.0 100.0% 0 16.86s 15,060 363 7,609
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 10.0 10.0 100.0% 0 4.17s 7,761 180 5,333
MiMo-V2.5 2.7 5.7 16.7% 1 6.33s 7,746 306 5,714
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 5.3 10.0 33.3% 0 27.03s 1,764 375 49,339
MiMo-V2.5 5.3 10.0 33.3% 0 34.53s 735 507 49,478
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 3.9 2.6 33.3% 1 24.48s 825 65 6,440
MiMo-V2.5 5.4 2.5 66.7% 1 5.37s 492 121 418
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 9.8 10.0 100.0% 0 4.26s 1,362 57 6,419
MiMo-V2.5 9.9 10.0 100.0% 0 1.80s 672 88 801
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 7.7 10.0 66.7% 0 6.22s 1,689 149 7,913
MiMo-V2.5 8.2 7.2 88.9% 1 20.25s 660 279 33,254
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 3.0 10.0 0.0% 0 13.68s 7,275 197 6,620
MiMo-V2.5 10.0 10.0 100.0% 0 7.29s 8,220 303 2,424
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 3.0 10.0 0.0% 0 63.48s 531 9 16,442
MiMo-V2.5 3.0 10.0 0.0% 0 51.29s 210 22 15,484

Quick Compare

Switch Comparison Pair

Gemini 3 Flash PreviewlowvsGrok 4.20mediumClaude Sonnet 4.6nonevsGrok 4.20mediumGemini 3.5 FlashminimalvsMiMo-V2.5mediumClaude Opus 4.8nonevsGrok 4.20mediumQwen3.7 MaxnonevsMiMo-V2.5mediumGPT-5.3 ChatnonevsGrok 4.20mediumDeepSeek V4 PrononevsGrok 4.20mediumQwen3.7 PlusnonevsGrok 4.20mediumGemini 3 Flash PreviewnonevsMiMo-V2.5mediumGrok 4.20mediumvsGLM 5.2noneGemini 3.1 Flash Lite PreviewlowvsMiMo-V2.5mediumStep 3.7 FlashhighvsGrok 4.20medium