Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.4 vs Xiaomi: MiMo-V2.5

Summary

GPT-5.4 vs MiMo-V2.5 benchmark comparison: GPT-5.4 leads on average score with 5.8 vs 5.1. MiMo-V2.5 has the lower benchmark cost at $0.007 vs $0.122. GPT-5.4 is faster at 1.42s vs 2.20s, with pass rates of 36.5% vs 27.0%.

Recommended model: MiMo-V2.5 - Its score stays close to the best score here (5.1 vs 5.8), while costing about 18.7x less than GPT-5.4.

Last updated at: 2026-06-12

Metric GPT-5.4 GPT-5.4 none Release: 2026-03-05 MiMo-V2.5 MiMo-V2.5 none Release: 2026-04-22
Score 5.8 5.1
Rank #116 #139
Reliability 10.0 10.0
Consistency 9.2 9.6
Tests Correct
Attempt pass rate 36.5% 27.0%
Flaky tests 2 1
Total Runs 63 63
Cost per result 1.740 0.413
Total Cost $0.122 $0.007
Input Price $2.500 / 1M $0.140 / 1M
Output Price $15.000 / 1M $0.280 / 1M
Total Input Tokens 34,212 41,985
Output Tokens 2,417 2,267
Reasoning Tokens 0 0
Response Time (avg) 1.42s 2.20s
Response Time (max) 2.95s 6.86s
Response Time (total) 29.87s 46.21s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#116 GPT-5.4

none
Cost
$0.026
Time
18.1s
Tokens
1,792 tok

#139 MiMo-V2.5

none
Cost
$0.007
Time
267.4s
Tokens
25,283 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 3.2 8.0 8.3% 1 1.21s 606 406 0
MiMo-V2.5 3.5 8.0 16.7% 1 2.19s 645 282 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 5.5 10.0 33.3% 0 1.62s 7,305 516 0
MiMo-V2.5 5.5 10.0 33.3% 0 3.24s 7,440 696 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 3.0 10.0 0.0% 0 2.89s 11,019 291 0
MiMo-V2.5 3.0 10.0 0.0% 0 2.36s 15,075 330 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 1.04s 7,140 222 0
MiMo-V2.5 6.5 10.0 50.0% 0 1.01s 7,758 366 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 5.3 7.2 44.4% 1 1.07s 723 50 0
MiMo-V2.5 3.0 10.0 0.0% 0 756ms 753 27 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 4.4 9.9 0.0% 0 1.78s 477 184 0
MiMo-V2.5 4.4 9.9 0.0% 0 6.86s 498 81 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 6.5 10.0 50.0% 0 1.07s 660 81 0
MiMo-V2.5 6.5 10.0 50.0% 0 751ms 684 72 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 5.6 9.8 33.3% 0 1.44s 642 381 0
MiMo-V2.5 5.4 10.0 33.3% 0 2.13s 678 166 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 2.75s 5,445 246 0
MiMo-V2.5 10.0 10.0 100.0% 0 2.43s 8,238 231 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 3.0 10.0 0.0% 0 990ms 195 40 0
MiMo-V2.5 3.0 10.0 0.0% 0 3.89s 216 16 0

Quick Compare

Switch Comparison Pair

Mistral Small 4mediumvsMiMo-V2.5noneMiniMax M2.7mediumvsMiMo-V2.5noneCobuddymediumvsMiMo-V2.5noneGemini 3.1 Flash LiteminimalvsGPT-5.4noneMiniMax M2.5mediumvsMiMo-V2.5noneQwen3 Coder NextmediumvsMiMo-V2.5noneDeepSeek V4 ProhighvsGPT-5.4noneGPT-5.4nonevsQwen3.5-35B-A3BmediumGemma 4 31BmediumFree AvailablevsGPT-5.4noneNemotron 3 SupermediumFree AvailablevsGPT-5.4noneMiniMax M2.7mediumvsGPT-5.4noneGemini 3.1 Flash LitelowvsGPT-5.4none