Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.3 Chat vs Xiaomi: MiMo-V2.5

Summary

GPT-5.3 Chat leads on average score with 7.5 vs 6.7. MiMo-V2.5 (medium) has the lower benchmark cost at $0.061 vs $0.433. GPT-5.3 Chat is faster at 6.34s vs 27.11s, with pass rates of 66.7% vs 69.8%.

Recommended modelGPT-5.3 ChatIt has the best score here (7.5), while responding about 4.3x faster than MiMo-V2.5 (medium).

Last updated at: 2026-07-14

Metric GPT-5.3 Chat GPT-5.3 Chat none Release: 2026-03-03 MiMo-V2.5 MiMo-V2.5 medium Release: 2026-04-22
Score 7.5 6.7
Rank #61 #94
Reliability 10.0 10.0
Consistency 8.1 8.1
Tests Correct
Attempt pass rate 66.7% 69.8%
Flaky tests 5 5
Total Runs 63 63
Cost per result 3.605 2.966
Total Cost $0.433 $0.061
Input Price $1.750 / 1M $0.105 / 1M
Output Price $14.000 / 1M $0.280 / 1M
Total Input Tokens 34,209 41,838
Output Tokens 26,617 2,827
Reasoning Tokens 0 198,898
Response Time (avg) 6.34s 27.11s
Response Time (max) 18.33s 162.44s
Response Time (total) 133.13s 569.38s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#61 GPT-5.3 Chat

none
Cost
$0.008
Time
8.1s
Tokens
634 tok

#94 MiMo-V2.5

medium
Cost
$0.002
Time
54.8s
Tokens
5,247 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.3 Chat 5.6 4.7 55.6% 2 10.52s 7,302 6,632 0
MiMo-V2.5 6.2 4.7 66.7% 2 97.14s 7,422 557 81,977

Quick Compare

Switch Comparison Pair