Navigate
AI BENCHY
Advertise here

Inception: Mercury 2 vs Xiaomi: MiMo-V2.5

MiMo-V2.5 leads on average score with 5.1 vs 4.6. MiMo-V2.5 has the lower benchmark cost at $0.025 vs $0.030. Mercury 2 is faster at 829ms vs 4.62s, with pass rates of 22.7% vs 25.8%.

Recommended modelMiMo-V2.5It has the strongest score in this comparison (5.1) and the best overall balance of cost and response time across all 2 models.

Last updated at: 2026-07-18

Metric Mercury 2 Mercury 2 none Release: 2026-02-24 MiMo-V2.5 MiMo-V2.5 none Release: 2026-04-22
Score 4.6 5.1
Rank #185 #164
Reliability 10.0 10.0
Consistency 9.2 9.6
Tests Correct
Attempt pass rate 22.7% 25.8%
Flaky tests 2 1
Total Runs 66 66
Cost per result 0.734 0.770
Total Cost $0.030 $0.025
Input Price $0.250 / 1M $0.140 / 1M
Output Price $0.750 / 1M $0.280 / 1M
Total Input Tokens 88,704 141,043
Output Tokens 9,564 16,464
Reasoning Tokens 0 0
Response Time (avg) 829ms 4.62s
Response Time (max) 4.52s 55.36s
Response Time (total) 18.24s 101.57s

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#185 Mercury 2

none
Cost
$0.002
Time
1.8s
Tokens
1,514 tok

#164 MiMo-V2.5

none
Cost
$0.007
Time
267.4s
Tokens
25,283 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 3.4 9.6 0.0% 0 1.03s 7,229 3,088 0
MiMo-V2.5 5.5 10.0 33.3% 0 3.24s 7,440 696 0

Quick Compare

Switch Comparison Pair