Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Inception: Mercury 2 vs Xiaomi: MiMo-V2.5

Last updated at: 2026-04-22

Metric Mercury 2 Mercury 2 medium Release: 2026-02-24 MiMo-V2.5 MiMo-V2.5 none Release: 2026-04-22
Score 6.5 5.1
Rank #56 #92
Consistency 8.6 10.0
Tests Correct
Attempt pass rate 53.7% 27.8%
Flaky tests 3 0
Total Runs 54 54
Cost per result 0.580 0.368
Total Cost $0.047 $0.019
Input Price $0.250 / 1M $0.400 / 1M
Output Price $0.750 / 1M $2.000 / 1M
Output Tokens 3,972 2,177
Reasoning Tokens 48,333 0
Response Time (avg) 2.21s 1.05s
Response Time (max) 14.63s 2.43s
Response Time (total) 37.51s 18.94s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 6.9 9.9 50.0% 0 1.12s 2,546 2,609
MiMo-V2.5 4.8 10.0 25.0% 0 842ms 232 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 10.0 10.0 100.0% 0 1.53s 249 2,213
MiMo-V2.5 10.0 10.0 100.0% 0 1.95s 660 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 10.0 10.0 100.0% 0 3.28s 268 4,887
MiMo-V2.5 3.0 10.0 0.0% 0 2.36s 330 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 7.3 5.9 83.3% 1 1.11s 183 1,656
MiMo-V2.5 6.5 10.0 50.0% 0 1.01s 366 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 2.9 7.2 11.1% 1 6.48s 41 30,754
MiMo-V2.5 3.0 10.0 0.0% 0 756ms 27 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 4.8 10.0 0.0% 0 821ms 137 542
MiMo-V2.5 4.6 10.0 0.0% 0 841ms 97 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 10.0 10.0 100.0% 0 1.07s 14 958
MiMo-V2.5 6.5 10.0 50.0% 0 751ms 72 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 3.9 7.5 22.2% 1 934ms 354 2,758
MiMo-V2.5 3.4 10.0 0.0% 0 731ms 162 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 10.0 10.0 100.0% 0 1.89s 180 1,956
MiMo-V2.5 10.0 10.0 100.0% 0 2.43s 231 0

Quick Compare

Switch Comparison Pair

Mercury 2mediumvsMiMo-V2-OmninoneElephant AlphamediumvsMiMo-V2.5noneMercury 2mediumvsGLM 5noneMiniMax M2.7mediumvsMiMo-V2.5noneMercury 2mediumvsQwen3.5 Plus 2026-02-15noneMercury 2mediumvsGLM 5V TurbononeMercury 2mediumvsQwen3.5-FlashnoneGemma 4 26B A4BnoneFree AvailablevsMercury 2mediumSeed-2.0-LitenonevsMercury 2mediumGemini 2.5 FlashnonevsMercury 2mediumMercury 2mediumvsQwen3.5-35B-A3BnoneDeepSeek V3.2nonevsMercury 2medium