Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Inception: Mercury 2 vs MiniMax: MiniMax M2.5

Last updated at: 2026-04-16

Metric Mercury 2 Mercury 2 none Release: 2026-02-24 MiniMax M2.5 MiniMax M2.5 medium Release: 2026-02-12 Free Available
Score 4.8 5.7
Rank #89 #69
Consistency 9.0 5.6
Tests Correct
Attempt pass rate 27.8% 57.4%
Flaky tests 2 10
Total Runs 54 54
Cost per result 0.165 4.987
Total Cost $0.007 $0.250
Input Price $0.250 / 1M $0.118 / 1M
Output Price $0.750 / 1M $0.991 / 1M
Output Tokens 1,625 107,044
Reasoning Tokens 0 206,422
Response Time (avg) 613ms 39.65s
Response Time (max) 1.27s 237.27s
Response Time (total) 11.04s 396.47s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 3.0 10.0 0.0% 0 483ms 286 0
MiniMax M2.5 7.9 6.3 83.3% 2 20.82s 286 45,344
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 3.6 8.9 0.0% 0 969ms 310 0
MiniMax M2.5 3.0 10.0 0.0% 0 0ms 0 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 3.0 10.0 0.0% 0 606ms 131 0
MiniMax M2.5 4.5 2.1 66.7% 1 60.39s 740 9,713
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 7.3 5.9 83.3% 1 667ms 180 0
MiniMax M2.5 4.6 1.7 66.7% 2 7.48s 266 3,835
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 5.3 7.2 44.4% 1 534ms 46 0
MiniMax M2.5 2.9 4.4 22.2% 2 237.27s 105,047 133,487
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 4.8 10.0 0.0% 0 628ms 159 0
MiniMax M2.5 3.8 2.5 33.3% 1 6.63s 25 1,686
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 6.5 10.0 50.0% 0 551ms 82 0
MiniMax M2.5 8.1 6.8 83.3% 1 4.64s 252 1,873
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 3.1 10.0 0.0% 0 533ms 234 0
MiniMax M2.5 5.3 7.2 44.4% 1 11.54s 159 9,547
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 10.0 10.0 100.0% 0 1.27s 197 0
MiniMax M2.5 10.0 10.0 100.0% 0 15.35s 269 937

Quick Compare

Switch Comparison Pair

MiniMax M2.5mediumFree AvailablevsQwen3.5-122B-A10BnoneMercury 2nonevsQwen3 Coder NextmediumMiniMax M2.5mediumFree AvailablevsGLM 4.7 FlashnoneMiniMax M2.5mediumFree AvailablevsGLM 5.1noneMiniMax M2.5mediumFree AvailablevsKimi K2.5noneMiniMax M2.5mediumFree AvailablevsGLM 5 TurbononeMiniMax M2.5mediumFree AvailablevsQwen3.5-27BnoneMercury 2nonevsGLM 4.7 FlashmediumMiniMax M2.5mediumFree AvailablevsGPT-5.4noneMiniMax M2.5mediumFree AvailablevsMiMo-V2-PrononeTrinity Large PreviewnoneFree AvailablevsMiniMax M2.5mediumFree AvailableMercury 2nonevsQwen3.5-9Bmedium