Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Compared models

Summary

MiniMax M3 vs MiniMax M2.7 vs MiniMax M2.5 benchmark comparisonMiniMax M3 leads on Score with 7.6. MiniMax M2.7 leads on Reliability with 10.0. MiniMax M2.7 has the lowest Total Cost at $0.104. MiniMax M2.7 is fastest at 38.18s.

Recommended model: MiniMax M3 - It has the best score here (7.6), while costing about 1.6x less than the other models in this comparison.

Last updated at: 2026-06-12

Metric MiniMax M3 MiniMax M3 medium Release: 2026-06-01 MiniMax M2.7 MiniMax M2.7 medium Release: 2026-03-18 MiniMax M2.5 MiniMax M2.5 medium Release: 2026-02-12
Score 7.6 5.2 4.7
Rank #43 #134 #151
Reliability 9.6 10.0 10.0
Consistency 7.9 6.8 6.5
Tests Correct
Attempt pass rate 65.1% 46.0% 46.0%
Flaky tests 5 8 9
Total Runs 63 63 63
Cost per result 1.187 2.494 7.900
Total Cost $0.131 $0.104 $0.303
Input Price $0.300 / 1M $0.250 / 1M $0.150 / 1M
Output Price $1.200 / 1M $1.000 / 1M $0.900 / 1M
Total Input Tokens 46,546 34,371 43,706
Output Tokens 49,036 8,981 109,495
Reasoning Tokens 92,543 89,812 330,814
Response Time (avg) 68.17s 38.18s 65.37s
Response Time (max) 431.03s 196.21s 251.36s
Response Time (total) 1363.38s 763.60s 849.76s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#43 MiniMax M3

medium
Cost
$0.012
Time
154.4s
Tokens
10,018 tok

#134 MiniMax M2.7

medium
Cost
$0.022
Time
22.8s
Tokens
9,250 tok

#151 MiniMax M2.5

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M3 5.5 3.7 66.7% 3 14.95s 2,526 874 3,414
MiniMax M2.7 7.9 6.3 83.3% 2 40.32s 654 3,010 17,716
MiniMax M2.5 7.9 6.3 83.3% 2 20.82s 612 286 45,344
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M3 6.1 6.5 55.6% 1 144.74s 5,804 6,223 32,667
MiniMax M2.7 5.7 9.1 33.3% 0 101.89s 2,961 1,231 38,841
MiniMax M2.5 3.4 9.1 0.0% 0 188.58s 6,076 357 106,177
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M3 10.0 10.0 100.0% 0 65.30s 14,760 1,306 6,253
MiniMax M2.7 4.7 1.6 66.7% 1 41.03s 14,233 369 4,480
MiniMax M2.5 4.5 2.1 66.7% 1 60.39s 21,104 740 9,713
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M3 10.0 10.0 100.0% 0 14.92s 8,088 514 3,164
MiniMax M2.7 6.3 5.8 66.7% 1 21.95s 7,152 187 5,882
MiniMax M2.5 4.6 1.7 66.7% 2 7.48s 6,584 266 3,835
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M3 5.5 9.3 33.3% 0 233.13s 869 16,254 19,070
MiniMax M2.7 3.0 10.0 0.0% 0 19.00s 245 8 2,796
MiniMax M2.5 2.9 4.4 22.2% 2 237.27s 308 105,047 133,487
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M3 5.1 3.4 33.3% 1 33.25s 954 2,487 2,523
MiniMax M2.7 3.9 2.5 33.3% 1 38.70s 486 92 5,204
MiniMax M2.5 3.8 2.5 33.3% 1 6.63s 492 25 1,686
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M3 9.8 10.0 100.0% 0 6.14s 1,623 103 920
MiniMax M2.7 3.8 5.8 33.3% 1 12.80s 687 350 2,600
MiniMax M2.5 7.5 10.0 50.0% 0 621ms 699 156 1,495
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M3 7.9 9.9 66.7% 0 49.91s 2,079 11,946 13,761
MiniMax M2.7 5.9 7.2 55.6% 1 24.87s 675 362 7,840
MiniMax M2.5 5.3 7.2 44.4% 1 11.21s 495 1,069 9,605
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M3 10.0 10.0 100.0% 0 11.91s 9,168 281 555
MiniMax M2.7 4.7 1.6 66.7% 1 12.05s 7,067 304 1,001
MiniMax M2.5 10.0 10.0 100.0% 0 15.35s 7,123 269 937
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M3 3.0 10.0 0.0% 0 100.80s 675 9,048 10,216
MiniMax M2.7 3.0 10.0 0.0% 0 22.77s 211 3,068 3,452
MiniMax M2.5 3.0 10.0 0.0% 0 80.79s 213 1,280 18,535

Quick Compare

Switch Comparison Pair

MiniMax M2.7mediumvsQwen3.6 35B A3BnoneLing-2.6-1TnonevsMiniMax M2.5mediumMiniMax M2.7mediumvsMistral Small 4noneMiniMax M2.7mediumvsQwen3 Coder NextnoneMiniMax M2.5mediumvsgpt-oss-120bnoneFree AvailableMiniMax M2.5mediumvsGPT-5.4 NanononeMiniMax M3mediumvsStep 3.7 FlashlowMiniMax M2.7mediumvsMiMo-V2.5noneMercury 2nonevsMiniMax M2.5mediumDeepSeek V3.2nonevsMiniMax M2.7mediumMiniMax M2.7mediumvsQwen3.5-9BnoneRing-2.6-1TnonevsMiniMax M2.5medium