Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

MiniMax: MiniMax M2.5 vs Nemotron 3 Ultra 550b A55b

Summary

MiniMax M2.5 vs Nemotron 3 Ultra 550b A55b benchmark comparison: Nemotron 3 Ultra 550b A55b leads on average score with 8.1 vs 4.7. Nemotron 3 Ultra 550b A55b has the lower benchmark cost at $0.158 vs $0.164. Nemotron 3 Ultra 550b A55b is faster at 15.05s vs 65.37s, with pass rates of 46.0% vs 69.8%.

Recommended model: Nemotron 3 Ultra 550b A55b - It has the best score here (8.1), while responding about 4.3x faster than MiniMax M2.5.

Last updated at: 2026-07-02

Metric MiniMax M2.5 MiniMax M2.5 medium Release: 2026-02-12 Nemotron 3 Ultra 550b A55b Nemotron 3 Ultra 550b A55b medium Release: 2026-06-04 Free Available
Score 4.7 8.1
Rank #151 #26
Reliability 10.0 9.7
Consistency 6.5 8.8
Tests Correct
Attempt pass rate 46.0% 69.8%
Flaky tests 9 3
Total Runs 63 63
Cost per result 7.900 0.000
Total Cost $0.164 $0.158
Input Price $0.120 / 1M $0.500 / 1M
Output Price $0.480 / 1M $2.200 / 1M
Total Input Tokens 43,706 46,813
Output Tokens 109,495 18,002
Reasoning Tokens 330,814 53,091
Response Time (avg) 65.37s 15.05s
Response Time (max) 251.36s 43.93s
Response Time (total) 849.76s 316.09s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#151 MiniMax M2.5

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

#26 Nemotron 3 Ultra 550b A55b

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 7.9 6.3 83.3% 2 20.82s 612 286 45,344
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 8.62s 780 835 1,485
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 3.4 9.1 0.0% 0 188.58s 6,076 357 106,177
Nemotron 3 Ultra 550b A55b 8.4 7.4 88.9% 1 26.53s 7,686 2,854 17,725
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 4.5 2.1 66.7% 1 60.39s 21,104 740 9,713
Nemotron 3 Ultra 550b A55b 9.8 10.0 100.0% 0 43.93s 17,574 1,040 3,590
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 4.6 1.7 66.7% 2 7.48s 6,584 266 3,835
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 5.68s 7,989 473 1,285
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 2.9 4.4 22.2% 2 237.27s 308 105,047 133,487
Nemotron 3 Ultra 550b A55b 3.5 4.4 33.3% 2 24.90s 858 11,169 16,249
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 3.8 2.5 33.3% 1 6.63s 492 25 1,686
Nemotron 3 Ultra 550b A55b 3.7 9.5 0.0% 0 2.52s 360 70 235
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 7.5 10.0 50.0% 0 621ms 699 156 1,495
Nemotron 3 Ultra 550b A55b 9.8 10.0 100.0% 0 6.35s 765 182 1,243
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 5.3 7.2 44.4% 1 11.21s 495 1,069 9,605
Nemotron 3 Ultra 550b A55b 5.5 9.9 33.3% 0 3.54s 792 771 2,055
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 10.0 10.0 100.0% 0 15.35s 7,123 269 937
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 7.72s 9,781 304 984
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 3.0 10.0 0.0% 0 80.79s 213 1,280 18,535
Nemotron 3 Ultra 550b A55b 3.0 10.0 0.0% 0 38.47s 228 304 8,240

Quick Compare

Switch Comparison Pair

Ling-2.6-1TnonevsMiniMax M2.5mediumMiniMax M2.5mediumvsGPT-5.4 NanononeMercury 2nonevsMiniMax M2.5mediumRing-2.6-1TnonevsMiniMax M2.5mediumDeepSeek V4 FlashhighvsNemotron 3 Ultra 550b A55bmediumFree AvailableLing-2.6-flashnonevsMiniMax M2.5mediumMiniMax M2.5mediumvsNemotron 3 SupernoneFree AvailableMiniMax M2.5mediumvsGLM 4.7 FlashnoneMiniMax M2.5mediumvsGPT-4o-mininoneTrinity Large PreviewnonevsMiniMax M2.5mediumMiniMax M2.5mediumvsGrok 4.20noneNemotron 3 Ultra 550b A55bmediumFree AvailablevsGPT-5.2 Chatnone