Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

MiniMax: MiniMax M2.5 vs Nemotron 3 Ultra 550b A55b

Last updated at: 2026-06-04

Metric MiniMax M2.5 MiniMax M2.5 medium Release: 2026-02-12 Nemotron 3 Ultra 550b A55b Nemotron 3 Ultra 550b A55b none Release: 2026-06-04 Free Available
Score 5.3 6.0
Rank #129 #104
Reliability 10.0 10.0
Consistency 6.5 9.2
Tests Correct
Attempt pass rate 46.0% 44.4%
Flaky tests 9 2
Total Runs 63 63
Cost per result 7.900 0.000
Total Cost $0.385 $0.000
Input Price $0.150 / 1M $0.000 / 1M
Output Price $1.150 / 1M $0.000 / 1M
Total Input Tokens 43,706 43,326
Output Tokens 109,495 2,138
Reasoning Tokens 330,814 0
Response Time (avg) 65.37s 2.27s
Response Time (max) 251.36s 13.49s
Response Time (total) 849.76s 47.65s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 7.9 6.3 83.3% 2 20.82s 612 286 45,344
Nemotron 3 Ultra 550b A55b 3.5 8.0 16.7% 1 2.35s 696 239 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 3.4 9.1 0.0% 0 188.58s 6,076 357 106,177
Nemotron 3 Ultra 550b A55b 5.5 10.0 33.3% 0 1.02s 7,623 369 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 4.5 2.1 66.7% 1 60.39s 21,104 740 9,713
Nemotron 3 Ultra 550b A55b 3.0 10.0 0.0% 0 4.79s 15,558 357 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 4.6 1.7 66.7% 2 7.48s 6,584 266 3,835
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 1.94s 7,944 249 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 2.9 4.4 22.2% 2 237.27s 308 105,047 133,487
Nemotron 3 Ultra 550b A55b 5.3 10.0 33.3% 0 698ms 789 27 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 3.8 2.5 33.3% 1 6.63s 492 25 1,686
Nemotron 3 Ultra 550b A55b 5.0 10.0 0.0% 0 13.49s 516 101 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 7.5 10.0 50.0% 0 621ms 699 156 1,495
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 1.46s 723 69 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 5.3 7.2 44.4% 1 11.21s 495 1,069 9,605
Nemotron 3 Ultra 550b A55b 5.9 7.2 55.6% 1 1.06s 726 352 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 10.0 10.0 100.0% 0 15.35s 7,123 269 937
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 2.99s 8,544 264 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 3.0 10.0 0.0% 0 80.79s 213 1,280 18,535
Nemotron 3 Ultra 550b A55b 3.0 10.0 0.0% 0 1.83s 207 111 0

Quick Compare

Switch Comparison Pair

MiniMax M2.5mediumvsQwen3.5-122B-A10BnoneDeepSeek V4 ProhighvsNemotron 3 Ultra 550b A55bnoneFree AvailableMiniMax M2.5mediumvsQwen3.6 FlashnoneDeepSeek V3.2nonevsMiniMax M2.5mediumMiniMax M2.5mediumvsGrok 4.20noneMiniMax M2.5mediumvsGLM 5 TurbononeMiniMax M2.5mediumvsgpt-oss-120bnoneFree AvailableMiniMax M2.5mediumvsKimi K2.5noneMiniMax M2.5mediumvsGPT-5.4noneMiniMax M2.5mediumvsKimi K2.6noneFree AvailableNemotron 3 Ultra 550b A55bnoneFree Availablevsgpt-oss-120bmediumFree AvailableMiniMax M2.5mediumvsMiMo-V2.5-Pronone