Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

MiniMax: MiniMax M2.7 vs Nemotron 3 Ultra 550b A55b

Last updated at: 2026-06-04

Metric MiniMax M2.7 MiniMax M2.7 medium Release: 2026-03-18 Nemotron 3 Ultra 550b A55b Nemotron 3 Ultra 550b A55b none Release: 2026-06-04 Free Available
Score 5.3 6.0
Rank #130 #104
Reliability 10.0 10.0
Consistency 6.8 9.2
Tests Correct
Attempt pass rate 46.0% 44.4%
Flaky tests 8 2
Total Runs 63 63
Cost per result 2.494 0.000
Total Cost $0.124 $0.000
Input Price $0.279 / 1M $0.000 / 1M
Output Price $1.200 / 1M $0.000 / 1M
Total Input Tokens 34,371 43,326
Output Tokens 8,981 2,138
Reasoning Tokens 89,812 0
Response Time (avg) 38.18s 2.27s
Response Time (max) 196.21s 13.49s
Response Time (total) 763.60s 47.65s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.7 7.9 6.3 83.3% 2 40.32s 654 3,010 17,716
Nemotron 3 Ultra 550b A55b 3.5 8.0 16.7% 1 2.35s 696 239 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.7 5.7 9.1 33.3% 0 101.89s 2,961 1,231 38,841
Nemotron 3 Ultra 550b A55b 5.5 10.0 33.3% 0 1.02s 7,623 369 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.7 4.7 1.6 66.7% 1 41.03s 14,233 369 4,480
Nemotron 3 Ultra 550b A55b 3.0 10.0 0.0% 0 4.79s 15,558 357 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.7 6.3 5.8 66.7% 1 21.95s 7,152 187 5,882
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 1.94s 7,944 249 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.7 3.0 10.0 0.0% 0 19.00s 245 8 2,796
Nemotron 3 Ultra 550b A55b 5.3 10.0 33.3% 0 698ms 789 27 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.7 3.9 2.5 33.3% 1 38.70s 486 92 5,204
Nemotron 3 Ultra 550b A55b 5.0 10.0 0.0% 0 13.49s 516 101 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.7 3.8 5.8 33.3% 1 12.80s 687 350 2,600
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 1.46s 723 69 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.7 5.9 7.2 55.6% 1 24.87s 675 362 7,840
Nemotron 3 Ultra 550b A55b 5.9 7.2 55.6% 1 1.06s 726 352 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.7 4.7 1.6 66.7% 1 12.05s 7,067 304 1,001
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 2.99s 8,544 264 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.7 3.0 10.0 0.0% 0 22.77s 211 3,068 3,452
Nemotron 3 Ultra 550b A55b 3.0 10.0 0.0% 0 1.83s 207 111 0

Quick Compare

Switch Comparison Pair

MiniMax M2.7mediumvsQwen3.5-122B-A10BnoneDeepSeek V4 ProhighvsNemotron 3 Ultra 550b A55bnoneFree AvailableDeepSeek V3.2nonevsMiniMax M2.7mediumMiniMax M2.7mediumvsQwen3.6 FlashnoneMiniMax M2.7mediumvsGLM 5 TurbononeMiniMax M2.7mediumvsKimi K2.5noneMiniMax M2.7mediumvsGrok 4.20noneMiniMax M2.7mediumvsgpt-oss-120bnoneFree AvailableNemotron 3 Ultra 550b A55bnoneFree Availablevsgpt-oss-120bmediumFree AvailableMiniMax M2.7mediumvsGPT-5.4noneMiniMax M2.7mediumvsKimi K2.6noneFree AvailableMiniMax M2.7mediumvsMiMo-V2.5-Pronone