Navigate
Advertise here

MiniMax M2.5 (medium) vs Nemotron 3.5 Lightning (low)

Nemotron 3.5 Lightning (low) leads on average score with 4.8 vs 4.6. Nemotron 3.5 Lightning (low) has the lower benchmark cost at $0.112 vs $0.327. Nemotron 3.5 Lightning (low) is faster at 59.81s vs 69.08s, with pass rates of 43.9% vs 42.4%.

Last updated at: 2026-09-29

Compared models

Rank
#344
Total Output Tokens
272,229
Response Time (avg)
69.08s
Total Cost
$0.327
Rank
#330
Total Output Tokens
665,174
Response Time (avg)
59.81s
Total Cost
$0.112
Recommended model Nemotron 3.5 Lightning (low)

It has the best score here (4.8), while costing about 2.9x less than MiniMax M2.5 (medium).

Detailed comparison

Metric MiniMax M2.5 MiniMax M2.5 medium Release: 2026-02-12 Nemotron 3.5 Lightning Nemotron 3.5 Lightning low Release: 2026-08-11 Free Available
Score 4.6 4.8
Rank #344 #330
Reliability 10.0 9.8
Consistency 6.6 6.8
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 43.9% 42.4%
Flaky tests 9 9
Total Runs 66 66
Cost per result 6.463 0.000
Total Cost $0.327 $0.112
Input Price $0.270 / 1M $0.060 / 1M
Output Price $1.080 / 1M $0.160 / 1M
Total Input Tokens 142,621 138,792
Output Tokens 20,409 142,972
Reasoning Tokens 251,820 522,202
Response Time (avg) 69.08s 59.81s
Response Time (max) 251.36s 312.21s
Response Time (total) 1036.24s 1315.80s
Parameters 230B total (10B active) 30B total (3B active)
Availability Weights available Weights available

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#344 MiniMax M2.5

medium
Reached the allocated time limit (300 seconds) without receiving showcase output.
Cost
$0.000
Time
300.0s
Tokens
0 tok

#330 Nemotron 3.5 Lightning

low
Cost
$0.000
Time
32.2s
Tokens
6,089 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 3.4 9.1 0.0% 0 188.58s 6,076 357 106,177
Nemotron 3.5 Lightning 4.0 7.8 11.1% 1 224.42s 7,522 72,614 262,558

Quick Compare

Switch Comparison Pair

Ring-2.6-1TnonevsNemotron 3.5 LightninglowFree AvailableNemotron 3.5 LightninglowFree AvailablevsHy4 previewnoneNemotron 3.5 LightninglowFree AvailablevsGPT-5.4 NanononeTrinity Large ThinkinghighvsNemotron 3.5 LightninglowFree AvailableGranite 4.2 8BhighvsMiniMax M2.5mediumMiniMax M2.5mediumvsLaguna S 2.1noneFree AvailableLing-2.6-flashnonevsNemotron 3.5 LightninglowFree AvailableKAT-Coder-Air V2.5nonevsNemotron 3.5 LightninglowFree AvailableNemotron 3.5 LightninglowFree AvailablevsGLM 4.7 FlashnoneTrinity Large PreviewnonevsNemotron 3.5 LightninglowFree AvailableMercury 2nonevsMiniMax M2.5mediumMercury 2.5 PreviewnonevsNemotron 3.5 LightninglowFree Available