Navigate
AI BENCHY
Advertise here

MiniMax M3 (medium) vs GPT-5.4 Nano (medium)

The average score is effectively tied at 7.5 vs 7.5. GPT-5.4 Nano (medium) has the lower benchmark cost at $0.142 vs $0.300. GPT-5.4 Nano (medium) is faster at 13.32s vs 75.15s, with pass rates of 62.1% vs 65.2%.

Last updated at: 2026-08-20

Rank
#84
Total Output Tokens
275,782
Response Time (avg)
75.15s
Total Cost
$0.300
Rank
#82
Total Output Tokens
99,881
Response Time (avg)
13.32s
Total Cost
$0.142
Recommended model GPT-5.4 Nano (medium)

It has the best score here (7.5), while costing about 2.1x less than MiniMax M3 (medium).

Detailed comparison

Metric MiniMax M3 MiniMax M3 medium Release: 2026-06-01 GPT-5.4 Nano GPT-5.4 Nano medium Release: 2026-03-17
Score 7.5 7.5
Rank #84 #82
Reliability 9.7 10.0
Consistency 8.0 8.5
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 62.1% 65.2%
Flaky tests 5 4
Total Runs 66 66
Cost per result 2.724 1.179
Total Cost $0.300 $0.142
Input Price $0.300 / 1M $0.200 / 1M
Output Price $1.200 / 1M $1.250 / 1M
Total Input Tokens 121,996 82,828
Output Tokens 90,051 7,100
Reasoning Tokens 185,731 92,781
Response Time (avg) 75.15s 13.32s
Response Time (max) 431.03s 94.06s
Response Time (total) 1578.24s 292.97s
Parameters 428B total (23B active) ~120B total (~5B active)
Availability Weights available Closed

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#84 MiniMax M3

medium
Cost
$0.012
Time
154.4s
Tokens
10,018 tok

#82 GPT-5.4 Nano

medium
Cost
$0.007
Time
24.6s
Tokens
4,943 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M3 6.1 6.5 55.6% 1 144.74s 5,804 6,223 32,667
GPT-5.4 Nano 6.1 4.7 66.7% 2 19.12s 7,305 516 20,778

Quick Compare

Switch Comparison Pair