Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

MiniMax: MiniMax M2.5 vs OpenAI: GPT-5.4 Mini

Summary

MiniMax M2.5 vs GPT-5.4 Mini benchmark comparison: GPT-5.4 Mini leads on average score with 5.3 vs 4.7. GPT-5.4 Mini has the lower benchmark cost at $0.038 vs $0.303. GPT-5.4 Mini is faster at 1.13s vs 65.37s, with pass rates of 46.0% vs 30.2%.

Recommended model: GPT-5.4 Mini - It has the best score here (5.3), while costing about 8.1x less than MiniMax M2.5.

Last updated at: 2026-06-12

Metric MiniMax M2.5 MiniMax M2.5 medium Release: 2026-02-12 GPT-5.4 Mini GPT-5.4 Mini none Release: 2026-03-17
Score 4.7 5.3
Rank #151 #131
Reliability 10.0 10.0
Consistency 6.5 8.8
Tests Correct
Attempt pass rate 46.0% 30.2%
Flaky tests 9 3
Total Runs 63 63
Cost per result 7.900 0.743
Total Cost $0.303 $0.038
Input Price $0.150 / 1M $0.750 / 1M
Output Price $0.900 / 1M $4.500 / 1M
Total Input Tokens 43,706 34,244
Output Tokens 109,495 2,541
Reasoning Tokens 330,814 0
Response Time (avg) 65.37s 1.13s
Response Time (max) 251.36s 2.52s
Response Time (total) 849.76s 23.82s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#151 MiniMax M2.5

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

#131 GPT-5.4 Mini

none
Cost
$0.010
Time
11.7s
Tokens
2,151 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 7.9 6.3 83.3% 2 20.82s 612 286 45,344
GPT-5.4 Mini 3.1 8.1 8.3% 1 929ms 606 654 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 3.4 9.1 0.0% 0 188.58s 6,076 357 106,177
GPT-5.4 Mini 5.5 10.0 33.3% 0 913ms 7,305 401 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 4.5 2.1 66.7% 1 60.39s 21,104 740 9,713
GPT-5.4 Mini 3.0 10.0 0.0% 0 2.52s 11,019 298 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 4.6 1.7 66.7% 2 7.48s 6,584 266 3,835
GPT-5.4 Mini 10.0 10.0 100.0% 0 1.30s 7,140 222 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 2.9 4.4 22.2% 2 237.27s 308 105,047 133,487
GPT-5.4 Mini 3.5 4.4 33.3% 2 937ms 723 88 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 3.8 2.5 33.3% 1 6.63s 492 25 1,686
GPT-5.4 Mini 4.8 10.0 0.0% 0 1.82s 477 174 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 7.5 10.0 50.0% 0 621ms 699 156 1,495
GPT-5.4 Mini 6.3 10.0 50.0% 0 728ms 660 101 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 5.3 7.2 44.4% 1 11.21s 495 1,069 9,605
GPT-5.4 Mini 5.4 10.0 33.3% 0 836ms 642 305 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 10.0 10.0 100.0% 0 15.35s 7,123 269 937
GPT-5.4 Mini 3.0 10.0 0.0% 0 2.32s 5,477 255 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 3.0 10.0 0.0% 0 80.79s 213 1,280 18,535
GPT-5.4 Mini 3.0 10.0 0.0% 0 1.33s 195 43 0

Quick Compare

Switch Comparison Pair

Ling-2.6-1TnonevsMiniMax M2.5mediumMiniMax M2.5mediumvsgpt-oss-120bnoneFree AvailableMiniMax M2.5mediumvsGPT-5.4 NanononeMercury 2nonevsMiniMax M2.5mediumRing-2.6-1TnonevsMiniMax M2.5mediumMiniMax M2.7mediumvsGPT-5.4 MininoneLing-2.6-flashnonevsMiniMax M2.5mediumMiniMax M2.5mediumvsNemotron 3 SupernoneFree AvailableMiniMax M2.5mediumvsGLM 4.7 FlashnoneMistral Small 4mediumvsGPT-5.4 MininoneMiniMax M2.5mediumvsGPT-4o-mininoneTrinity Large PreviewnonevsMiniMax M2.5medium