Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

MiniMax: MiniMax M2.5 vs OpenAI: GPT-4o-mini

Summary

MiniMax M2.5 vs GPT-4o-mini benchmark comparison: MiniMax M2.5 leads on average score with 5.3 vs 4.8. GPT-4o-mini has the lower benchmark cost at $0.006 vs $0.303. GPT-4o-mini is faster at 1.77s vs 65.37s, with pass rates of 46.0% vs 23.8%.

Recommended model: GPT-4o-mini - Its score stays close to the best score here (4.8 vs 5.3), while costing about 51.1x less than MiniMax M2.5.

Last updated at: 2026-06-10

Metric MiniMax M2.5 MiniMax M2.5 medium Release: 2026-02-12 GPT-4o-mini GPT-4o-mini none Release: 2024-07-18
Score 5.3 4.8
Rank #130 #148
Reliability 10.0 10.0
Consistency 6.5 9.9
Tests Correct
Attempt pass rate 46.0% 23.8%
Flaky tests 9 0
Total Runs 63 63
Cost per result 7.900 0.119
Total Cost $0.303 $0.006
Input Price $0.150 / 1M $0.150 / 1M
Output Price $0.900 / 1M $0.600 / 1M
Total Input Tokens 43,706 31,518
Output Tokens 109,495 1,982
Reasoning Tokens 330,814 0
Response Time (avg) 65.37s 1.77s
Response Time (max) 251.36s 7.58s
Response Time (total) 849.76s 24.80s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#130 MiniMax M2.5

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

#148 GPT-4o-mini

none
Cost
$0.001
Time
6.6s
Tokens
742 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 7.9 6.3 83.3% 2 20.82s 612 286 45,344
GPT-4o-mini 4.8 10.0 25.0% 0 1.34s 618 186 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 3.4 9.1 0.0% 0 188.58s 6,076 357 106,177
GPT-4o-mini 3.2 9.6 0.0% 0 1.63s 7,314 367 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 4.5 2.1 66.7% 1 60.39s 21,104 740 9,713
GPT-4o-mini 3.0 10.0 0.0% 0 7.58s 8,298 568 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 4.6 1.7 66.7% 2 7.48s 6,584 266 3,835
GPT-4o-mini 10.0 10.0 100.0% 0 1.27s 7,161 183 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 2.9 4.4 22.2% 2 237.27s 308 105,047 133,487
GPT-4o-mini 3.0 10.0 0.0% 0 637ms 732 15 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 3.8 2.5 33.3% 1 6.63s 492 25 1,686
GPT-4o-mini 4.0 10.0 0.0% 0 909ms 480 66 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 7.5 10.0 50.0% 0 621ms 699 156 1,495
GPT-4o-mini 6.3 10.0 50.0% 0 1.11s 666 69 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 5.3 7.2 44.4% 1 11.21s 495 1,069 9,605
GPT-4o-mini 3.5 10.0 0.0% 0 1.21s 651 308 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 10.0 10.0 100.0% 0 15.35s 7,123 269 937
GPT-4o-mini 10.0 10.0 100.0% 0 2.51s 5,400 205 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 3.0 10.0 0.0% 0 80.79s 213 1,280 18,535
GPT-4o-mini 3.0 10.0 0.0% 0 794ms 198 15 0

Quick Compare

Switch Comparison Pair

MiniMax M2.5mediumvsQwen3.5-122B-A10BnoneMiniMax M2.5mediumvsQwen3.6 FlashnoneDeepSeek V3.2nonevsMiniMax M2.5mediumMiniMax M2.5mediumvsGrok 4.20noneMiniMax M2.5mediumvsGLM 5 TurbononeMiniMax M2.5mediumvsgpt-oss-120bnoneFree AvailableMiniMax M2.5mediumvsKimi K2.5noneGPT-4o-mininonevsQwen3 Coder NextmediumMiniMax M2.5mediumvsGPT-5.4noneMiniMax M2.5mediumvsKimi K2.6noneFree AvailableMiniMax M2.5mediumvsMiMo-V2.5-PrononeMiniMax M2.5mediumvsGLM 4.7 Flashnone