Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

MiniMax: MiniMax M2.5 vs OpenAI: GPT-5.6 Luna

Summary

MiniMax M2.5 (medium) vs GPT-5.6 Luna benchmark comparison: GPT-5.6 Luna leads on average score with 5.3 vs 4.7. GPT-5.6 Luna has the lower benchmark cost at $0.047 vs $0.303. GPT-5.6 Luna is faster at 1.06s vs 65.37s, with pass rates of 46.0% vs 36.5%.

Recommended model: GPT-5.6 Luna - It has the best score here (5.3), while costing about 6.6x less than MiniMax M2.5 (medium).

Last updated at: 2026-07-09

Metric MiniMax M2.5 MiniMax M2.5 medium Release: 2026-02-12 GPT-5.6 Luna GPT-5.6 Luna none Release: 2026-07-09
Score 4.7 5.3
Rank #165 #142
Reliability 10.0 10.0
Consistency 6.5 8.8
Tests Correct
Attempt pass rate 46.0% 36.5%
Flaky tests 9 3
Total Runs 63 63
Cost per result 7.900 0.767
Total Cost $0.303 $0.047
Input Price $0.150 / 1M $1.000 / 1M
Output Price $0.900 / 1M $6.000 / 1M
Total Input Tokens 43,706 34,218
Output Tokens 109,495 1,967
Reasoning Tokens 330,814 0
Response Time (avg) 65.37s 1.06s
Response Time (max) 251.36s 2.80s
Response Time (total) 849.76s 22.34s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#165 MiniMax M2.5

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

#142 GPT-5.6 Luna

none
Cost
$0.016
Time
15.8s
Tokens
2,685 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 7.9 6.3 83.3% 2 20.82s 612 286 45,344
GPT-5.6 Luna 4.8 10.0 25.0% 0 901ms 606 266 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 3.4 9.1 0.0% 0 188.58s 6,076 357 106,177
GPT-5.6 Luna 3.8 7.2 22.2% 1 980ms 7,302 459 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 4.5 2.1 66.7% 1 60.39s 21,104 740 9,713
GPT-5.6 Luna 3.0 10.0 0.0% 0 2.78s 11,019 280 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 4.6 1.7 66.7% 2 7.48s 6,584 266 3,835
GPT-5.6 Luna 10.0 10.0 100.0% 0 758ms 7,140 222 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 2.9 4.4 22.2% 2 237.27s 308 105,047 133,487
GPT-5.6 Luna 2.9 7.2 11.1% 1 737ms 723 54 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 3.8 2.5 33.3% 1 6.63s 492 25 1,686
GPT-5.6 Luna 5.0 10.0 0.0% 0 1.00s 477 150 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 7.5 10.0 50.0% 0 621ms 699 156 1,495
GPT-5.6 Luna 7.1 5.8 83.3% 1 1.23s 660 86 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 5.3 7.2 44.4% 1 11.21s 495 1,069 9,605
GPT-5.6 Luna 5.3 10.0 33.3% 0 790ms 642 202 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 10.0 10.0 100.0% 0 15.35s 7,123 269 937
GPT-5.6 Luna 10.0 10.0 100.0% 0 2.80s 5,454 222 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 3.0 10.0 0.0% 0 80.79s 213 1,280 18,535
GPT-5.6 Luna 3.0 10.0 0.0% 0 651ms 195 26 0

Quick Compare

Switch Comparison Pair

Ling-2.6-1TnonevsMiniMax M2.5mediumMiniMax M2.5mediumvsGPT-5.4 NanononeMercury 2nonevsMiniMax M2.5mediumRing-2.6-1TnonevsMiniMax M2.5mediumMiniMax M2.7mediumvsGPT-5.6 LunanoneLing-2.6-flashnonevsMiniMax M2.5mediumMiniMax M2.5mediumvsNemotron 3 SupernoneFree AvailableMiniMax M2.5mediumvsGLM 4.7 FlashnoneMistral Small 4mediumvsGPT-5.6 LunanoneMiniMax M2.5mediumvsGPT-4o-mininoneTrinity Large PreviewnonevsMiniMax M2.5mediumMiniMax M2.5mediumvsGrok 4.20none