Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

MiniMax: MiniMax M2.5 vs Mistral: Mistral Small 4

Summary

MiniMax M2.5 vs Mistral Small 4 benchmark comparison: Mistral Small 4 leads on average score with 5.1 vs 4.7. Mistral Small 4 has the lower benchmark cost at $0.007 vs $0.303. Mistral Small 4 is faster at 630ms vs 65.37s, with pass rates of 46.0% vs 27.0%.

Recommended model: Mistral Small 4 - It has the best score here (5.1), while costing about 43.7x less than MiniMax M2.5.

Last updated at: 2026-06-12

Metric MiniMax M2.5 MiniMax M2.5 medium Release: 2026-02-12 Mistral Small 4 Mistral Small 4 none Release: 2026-03-16
Score 4.7 5.1
Rank #151 #136
Reliability 10.0 10.0
Consistency 6.5 9.5
Tests Correct
Attempt pass rate 46.0% 27.0%
Flaky tests 9 1
Total Runs 63 63
Cost per result 7.900 0.139
Total Cost $0.303 $0.007
Input Price $0.150 / 1M $0.150 / 1M
Output Price $0.900 / 1M $0.600 / 1M
Total Input Tokens 43,706 37,309
Output Tokens 109,495 2,201
Reasoning Tokens 330,814 0
Response Time (avg) 65.37s 630ms
Response Time (max) 251.36s 1.72s
Response Time (total) 849.76s 13.22s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#151 MiniMax M2.5

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

#136 Mistral Small 4

none
Cost
$0.002
Time
10.4s
Tokens
2,370 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 7.9 6.3 83.3% 2 20.82s 612 286 45,344
Mistral Small 4 3.4 7.9 16.7% 1 395ms 708 182 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 3.4 9.1 0.0% 0 188.58s 6,076 357 106,177
Mistral Small 4 3.7 9.7 0.0% 0 901ms 7,636 619 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 4.5 2.1 66.7% 1 60.39s 21,104 740 9,713
Mistral Small 4 3.0 10.0 0.0% 0 1.72s 11,640 496 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 4.6 1.7 66.7% 2 7.48s 6,584 266 3,835
Mistral Small 4 10.0 10.0 100.0% 0 822ms 7,914 261 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 2.9 4.4 22.2% 2 237.27s 308 105,047 133,487
Mistral Small 4 5.3 10.0 33.3% 0 367ms 798 28 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 3.8 2.5 33.3% 1 6.63s 492 25 1,686
Mistral Small 4 4.0 10.0 0.0% 0 729ms 519 205 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 7.5 10.0 50.0% 0 621ms 699 156 1,495
Mistral Small 4 6.5 10.0 50.0% 0 380ms 729 69 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 5.3 7.2 44.4% 1 11.21s 495 1,069 9,605
Mistral Small 4 3.1 9.9 0.0% 0 399ms 735 111 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 10.0 10.0 100.0% 0 15.35s 7,123 269 937
Mistral Small 4 10.0 10.0 100.0% 0 1.40s 6,420 213 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.5 3.0 10.0 0.0% 0 80.79s 213 1,280 18,535
Mistral Small 4 3.0 10.0 0.0% 0 397ms 210 17 0

Quick Compare

Switch Comparison Pair

Ling-2.6-1TnonevsMiniMax M2.5mediumMiniMax M2.7mediumvsMistral Small 4noneMiniMax M2.5mediumvsgpt-oss-120bnoneFree AvailableMiniMax M2.5mediumvsGPT-5.4 NanononeMercury 2nonevsMiniMax M2.5mediumRing-2.6-1TnonevsMiniMax M2.5mediumLing-2.6-flashnonevsMiniMax M2.5mediumMiniMax M2.5mediumvsNemotron 3 SupernoneFree AvailableMiniMax M2.5mediumvsGLM 4.7 FlashnoneCobuddymediumvsMistral Small 4noneMiniMax M2.5mediumvsGPT-4o-mininoneTrinity Large PreviewnonevsMiniMax M2.5medium