Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

MiniMax: MiniMax M2.5 vs Mistral: Mistral Small 4

Last updated at: 2026-03-17

Metric MiniMax M2.5 MiniMax M2.5 medium Release: 2026-02-12 Free Available Mistral Small 4 Mistral Small 4 none Release: 2026-03-16
Rank #50 #61
Score 5.9 5.3
Consistency 5.4 9.5
Cost per result 4.987 0.108
Total Cost $0.250 $0.006
Tests Correct
Attempt pass rate 60.8% 33.3%
Flaky tests 10 1
Total Runs 51 51
Output Tokens 107,044 1,624
Reasoning Tokens 206,422 0
Response Time (avg) 39.65s 629ms
Response Time (max) 237.27s 1.72s
Response Time (total) 396.47s 10.70s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 7.9 6.3 83.3% 2 20.82s 286 45,344
Mistral Small 4 3.4 7.9 16.7% 1 395ms 182 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 4.5 2.1 66.7% 1 60.39s 740 9,713
Mistral Small 4 3.0 10.0 0.0% 0 1.72s 496 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 4.6 1.7 66.7% 2 7.48s 266 3,835
Mistral Small 4 10.0 10.0 100.0% 0 822ms 261 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 2.9 4.4 22.2% 2 237.27s 105,047 133,487
Mistral Small 4 5.3 10.0 33.3% 0 367ms 28 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 3.8 2.5 33.3% 1 6.63s 25 1,686
Mistral Small 4 4.0 10.0 0.0% 0 729ms 205 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 8.1 6.8 83.3% 1 4.64s 252 1,873
Mistral Small 4 6.5 10.0 50.0% 0 380ms 69 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 5.3 7.2 44.4% 1 11.54s 159 9,547
Mistral Small 4 3.1 9.9 0.0% 0 589ms 170 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 10.0 10.0 100.0% 0 15.35s 269 937
Mistral Small 4 10.0 10.0 100.0% 0 1.40s 213 0

Quick Compare

Switch Comparison Pair

MiniMax M2.5mediumFree AvailablevsQwen3.5-35B-A3BnoneMiniMax M2.5mediumFree AvailablevsHunter AlphanoneGemini 2.5 FlashnonevsMiniMax M2.5mediumFree AvailableMiniMax M2.5mediumFree AvailablevsQwen3.5-122B-A10BnoneSeed-2.0-LitenonevsMiniMax M2.5mediumFree AvailableMiniMax M2.5mediumFree AvailablevsQwen3.5-FlashnoneMiniMax M2.5mediumFree AvailablevsGPT-5.4noneMiniMax M2.5mediumFree AvailablevsQwen3.5-27BnoneMiniMax M2.5mediumFree AvailablevsGLM 5 TurbononeMiniMax M2.5mediumFree AvailablevsGLM 4.7 FlashnoneMistral Small 4nonevsQwen3 Coder NextmediumDeepSeek V3.2nonevsMiniMax M2.5mediumFree Available