Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

MiniMax: MiniMax M2.7 vs Mistral: Mistral Small 4

Last updated at: 2026-03-18

Metric MiniMax M2.7 MiniMax M2.7 medium Release: 2026-03-18 Mistral Small 4 Mistral Small 4 none Release: 2026-03-16
Score 5.0 5.3
Rank #64 #61
Consistency 5.3 9.5
Tests Correct
Attempt pass rate 49.0% 33.3%
Flaky tests 10 1
Total Runs 51 51
Cost per result 2.398 0.108
Total Cost $0.072 $0.006
Input Price $0.300 / 1M $0.150 / 1M
Output Price $1.200 / 1M $0.600 / 1M
Output Tokens 4,517 1,624
Reasoning Tokens 47,612 0
Response Time (avg) 27.32s 629ms
Response Time (max) 117.04s 1.72s
Response Time (total) 437.10s 10.70s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 7.9 6.3 83.3% 2 40.32s 3,010 17,716
Mistral Small 4 3.4 7.9 16.7% 1 395ms 182 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 4.7 1.6 66.7% 1 41.03s 369 4,480
Mistral Small 4 3.0 10.0 0.0% 0 1.72s 496 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 6.3 5.8 66.7% 1 21.95s 187 5,882
Mistral Small 4 10.0 10.0 100.0% 0 822ms 261 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 3.0 10.0 0.0% 0 19.00s 8 2,796
Mistral Small 4 5.3 10.0 33.3% 0 367ms 28 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 3.9 2.5 33.3% 1 38.70s 92 5,204
Mistral Small 4 4.0 10.0 0.0% 0 729ms 205 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 3.7 1.8 50.0% 2 12.64s 213 2,457
Mistral Small 4 6.5 10.0 50.0% 0 380ms 69 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 3.8 4.5 33.3% 2 25.62s 334 8,076
Mistral Small 4 3.1 9.9 0.0% 0 589ms 170 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 4.7 1.6 66.7% 1 12.05s 304 1,001
Mistral Small 4 10.0 10.0 100.0% 0 1.40s 213 0

Quick Compare

Switch Comparison Pair

MiniMax M2.7mediumvsQwen3 Coder NextnoneMiniMax M2.7mediumvsGPT-4o-mininoneMercury 2nonevsMiniMax M2.7mediumMiniMax M2.7mediumvsGPT-5.4 MininoneMiniMax M2.7mediumvsNemotron 3 Super 120b A12bnoneFree AvailableMiniMax M2.7mediumvsQwen3.5-9BnoneTrinity Large PreviewnoneFree AvailablevsMiniMax M2.7mediumMiniMax M2.7mediumvsKimi K2.5noneMiniMax M2.7mediumvsGrok 4.20 BetanoneMistral Small 4nonevsQwen3 Coder NextmediumMiniMax M2.7mediumvsGLM 4.7 FlashnoneMiniMax M2.7mediumvsGLM 5 Turbonone