Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

MiniMax: MiniMax M2.7 vs Mistral: Mistral Small 4

Last updated at: 2026-04-29

Metric MiniMax M2.7 MiniMax M2.7 medium Release: 2026-03-18 Mistral Small 4 Mistral Small 4 medium Release: 2026-03-16
Score 5.3 5.7
Rank #105 #96
Reliability N/A N/A
Consistency 5.5 6.8
Tests Correct
Attempt pass rate 51.9% 50.0%
Flaky tests 10 7
Total Runs 54 54
Cost per result 2.273 0.674
Total Cost $0.091 $0.034
Input Price $0.300 / 1M $0.150 / 1M
Output Price $1.200 / 1M $0.600 / 1M
Output Tokens 4,984 15,084
Reasoning Tokens 62,787 39,408
Response Time (avg) 31.08s 5.64s
Response Time (max) 117.04s 30.49s
Response Time (total) 528.37s 101.52s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 7.9 6.3 83.3% 2 40.32s 3,010 17,716
Mistral Small 4 5.6 3.8 66.7% 3 2.67s 4,055 4,778
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 10.0 10.0 100.0% 0 91.27s 467 15,175
Mistral Small 4 6.7 3.5 66.7% 1 30.49s 2,796 11,296
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 4.7 1.6 66.7% 1 41.03s 369 4,480
Mistral Small 4 3.0 10.0 0.0% 0 25.25s 2,612 10,700
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 6.3 5.8 66.7% 1 21.95s 187 5,882
Mistral Small 4 7.3 5.9 83.3% 1 1.23s 335 723
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 3.0 10.0 0.0% 0 19.00s 8 2,796
Mistral Small 4 5.3 7.2 44.4% 1 6.11s 2,621 6,904
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 3.9 2.5 33.3% 1 38.70s 92 5,204
Mistral Small 4 4.8 10.0 0.0% 0 2.05s 821 828
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 3.7 1.8 50.0% 2 12.64s 213 2,457
Mistral Small 4 7.3 5.8 83.3% 1 1.38s 540 1,031
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 3.8 4.5 33.3% 2 25.62s 334 8,076
Mistral Small 4 3.4 9.7 0.0% 0 2.00s 983 2,338
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 4.7 1.6 66.7% 1 12.05s 304 1,001
Mistral Small 4 10.0 10.0 100.0% 0 3.50s 321 810

Quick Compare

Switch Comparison Pair

DeepSeek V4 FlashnonevsMiniMax M2.7mediumMiniMax M2.7mediumvsGrok 4.20noneMiniMax M2.7mediumvsMistral Small 4noneTrinity Large PreviewnonevsMiniMax M2.7mediumMistral Small 4mediumvsQwen3.5-122B-A10BnoneMiniMax M2.7mediumvsgpt-oss-120bnoneFree AvailableMistral Small 4mediumvsGLM 4.7 FlashnoneMistral Small 4mediumvsGLM 5.1noneLing-2.6-flashnoneFree AvailablevsMiniMax M2.7mediumMiniMax M2.7mediumvsElephant AlphanoneMistral Small 4mediumvsKimi K2.5noneMistral Small 4mediumvsQwen3.6 Flashnone