Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

MiniMax: MiniMax M2.7 vs Mistral: Mistral Small 4

Summary

MiniMax M2.7 vs Mistral Small 4 benchmark comparison: The average score is effectively tied at 5.2 vs 5.1. Mistral Small 4 has the lower benchmark cost at $0.007 vs $0.104. Mistral Small 4 is faster at 630ms vs 38.18s, with pass rates of 46.0% vs 27.0%.

Recommended model: Mistral Small 4 - It has the best score here (5.1), while costing about 15.0x less than MiniMax M2.7.

Last updated at: 2026-06-18

Metric MiniMax M2.7 MiniMax M2.7 medium Release: 2026-03-18 Mistral Small 4 Mistral Small 4 none Release: 2026-03-16
Score 5.2 5.1
Rank #127 #129
Reliability 10.0 10.0
Consistency 6.8 9.5
Tests Correct
Attempt pass rate 46.0% 27.0%
Flaky tests 8 1
Total Runs 63 63
Cost per result 2.494 0.139
Total Cost $0.104 $0.007
Input Price $0.250 / 1M $0.150 / 1M
Output Price $1.000 / 1M $0.600 / 1M
Total Input Tokens 34,371 37,309
Output Tokens 8,981 2,201
Reasoning Tokens 89,812 0
Response Time (avg) 38.18s 630ms
Response Time (max) 196.21s 1.72s
Response Time (total) 763.60s 13.22s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#127 MiniMax M2.7

medium
Cost
$0.022
Time
22.8s
Tokens
9,250 tok

#129 Mistral Small 4

none
Cost
$0.002
Time
10.4s
Tokens
2,370 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.7 7.9 6.3 83.3% 2 40.32s 654 3,010 17,716
Mistral Small 4 3.4 7.9 16.7% 1 395ms 708 182 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.7 5.7 9.1 33.3% 0 101.89s 2,961 1,231 38,841
Mistral Small 4 3.7 9.7 0.0% 0 901ms 7,636 619 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.7 4.7 1.6 66.7% 1 41.03s 14,233 369 4,480
Mistral Small 4 3.0 10.0 0.0% 0 1.72s 11,640 496 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.7 6.3 5.8 66.7% 1 21.95s 7,152 187 5,882
Mistral Small 4 10.0 10.0 100.0% 0 822ms 7,914 261 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.7 3.0 10.0 0.0% 0 19.00s 245 8 2,796
Mistral Small 4 5.3 10.0 33.3% 0 367ms 798 28 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.7 3.9 2.5 33.3% 1 38.70s 486 92 5,204
Mistral Small 4 4.0 10.0 0.0% 0 729ms 519 205 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.7 3.8 5.8 33.3% 1 12.80s 687 350 2,600
Mistral Small 4 6.5 10.0 50.0% 0 380ms 729 69 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.7 5.9 7.2 55.6% 1 24.87s 675 362 7,840
Mistral Small 4 3.1 9.9 0.0% 0 399ms 735 111 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.7 4.7 1.6 66.7% 1 12.05s 7,067 304 1,001
Mistral Small 4 10.0 10.0 100.0% 0 1.40s 6,420 213 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M2.7 3.0 10.0 0.0% 0 22.77s 211 3,068 3,452
Mistral Small 4 3.0 10.0 0.0% 0 397ms 210 17 0

Quick Compare

Switch Comparison Pair

MiniMax M2.7mediumvsQwen3.6 35B A3BnoneMiniMax M2.7mediumvsQwen3 Coder NextnoneNorth Mini CodenoneFree AvailablevsMiniMax M2.7mediumMiniMax M2.7mediumvsMiMo-V2.5noneDeepSeek V3.2nonevsMiniMax M2.7mediumMiniMax M2.7mediumvsQwen3.5-9BnoneMiniMax M2.7mediumvsQwen3.5-122B-A10BnoneMiniMax M2.7mediumvsGPT-5.4 MininoneTrinity Large PreviewnonevsMiniMax M2.7mediumCobuddymediumvsMistral Small 4noneMiniMax M2.7mediumvsGPT-4o-mininoneMiniMax M2.7mediumvsQwen3.5 Plus 2026-04-20none