MiniMax M2.7 (medium) vs Mistral Small 4 (medium)

Recommended model Mistral Small 4 (medium)

It has the best score here (5.1), while costing about 1.7x less than MiniMax M2.7 (medium).

Detailed comparison

Metric	MiniMax M2.7 MiniMax M2.7 medium Release: 2026-03-18	Mistral Small 4 Mistral Small 4 medium Release: 2026-03-16

Metric	MiniMax M2.7 MiniMax M2.7 medium Release: 2026-03-18	Mistral Small 4 Mistral Small 4 medium Release: 2026-03-16
Score	5.0	5.1
Rank	#192	#187
Reliability	10.0	10.0
Consistency	6.6	7.0
Tests Correct
Attempt pass rate	45.5%	42.4%
Flaky tests	9	8
Total Runs	66	66
Cost per result	3.906	1.913
Total Cost	$0.163	$0.096
Input Price	$0.250 / 1M	$0.150 / 1M
Output Price	$1.000 / 1M	$0.600 / 1M
Total Input Tokens	114,518	140,494
Output Tokens	18,558	39,462
Reasoning Tokens	119,036	92,362
Response Time (avg)	41.28s	10.77s
Response Time (max)	196.21s	59.15s
Response Time (total)	866.81s	236.94s

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

medium

medium

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
MiniMax M2.7	7.9	6.3	83.3%	2		40.32s	654	3,010	17,716
Mistral Small 4	5.6	3.8	66.7%	3		2.67s	708	4,055	4,778

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
MiniMax M2.7	5.7	9.1	33.3%	0		101.89s	2,961	1,231	38,841
Mistral Small 4	4.4	5.1	33.3%	2		39.98s	7,636	11,635	54,715

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
MiniMax M2.7	3.8	1.6	50.0%	2		72.12s	94,380	9,946	33,704
Mistral Small 4	3.0	10.0	0.0%	0		32.40s	116,624	17,890	18,384

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
MiniMax M2.7	6.3	5.8	66.7%	1		21.95s	7,152	187	5,882
Mistral Small 4	7.3	5.9	83.3%	1		1.23s	6,171	335	723

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
MiniMax M2.7	3.0	10.0	0.0%	0		19.00s	245	8	2,796
Mistral Small 4	5.3	7.2	44.4%	1		6.11s	742	2,621	6,904

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
MiniMax M2.7	3.9	2.5	33.3%	1		38.70s	486	92	5,204
Mistral Small 4	4.8	10.0	0.0%	0		2.05s	519	821	828

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
MiniMax M2.7	3.8	5.8	33.3%	1		12.80s	687	350	2,600
Mistral Small 4	7.3	5.8	83.3%	1		1.38s	729	540	1,031

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
MiniMax M2.7	5.9	7.2	55.6%	1		24.87s	675	362	7,840
Mistral Small 4	3.4	9.7	0.0%	0		2.17s	735	1,226	2,632

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
MiniMax M2.7	4.7	1.6	66.7%	1		12.05s	7,067	304	1,001
Mistral Small 4	10.0	10.0	100.0%	0		3.50s	6,420	321	810

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
MiniMax M2.7	3.0	10.0	0.0%	0		22.77s	211	3,068	3,452
Mistral Small 4	3.0	10.0	0.0%	0		5.92s	210	18	1,557

Switch Comparison Pair