AI BENCHY Compare

MiniMax: MiniMax M3 vs StepFun: Step 3.7 Flash

Summary

Step 3.7 Flash (low) leads on average score with 7.7 vs 7.6. MiniMax M3 (medium) has the lower benchmark cost at $0.131 vs $0.341. Step 3.7 Flash (low) is faster at 15.74s vs 68.17s, with pass rates of 65.1% vs 68.3%.

Recommended modelStep 3.7 Flash (low)It has the best score here (7.7), while responding about 4.3x faster than MiniMax M3 (medium).

Last updated at: 2026-07-14

Metric	MiniMax M3 MiniMax M3 medium Release: 2026-06-01	Step 3.7 Flash Step 3.7 Flash low Release: 2026-05-29

Metric	MiniMax M3 MiniMax M3 medium Release: 2026-06-01	Step 3.7 Flash Step 3.7 Flash low Release: 2026-05-29
Score	7.6	7.7
Rank	#54	#51
Reliability	9.6	10.0
Consistency	7.9	8.4
Tests Correct
Attempt pass rate	65.1%	68.3%
Flaky tests	5	4
Total Runs	63	63
Cost per result	1.187	2.840
Total Cost	$0.131	$0.341
Input Price	$0.300 / 1M	$0.200 / 1M
Output Price	$1.200 / 1M	$1.150 / 1M
Total Input Tokens	46,546	40,101
Output Tokens	49,036	289,325
Reasoning Tokens	92,543	0
Response Time (avg)	68.17s	15.74s
Response Time (max)	431.03s	124.75s
Response Time (total)	1363.38s	330.63s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#54 MiniMax M3

medium

Cost: $0.012
Time: 154.4s
Tokens: 10,018 tok

#51 Step 3.7 Flash

low

Invalid SVG

Cost: $0.004
Time: 25.3s
Tokens: 3,072 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
MiniMax M3	5.5	3.7	66.7%	3		14.95s	2,526	874	3,414
Step 3.7 Flash	8.7	7.9	91.7%	1		4.02s	756	10,896	0

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
MiniMax M3	6.1	6.5	55.6%	1		144.74s	5,804	6,223	32,667
Step 3.7 Flash	8.2	7.2	88.9%	1		9.46s	7,437	18,685	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
MiniMax M3	10.0	10.0	100.0%	0		65.30s	14,760	1,306	6,253
Step 3.7 Flash	10.0	10.0	100.0%	0		7.98s	13,683	6,426	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
MiniMax M3	10.0	10.0	100.0%	0		14.92s	8,088	514	3,164
Step 3.7 Flash	7.3	5.8	83.3%	1		2.29s	7,398	2,667	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
MiniMax M3	5.5	9.3	33.3%	0		233.13s	869	16,254	19,070
Step 3.7 Flash	5.3	7.2	44.4%	1		43.31s	828	104,487	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
MiniMax M3	5.1	3.4	33.3%	1		33.25s	954	2,487	2,523
Step 3.7 Flash	3.4	9.3	0.0%	0		7.00s	525	4,604	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
MiniMax M3	9.8	10.0	100.0%	0		6.14s	1,623	103	920
Step 3.7 Flash	9.8	10.0	100.0%	0		1.58s	735	1,857	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
MiniMax M3	7.9	9.9	66.7%	0		49.91s	2,079	11,946	13,761
Step 3.7 Flash	5.5	9.9	33.3%	0		1.84s	756	3,564	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
MiniMax M3	10.0	10.0	100.0%	0		11.91s	9,168	281	555
Step 3.7 Flash	10.0	10.0	100.0%	0		3.25s	7,746	1,360	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
MiniMax M3	3.0	10.0	0.0%	0		100.80s	675	9,048	10,216
Step 3.7 Flash	3.0	10.0	0.0%	0		124.75s	237	134,779	0

Quick Compare

Switch Comparison Pair

GPT-5.6 LunahighvsStep 3.7 Flashlow Claude Opus 4.6mediumvsStep 3.7 Flashlow DeepSeek V4 ProhighvsMiniMax M3medium Step 3.7 FlashlowvsGrok 4.3medium KAT-Coder-Pro V2.5highvsStep 3.7 Flashlow Qwen3.5-122B-A10BmediumvsStep 3.7 Flashlow KAT-Coder-Pro V2.5highvsMiniMax M3medium Kimi K2.6mediumFree AvailablevsStep 3.7 Flashlow Gemini 3.1 Flash LitemediumvsStep 3.7 Flashlow Qwen3.5 Plus 2026-04-20mediumvsStep 3.7 Flashlow Gemini 3.1 Flash Lite PreviewmediumvsStep 3.7 Flashlow MiniMax M3mediumvsGPT-5.6 Lunahigh