Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

MiniMax: MiniMax M2.7 vs StepFun: Step 3.5 Flash

Last updated at: 2026-03-18

Metric MiniMax M2.7 MiniMax M2.7 medium Release: 2026-03-18 Step 3.5 Flash Step 3.5 Flash medium Release: 2026-02-01 Free Available
Score 5.0 7.9
Rank #64 #22
Consistency 5.3 9.1
Tests Correct
Attempt pass rate 49.0% 70.6%
Flaky tests 10 2
Total Runs 51 49
Cost per result 2.398 0.000
Total Cost $0.072 $0.000
Input Price $0.300 / 1M $0.000 / 1M
Output Price $1.200 / 1M $0.000 / 1M
Output Tokens 4,517 71,904
Reasoning Tokens 47,612 155,607
Response Time (avg) 27.32s 26.78s
Response Time (max) 117.04s 170.45s
Response Time (total) 437.10s 294.58s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 7.9 6.3 83.3% 2 40.32s 3,010 17,716
Step 3.5 Flash 10.0 10.0 100.0% 0 13.56s 14,376 17,668
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 4.7 1.6 66.7% 1 41.03s 369 4,480
Step 3.5 Flash 10.0 10.0 100.0% 0 29.57s 1,176 12,984
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 6.3 5.8 66.7% 1 21.95s 187 5,882
Step 3.5 Flash 10.0 10.0 100.0% 0 15.01s 600 13,886
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 3.0 10.0 0.0% 0 19.00s 8 2,796
Step 3.5 Flash 5.3 7.2 44.4% 1 170.45s 45,350 90,436
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 3.9 2.5 33.3% 1 38.70s 92 5,204
Step 3.5 Flash 5.5 10.0 0.0% 0 6.54s 2,214 2,584
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 3.7 1.8 50.0% 2 12.64s 213 2,457
Step 3.5 Flash 8.5 6.8 83.3% 1 4.98s 2,284 3,412
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 3.8 4.5 33.3% 2 25.62s 334 8,076
Step 3.5 Flash 5.3 10.0 33.3% 0 7.72s 5,629 10,835
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 4.7 1.6 66.7% 1 12.05s 304 1,001
Step 3.5 Flash 10.0 10.0 100.0% 0 11.91s 275 3,802

Quick Compare

Switch Comparison Pair