Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

MiniMax: MiniMax M2.5 vs Qwen: Qwen3.5-9B

Last updated at: 2026-03-12

Metric MiniMax M2.5 MiniMax M2.5 medium Release: 2026-02-12 Qwen3.5-9B Qwen3.5-9B none Release: 2026-03-02
Rank #49 #60
Avg Score 4.7 3.4
Consistency 5.6 10.0
Cost per result 4.981 0.111
Total Cost $0.250 $0.005
Tests Correct
Attempt pass rate 60.4% 25.0%
Flaky tests 9 0
Total Runs 48 48
Output Tokens 107,044 2,939
Reasoning Tokens 206,190 0
Response Time (avg) 43.03s 1.06s
Response Time (max) 237.27s 5.91s
Response Time (total) 387.25s 16.95s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Avg Score vs Response Time (avg)

Total Output Tokens

Avg Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 9.3 7.9 88.9% 1 32.42s 286 45,112
Qwen3.5-9B 10.0 9.9 0.0% 0 1.02s 576 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 10.0 2.1 66.7% 1 60.39s 740 9,713
Qwen3.5-9B 10.0 10.0 0.0% 0 5.91s 1,255 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 10.0 1.7 66.7% 2 7.48s 266 3,835
Qwen3.5-9B 9.9 10.0 100.0% 0 847ms 249 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 10.0 4.4 22.2% 2 237.27s 105,047 133,487
Qwen3.5-9B 10.0 10.0 0.0% 0 464ms 24 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 3.0 2.5 33.3% 1 6.63s 25 1,686
Qwen3.5-9B 3.0 9.9 0.0% 0 552ms 99 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 8.0 6.8 83.3% 1 4.64s 252 1,873
Qwen3.5-9B 5.5 10.0 50.0% 0 514ms 75 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 4.0 7.2 44.4% 1 11.54s 159 9,547
Qwen3.5-9B 10.0 9.9 0.0% 0 683ms 388 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 10.0 10.0 100.0% 0 15.35s 269 937
Qwen3.5-9B 10.0 10.0 100.0% 0 1.27s 273 0

Quick Compare

Switch Comparison Pair