Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

MiniMax: MiniMax M2.7 vs Qwen: Qwen3.5-9B

Last updated at: 2026-05-22

Metric MiniMax M2.7 MiniMax M2.7 medium Release: 2026-03-18 Qwen3.5-9B Qwen3.5-9B none Release: 2026-03-02
Score 5.0 4.6
Rank #133 #142
Reliability 8.3 10.0
Consistency 5.9 9.7
Tests Correct
Attempt pass rate 46.7% 21.7%
Flaky tests 10 1
Total Runs 60 60
Cost per result 2.593 0.120
Total Cost $0.104 $0.005
Input Price $0.279 / 1M $0.040 / 1M
Output Price $1.200 / 1M $0.150 / 1M
Output Tokens 8,059 3,984
Reasoning Tokens 73,466 0
Response Time (avg) 29.96s 1.69s
Response Time (max) 117.04s 5.91s
Response Time (total) 569.33s 33.84s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 7.9 6.3 83.3% 2 40.32s 3,010 17,716
Qwen3.5-9B 3.1 9.9 0.0% 0 1.71s 582 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 6.7 9.6 50.0% 0 54.73s 474 22,402
Qwen3.5-9B 4.4 6.7 16.7% 1 5.39s 1,033 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 4.7 1.6 66.7% 1 41.03s 369 4,480
Qwen3.5-9B 3.0 10.0 0.0% 0 5.91s 1,255 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 6.3 5.8 66.7% 1 21.95s 187 5,882
Qwen3.5-9B 10.0 10.0 100.0% 0 847ms 249 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 3.0 10.0 0.0% 0 19.00s 8 2,796
Qwen3.5-9B 3.0 10.0 0.0% 0 464ms 24 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 3.9 2.5 33.3% 1 38.70s 92 5,204
Qwen3.5-9B 4.4 9.9 0.0% 0 552ms 99 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 3.8 1.6 50.0% 2 12.64s 213 2,457
Qwen3.5-9B 6.5 10.0 50.0% 0 514ms 75 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 3.5 4.4 33.3% 2 25.62s 334 8,076
Qwen3.5-9B 3.1 10.0 0.0% 0 683ms 388 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 4.7 1.6 66.7% 1 12.05s 304 1,001
Qwen3.5-9B 10.0 10.0 100.0% 0 1.27s 273 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.7 3.0 10.0 0.0% 0 22.77s 3,068 3,452
Qwen3.5-9B 3.0 10.0 0.0% 0 2.32s 6 0

Quick Compare

Switch Comparison Pair