Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

MiniMax: MiniMax M2.5 vs Qwen: Qwen3.5-35B-A3B

Last updated at: 2026-05-29

Metric MiniMax M2.5 MiniMax M2.5 medium Release: 2026-02-12 Free Available Qwen3.5-35B-A3B Qwen3.5-35B-A3B none Release: 2026-02-24
Score 5.5 5.8
Rank #123 #110
Reliability 10.0 10.0
Consistency 6.4 8.9
Tests Correct
Attempt pass rate 48.3% 45.0%
Flaky tests 9 3
Total Runs 60 60
Cost per result 6.075 0.224
Total Cost $0.304 $0.016
Input Price $0.150 / 1M $0.139 / 1M
Output Price $1.150 / 1M $1.000 / 1M
Output Tokens 109,492 4,334
Reasoning Tokens 251,674 0
Response Time (avg) 49.87s 3.50s
Response Time (max) 237.27s 47.43s
Response Time (total) 598.39s 70.00s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 7.9 6.3 83.3% 2 20.82s 286 45,344
Qwen3.5-35B-A3B 3.4 7.9 16.7% 1 1.43s 574 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 3.5 9.8 0.0% 0 125.80s 354 27,037
Qwen3.5-35B-A3B 6.8 10.0 50.0% 0 1.72s 562 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 4.5 2.1 66.7% 1 60.39s 740 9,713
Qwen3.5-35B-A3B 3.0 10.0 0.0% 0 47.43s 1,833 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 4.6 1.7 66.7% 2 7.48s 266 3,835
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 1.16s 243 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 2.9 4.4 22.2% 2 237.27s 105,047 133,487
Qwen3.5-35B-A3B 7.7 10.0 66.7% 0 485ms 15 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 3.8 2.5 33.3% 1 6.63s 25 1,686
Qwen3.5-35B-A3B 6.5 3.4 66.7% 1 1.19s 114 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 7.5 10.0 50.0% 0 621ms 156 1,495
Qwen3.5-35B-A3B 6.3 10.0 50.0% 0 809ms 63 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 5.3 7.2 44.4% 1 11.21s 1,069 9,605
Qwen3.5-35B-A3B 3.7 7.4 22.2% 1 1.35s 655 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 10.0 10.0 100.0% 0 15.35s 269 937
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 2.30s 264 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 3.0 10.0 0.0% 0 80.79s 1,280 18,535
Qwen3.5-35B-A3B 3.0 10.0 0.0% 0 493ms 11 0

Quick Compare

Switch Comparison Pair