Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

MiniMax: MiniMax M2.5 vs Qwen: Qwen3.5-35B-A3B

Last updated at: 2026-04-14

Metric MiniMax M2.5 MiniMax M2.5 medium Release: 2026-02-12 Free Available Qwen3.5-35B-A3B Qwen3.5-35B-A3B none Release: 2026-02-24
Score 5.7 6.1
Rank #67 #60
Consistency 5.6 8.7
Tests Correct
Attempt pass rate 57.4% 50.0%
Flaky tests 10 3
Total Runs 54 54
Cost per result 4.987 0.215
Total Cost $0.250 $0.016
Input Price $0.118 / 1M $0.163 / 1M
Output Price $0.991 / 1M $1.300 / 1M
Output Tokens 107,044 4,300
Reasoning Tokens 206,422 0
Response Time (avg) 39.65s 3.82s
Response Time (max) 237.27s 47.43s
Response Time (total) 396.47s 68.74s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 7.9 6.3 83.3% 2 20.82s 286 45,344
Qwen3.5-35B-A3B 3.4 7.9 16.7% 1 1.43s 574 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 3.0 10.0 0.0% 0 0ms 0 0
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 2.67s 539 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 4.5 2.1 66.7% 1 60.39s 740 9,713
Qwen3.5-35B-A3B 3.0 10.0 0.0% 0 47.43s 1,833 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 4.6 1.7 66.7% 2 7.48s 266 3,835
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 1.16s 243 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 2.9 4.4 22.2% 2 237.27s 105,047 133,487
Qwen3.5-35B-A3B 7.7 10.0 66.7% 0 485ms 15 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 3.8 2.5 33.3% 1 6.63s 25 1,686
Qwen3.5-35B-A3B 6.5 3.4 66.7% 1 1.19s 114 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 8.1 6.8 83.3% 1 4.64s 252 1,873
Qwen3.5-35B-A3B 6.3 10.0 50.0% 0 809ms 63 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 5.3 7.2 44.4% 1 11.54s 159 9,547
Qwen3.5-35B-A3B 3.9 7.4 22.2% 1 1.34s 655 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 10.0 10.0 100.0% 0 15.35s 269 937
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 2.30s 264 0

Quick Compare

Switch Comparison Pair