Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

MiniMax: MiniMax M2.5 vs Qwen: Qwen3.5-Flash

Last updated at: 2026-06-01

Metric MiniMax M2.5 MiniMax M2.5 medium Release: 2026-02-12 Qwen3.5-Flash Qwen3.5-Flash none Release: 2026-02-24
Score 5.5 5.9
Rank #124 #104
Reliability 10.0 10.0
Consistency 6.4 9.7
Tests Correct
Attempt pass rate 48.3% 41.7%
Flaky tests 9 1
Total Runs 60 60
Cost per result 6.075 0.073
Total Cost $0.294 $0.004
Input Price $0.150 / 1M $0.065 / 1M
Output Price $1.150 / 1M $0.260 / 1M
Output Tokens 109,492 4,270
Reasoning Tokens 251,674 0
Response Time (avg) 49.87s 3.74s
Response Time (max) 237.27s 27.18s
Response Time (total) 598.39s 74.71s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 7.9 6.3 83.3% 2 20.82s 286 45,344
Qwen3.5-Flash 3.5 8.3 8.3% 1 1.32s 690 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 3.5 9.8 0.0% 0 125.80s 354 27,037
Qwen3.5-Flash 6.8 10.0 50.0% 0 993ms 513 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 4.5 2.1 66.7% 1 60.39s 740 9,713
Qwen3.5-Flash 3.0 10.0 0.0% 0 6.22s 1,794 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 4.6 1.7 66.7% 2 7.48s 266 3,835
Qwen3.5-Flash 10.0 10.0 100.0% 0 1.57s 243 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 2.9 4.4 22.2% 2 237.27s 105,047 133,487
Qwen3.5-Flash 7.7 10.0 66.7% 0 905ms 15 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 3.8 2.5 33.3% 1 6.63s 25 1,686
Qwen3.5-Flash 10.0 10.0 100.0% 0 803ms 100 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 7.5 10.0 50.0% 0 621ms 156 1,495
Qwen3.5-Flash 6.3 10.0 50.0% 0 8.81s 63 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 5.3 7.2 44.4% 1 11.21s 1,069 9,605
Qwen3.5-Flash 3.1 10.0 0.0% 0 10.89s 579 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 10.0 10.0 100.0% 0 15.35s 269 937
Qwen3.5-Flash 10.0 10.0 100.0% 0 3.67s 264 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 3.0 10.0 0.0% 0 80.79s 1,280 18,535
Qwen3.5-Flash 3.0 10.0 0.0% 0 588ms 9 0

Quick Compare

Switch Comparison Pair