Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

MiniMax: MiniMax M2.5 vs Qwen: Qwen3.5-27B

Last updated at: 2026-05-29

Metric MiniMax M2.5 MiniMax M2.5 medium Release: 2026-02-12 Free Available Qwen3.5-27B Qwen3.5-27B none Release: 2026-02-24
Score 5.5 5.8
Rank #123 #112
Reliability 10.0 10.0
Consistency 6.4 9.3
Tests Correct
Attempt pass rate 48.3% 40.0%
Flaky tests 9 2
Total Runs 60 60
Cost per result 6.075 0.241
Total Cost $0.304 $0.017
Input Price $0.150 / 1M $0.195 / 1M
Output Price $1.150 / 1M $1.560 / 1M
Output Tokens 109,492 3,585
Reasoning Tokens 251,674 0
Response Time (avg) 49.87s 1.69s
Response Time (max) 237.27s 9.39s
Response Time (total) 598.39s 33.82s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 7.9 6.3 83.3% 2 20.82s 286 45,344
Qwen3.5-27B 4.8 10.0 25.0% 0 788ms 267 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 3.5 9.8 0.0% 0 125.80s 354 27,037
Qwen3.5-27B 7.3 10.0 50.0% 0 1.98s 408 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 4.5 2.1 66.7% 1 60.39s 740 9,713
Qwen3.5-27B 2.8 1.6 33.3% 1 9.39s 1,461 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 4.6 1.7 66.7% 2 7.48s 266 3,835
Qwen3.5-27B 10.0 10.0 100.0% 0 1.43s 243 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 2.9 4.4 22.2% 2 237.27s 105,047 133,487
Qwen3.5-27B 3.0 10.0 0.0% 0 540ms 15 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 3.8 2.5 33.3% 1 6.63s 25 1,686
Qwen3.5-27B 5.0 10.0 0.0% 0 2.51s 126 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 7.5 10.0 50.0% 0 621ms 156 1,495
Qwen3.5-27B 6.3 10.0 50.0% 0 1.03s 69 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 5.3 7.2 44.4% 1 11.21s 1,069 9,605
Qwen3.5-27B 6.7 7.9 55.6% 1 1.38s 683 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 10.0 10.0 100.0% 0 15.35s 269 937
Qwen3.5-27B 10.0 10.0 100.0% 0 3.54s 303 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
MiniMax M2.5 3.0 10.0 0.0% 0 80.79s 1,280 18,535
Qwen3.5-27B 3.0 10.0 0.0% 0 599ms 10 0

Quick Compare

Switch Comparison Pair