Navigate
AI BENCHY
Advertise here

MiniMax M3 (medium) vs Qwen3.5-27B (medium)

The average score is effectively tied at 7.5 vs 7.5. MiniMax M3 (medium) has the lower benchmark cost at $0.300 vs $0.982. MiniMax M3 (medium) is faster at 75.15s vs 113.28s, with pass rates of 62.1% vs 75.8%.

Last updated at: 2026-08-26

Rank
#85
Total Output Tokens
275,782
Response Time (avg)
75.15s
Total Cost
$0.300
Rank
#88
Total Output Tokens
614,909
Response Time (avg)
113.28s
Total Cost
$0.982
Recommended model MiniMax M3 (medium)

It has the best score here (7.5), while costing about 3.3x less than Qwen3.5-27B (medium).

Detailed comparison

Metric MiniMax M3 MiniMax M3 medium Release: 2026-06-01 Qwen3.5-27B Qwen3.5-27B medium Release: 2026-02-24
Score 7.5 7.5
Rank #85 #88
Reliability 9.7 10.0
Consistency 8.0 7.8
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 62.1% 75.8%
Flaky tests 5 6
Total Runs 66 66
Cost per result 2.724 8.217
Total Cost $0.300 $0.982
Input Price $0.300 / 1M $0.195 / 1M
Output Price $1.200 / 1M $1.560 / 1M
Total Input Tokens 121,996 111,644
Output Tokens 90,051 16,113
Reasoning Tokens 185,731 598,796
Response Time (avg) 75.15s 113.28s
Response Time (max) 431.03s 1026.43s
Response Time (total) 1578.24s 2492.26s
Parameters 428B total (23B active) 27B
Availability Weights available Open source

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#85 MiniMax M3

medium
Cost
$0.012
Time
154.4s
Tokens
10,018 tok

#88 Qwen3.5-27B

medium
Cost
$0.008
Time
62.0s
Tokens
3,099 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
MiniMax M3 6.1 6.5 55.6% 1 144.74s 5,804 6,223 32,667
Qwen3.5-27B 6.2 7.1 55.6% 1 160.69s 7,895 6,381 89,388

Quick Compare

Switch Comparison Pair