Qwen: Qwen3.5-27B vs Qwen: Qwen3.7 Max

The average score is effectively tied at 7.4 vs 7.4. Qwen3.7 Max has the lower benchmark cost at $0.197 vs $1.627. Qwen3.7 Max is faster at 4.52s vs 111.94s, with pass rates of 72.7% vs 68.2%.

Recommended modelQwen3.7 MaxIt has the best score here (7.4), while costing about 8.3x less than Qwen3.5-27B (medium).

Last updated at: 2026-07-18

Metric	Qwen3.5-27B Qwen3.5-27B medium Release: 2026-02-24	Qwen3.7 Max Qwen3.7 Max none Release: 2026-05-22

Metric	Qwen3.5-27B Qwen3.5-27B medium Release: 2026-02-24	Qwen3.7 Max Qwen3.7 Max none Release: 2026-05-22
Score	7.4	7.4
Rank	#58	#59
Reliability	10.0	9.9
Consistency	8.2	10.0
Tests Correct
Attempt pass rate	72.7%	68.2%
Flaky tests	5	0
Total Runs	66	66
Cost per result	8.324	1.582
Total Cost	$1.627	$0.197
Input Price	$0.260 / 1M	$1.475 / 1M
Output Price	$2.600 / 1M	$4.425 / 1M
Total Input Tokens	111,635	95,983
Output Tokens	15,999	12,446
Reasoning Tokens	598,430	0
Response Time (avg)	111.94s	4.52s
Response Time (max)	1026.43s	72.30s
Response Time (total)	2462.67s	99.52s

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#58 Qwen3.5-27B

medium

Cost: $0.008
Time: 62.0s
Tokens: 3,099 tok

#59 Qwen3.7 Max

none

Cost: $0.046
Time: 195.0s
Tokens: 12,171 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	8.7	7.9	91.7%	1		19.75s	672	569	31,505
Qwen3.7 Max	6.5	10.0	50.0%	0		1.08s	696	242	0

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	6.2	7.1	55.6%	1		160.69s	7,895	6,381	89,388
Qwen3.7 Max	5.5	10.0	33.3%	0		1.35s	7,911	582	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	7.3	5.8	83.3%	1		595.19s	84,417	7,948	279,132
Qwen3.7 Max	6.5	10.0	50.0%	0		37.23s	68,425	10,623	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	10.0	10.0	100.0%	0		30.26s	7,782	270	16,150
Qwen3.7 Max	10.0	10.0	100.0%	0		1.35s	7,794	243	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	5.3	10.0	33.3%	0		79.53s	553	43	52,368
Qwen3.7 Max	7.7	10.0	66.7%	0		975ms	789	15	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	6.1	3.1	66.7%	1		101.41s	524	70	23,147
Qwen3.7 Max	10.0	10.0	100.0%	0		1.04s	522	120	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	10.0	10.0	100.0%	0		19.66s	699	97	11,638
Qwen3.7 Max	10.0	10.0	100.0%	0		943ms	711	72	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	8.2	7.7	77.8%	1		59.60s	696	242	70,096
Qwen3.7 Max	10.0	10.0	100.0%	0		1.13s	714	314	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	10.0	10.0	100.0%	0		7.45s	8,193	348	1,323
Qwen3.7 Max	10.0	10.0	100.0%	0		3.92s	8,211	222	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	3.0	10.0	0.0%	0		85.11s	204	31	23,683
Qwen3.7 Max	3.0	10.0	0.0%	0		856ms	210	13	0

Quick Compare

Switch Comparison Pair

GPT-5.6 TerralowvsQwen3.5-27Bmedium GPT-5.4 MinimediumvsQwen3.7 Maxnone GPT-5.6 TerralowvsQwen3.7 Maxnone Gemini 3 Flash PreviewlowvsQwen3.7 Maxnone GPT-5.3 ChatnonevsQwen3.5-27Bmedium Gemini 3 Flash PreviewlowvsQwen3.5-27Bmedium KAT-Coder-Pro V2.5lowvsQwen3.7 Maxnone KAT-Coder-Pro V2.5lowvsQwen3.5-27Bmedium GPT-5.4 NanomediumvsQwen3.7 Maxnone Kimi K2.7 CodemediumvsQwen3.7 Maxnone Claude Sonnet 4.6nonevsQwen3.5-27Bmedium Nemotron 3 UltramediumFree AvailablevsQwen3.7 Maxnone