Qwen3.5-27B vs GLM 5 (medium)

Compared models

Rank: #139
Total Output Tokens: 36,422
Response Time (avg): 9.98s
Total Cost: $0.116

Rank: #146
Total Output Tokens: 138,257
Response Time (avg): 39.05s
Total Cost: $0.360

Recommended model Qwen3.5-27B

It has the best score here (7.2), while costing about 3.1x less than GLM 5 (medium).

Detailed comparison

Metric	Qwen3.5-27B Qwen3.5-27B none Release: 2026-02-24	GLM 5 GLM 5 medium Release: 2026-02-12

Metric	Qwen3.5-27B Qwen3.5-27B none Release: 2026-02-24	GLM 5 GLM 5 medium Release: 2026-02-12
Score	7.2	7.2
Rank	#139	#146
Reliability	10.0	10.0
Consistency	9.4	7.9
Attempts	69/69	66/69
Tests Correct
Attempt pass rate	47.8%	76.8%
Flaky tests	2	5
Total Runs	69	66
Cost per result	1.153	2.552
Total Cost	$0.116	$0.360
Input Price	$0.195 / 1M	$0.600 / 1M
Output Price	$1.560 / 1M	$1.920 / 1M
Total Input Tokens	283,977	212,440
Output Tokens	36,422	22,922
Reasoning Tokens	0	115,335
Response Time (avg)	9.98s	39.05s
Response Time (max)	124.53s	110.70s
Response Time (total)	229.52s	546.68s
Parameters	27B	744B total (40B active)
Availability	Open source	Open source

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#139 Qwen3.5-27B

none

Cost: $0.007
Time: 42.9s
Tokens: 4,273 tok

#146 GLM 5

medium

Cost: $0.005
Time: 20.7s
Tokens: 2,068 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	10.0	10.0	100.0%	0		124.53s	181,652	12,099	0
GLM 5	4.7	3.1	33.3%	1		110.70s	177,216	1,352	12,339

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	4.8	10.0	25.0%	0		788ms	696	267	0
GLM 5	10.0	10.0	100.0%	0		23.66s	555	480	7,056

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	5.8	10.0	33.3%	0		1.80s	7,913	415	0
GLM 5	10.0	10.0	100.0%	0		74.30s	7,254	2,997	52,930

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	6.4	5.8	66.7%	1		39.43s	74,756	22,190	0
GLM 5	5.0	5.0	50.0%	0		28.96s	12,804	662	3,242

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	10.0	10.0	100.0%	0		1.43s	7,794	243	0
GLM 5	7.1	5.6	83.3%	1		8.90s	5,508	567	3,734

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	5.3	10.0	33.3%	0		634ms	798	17	0
GLM 5	3.5	4.4	33.3%	2		0ms	260	13,176	14,137

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	5.0	10.0	0.0%	0		2.51s	522	126	0
GLM 5	6.1	3.1	66.7%	1		14.69s	477	2,020	2,248

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	6.3	10.0	50.0%	0		1.03s	711	69	0
GLM 5	10.0	10.0	100.0%	0		7.25s	636	1,001	2,129

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	6.7	7.9	55.6%	1		1.38s	714	683	0
GLM 5	10.0	10.0	100.0%	0		11.33s	609	33	4,076

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	10.0	10.0	100.0%	0		3.54s	8,211	303	0
GLM 5	10.0	10.0	100.0%	0		15.93s	6,935	233	994

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	3.0	10.0	0.0%	0		599ms	210	10	0
GLM 5	3.0	10.0	0.0%	0		67.37s	186	401	12,450

Quick Compare

Switch Comparison Pair

Step 3.7 FlashlowvsGLM 5medium Qwen3.7 FlashhighvsGLM 5medium Claude Opus 5nonevsGLM 5medium Claude Opus 4.8lowvsGLM 5medium Gemini 3.5 Flash LitemediumvsQwen3.5-27Bnone Gemini 3.8 FlashlowvsQwen3.5-27Bnone Gemini 3.8 FlashlowvsGLM 5medium LongCat 2.0highvsQwen3.5-27Bnone Gemini 2.5 FlashmediumvsQwen3.5-27Bnone Claude Opus 4.8lowvsQwen3.5-27Bnone Qwen3.5-27BnonevsGrok 4.7medium Claude Fable 5.1mediumvsQwen3.5-27Bnone