AI BENCHY Compare

Qwen: Qwen3.5-27B vs Z.ai: GLM 5.1

Last updated at: 2026-04-07

Metric	Qwen3.5-27B Qwen3.5-27B none Release: 2026-02-24	GLM 5.1 GLM 5.1 none Release: 2026-04-07

Metric	Qwen3.5-27B Qwen3.5-27B none Release: 2026-02-24	GLM 5.1 GLM 5.1 none Release: 2026-04-07
Score	5.6	5.6
Rank	#69	#67
Consistency	9.1	8.2
Tests Correct
Attempt pass rate	35.3%	39.2%
Flaky tests	2	4
Total Runs	51	51
Cost per result	0.303	1.000
Total Cost	$0.016	$0.050
Input Price	$0.195 / 1M	$1.000 / 1M
Output Price	$1.560 / 1M	$3.200 / 1M
Output Tokens	3,164	3,219
Reasoning Tokens	0	0
Response Time (avg)	1.70s	4.01s
Response Time (max)	9.39s	32.57s
Response Time (total)	28.82s	68.23s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-27B	4.8	10.0	25.0%	0		788ms	267	0
GLM 5.1	4.0	6.3	25.0%	2		2.11s	305	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-27B	2.8	1.6	33.3%	1		9.39s	1,461	0
GLM 5.1	2.8	2.1	33.3%	1		32.57s	2,129	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-27B	10.0	10.0	100.0%	0		1.43s	243	0
GLM 5.1	10.0	10.0	100.0%	0		1.08s	204	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-27B	3.0	10.0	0.0%	0		540ms	15	0
GLM 5.1	2.9	7.2	11.1%	1		1.99s	24	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-27B	5.0	10.0	0.0%	0		2.51s	126	0
GLM 5.1	5.0	10.0	0.0%	0		790ms	39	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-27B	4.8	10.0	0.0%	0		815ms	69	0
GLM 5.1	8.3	10.0	50.0%	0		1.58s	66	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-27B	6.7	7.9	55.6%	1		1.37s	680	0
GLM 5.1	5.7	10.0	33.3%	0		1.48s	152	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-27B	10.0	10.0	100.0%	0		3.54s	303	0
GLM 5.1	10.0	10.0	100.0%	0		10.68s	300	0

Quick Compare

Switch Comparison Pair

Mistral Small 4mediumvsQwen3.5-27Bnone Mistral Small 4mediumvsGLM 5.1none MiniMax M2.5mediumFree AvailablevsGLM 5.1none MiniMax M2.5mediumFree AvailablevsQwen3.5-27Bnone gpt-oss-120bmediumFree AvailablevsGLM 5.1none gpt-oss-120bmediumFree AvailablevsQwen3.5-27Bnone Grok 4.20 Multi Agent BetamediumvsGLM 5.1none MiniMax M2.7mediumvsQwen3.5-27Bnone Qwen3.5-27BnonevsGrok 4.20 Multi Agent Betamedium GPT-5 NanomediumvsGLM 5.1none MiniMax M2.7mediumvsGLM 5.1none GPT-5 NanomediumvsQwen3.5-27Bnone