AI BENCHY Compare

Qwen: Qwen3.5-9B vs Z.ai: GLM 5.1

Last updated at: 2026-04-07

Metric	Qwen3.5-9B Qwen3.5-9B medium Release: 2026-03-02	GLM 5.1 GLM 5.1 none Release: 2026-04-07

Metric	Qwen3.5-9B Qwen3.5-9B medium Release: 2026-03-02	GLM 5.1 GLM 5.1 none Release: 2026-04-07
Score	4.5	5.6
Rank	#87	#67
Consistency	7.0	8.2
Tests Correct
Attempt pass rate	35.3%	39.2%
Flaky tests	6	4
Total Runs	51	51
Cost per result	0.787	1.000
Total Cost	$0.024	$0.050
Input Price	$0.050 / 1M	$1.000 / 1M
Output Price	$0.150 / 1M	$3.200 / 1M
Output Tokens	18,141	3,219
Reasoning Tokens	141,204	0
Response Time (avg)	69.21s	4.01s
Response Time (max)	226.38s	32.57s
Response Time (total)	968.99s	68.23s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	5.1	5.8	50.0%	2		34.44s	2,621	12,411
GLM 5.1	4.0	6.3	25.0%	2		2.11s	305	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	3.0	10.0	0.0%	0		0ms	0	0
GLM 5.1	2.8	2.1	33.3%	1		32.57s	2,129	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	3.6	5.6	33.3%	1		87.31s	1,383	32,113
GLM 5.1	10.0	10.0	100.0%	0		1.08s	204	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	3.6	7.2	22.2%	1		137.75s	11,549	48,475
GLM 5.1	2.9	7.2	11.1%	1		1.99s	24	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	2.8	1.6	33.3%	1		226.38s	0	30,695
GLM 5.1	5.0	10.0	0.0%	0		790ms	39	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	6.4	5.8	66.7%	1		17.15s	599	4,517
GLM 5.1	8.3	10.0	50.0%	0		1.58s	66	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	3.1	10.0	0.0%	0		33.38s	1,545	11,844
GLM 5.1	5.7	10.0	33.3%	0		1.48s	152	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	10.0	10.0	100.0%	0		4.31s	444	1,149
GLM 5.1	10.0	10.0	100.0%	0		10.68s	300	0

Quick Compare

Switch Comparison Pair

Qwen3.5-9BmediumvsGrok 4.1 Fastnone Qwen3.5-9BmediumvsMiMo-V2-Flashnone Mistral Small 4mediumvsGLM 5.1none GPT-5.4 NanononevsQwen3.5-9Bmedium MiniMax M2.5mediumFree AvailablevsGLM 5.1none gpt-oss-120bmediumFree AvailablevsGLM 5.1none GPT-5.4 MininonevsQwen3.5-9Bmedium Mercury 2nonevsQwen3.5-9Bmedium GPT-4o-mininonevsQwen3.5-9Bmedium Grok 4.20 Multi Agent BetamediumvsGLM 5.1none GPT-5 NanomediumvsGLM 5.1none MiniMax M2.7mediumvsGLM 5.1none