AI BENCHY Compare

Qwen: Qwen3.5-9B vs Z.ai: GLM 4.7 Flash

Last updated at: 2026-04-26

Metric	Qwen3.5-9B Qwen3.5-9B medium Release: 2026-03-02	GLM 4.7 Flash GLM 4.7 Flash medium Release: 2026-01-19

Metric	Qwen3.5-9B Qwen3.5-9B medium Release: 2026-03-02	GLM 4.7 Flash GLM 4.7 Flash medium Release: 2026-01-19
Score	4.4	4.6
Rank	#114	#109
Reliability	N/A	N/A
Consistency	7.2	6.3
Tests Correct
Attempt pass rate	33.3%	38.9%
Flaky tests	6	8
Total Runs	54	54
Cost per result	0.976	1.126
Total Cost	$0.030	$0.046
Input Price	$0.100 / 1M	$0.060 / 1M
Output Price	$0.150 / 1M	$0.400 / 1M
Output Tokens	24,291	39,688
Reasoning Tokens	172,597	72,401
Response Time (avg)	73.64s	32.33s
Response Time (max)	226.38s	174.55s
Response Time (total)	1104.60s	355.65s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	5.1	5.8	50.0%	2		34.44s	2,621	12,411
GLM 4.7 Flash	4.7	5.9	41.7%	2		14.95s	1,122	6,110

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	2.6	10.0	0.0%	0		135.61s	6,150	31,393
GLM 4.7 Flash	3.6	2.1	33.3%	1		21.26s	969	6,936

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	3.0	10.0	0.0%	0		0ms	0	0
GLM 4.7 Flash	2.8	2.1	33.3%	1		65.57s	2,585	20,648

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	3.6	5.6	33.3%	1		87.31s	1,383	32,113
GLM 4.7 Flash	6.3	10.0	50.0%	0		1.51s	584	2,755

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	3.6	7.2	22.2%	1		137.75s	11,549	48,475
GLM 4.7 Flash	3.5	4.4	33.3%	2		174.55s	33,000	25,394

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	2.8	1.6	33.3%	1		226.38s	0	30,695
GLM 4.7 Flash	3.6	9.7	0.0%	0		18.14s	18	2,138

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	6.4	5.8	66.7%	1		17.15s	599	4,517
GLM 4.7 Flash	6.2	5.8	66.7%	1		2.97s	388	2,181

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	3.1	10.0	0.0%	0		33.38s	1,545	11,844
GLM 4.7 Flash	2.9	7.2	11.1%	1		12.90s	798	5,225

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	10.0	10.0	100.0%	0		4.31s	444	1,149
GLM 4.7 Flash	10.0	10.0	100.0%	0		15.95s	224	1,014

Quick Compare

Switch Comparison Pair

MiMo-V2-FlashnonevsGLM 4.7 Flashmedium Grok 4.1 FastnonevsGLM 4.7 Flashmedium GPT-5.4 NanononevsQwen3.5-9Bmedium Ling 2.6 1tnoneFree AvailablevsQwen3.5-9Bmedium HY3 PreviewnoneFree AvailablevsGLM 4.7 Flashmedium Ling 2.6 1tnoneFree AvailablevsGLM 4.7 Flashmedium GPT-5.4 NanononevsGLM 4.7 Flashmedium Qwen3.5-9BmediumvsGrok 4.1 Fastnone Qwen3.5-9BmediumvsMiMo-V2-Flashnone Mercury 2nonevsGLM 4.7 Flashmedium Qwen3.5-9BnonevsGLM 4.7 Flashmedium GPT-4o-mininonevsGLM 4.7 Flashmedium