AI BENCHY Compare

Qwen: Qwen3.5-9B vs Z.ai: GLM 4.7 Flash

Last updated at: 2026-03-12

Metric	Qwen3.5-9B Qwen3.5-9B none Release: 2026-03-02	GLM 4.7 Flash GLM 4.7 Flash medium Release: 2026-01-19

Metric	Qwen3.5-9B Qwen3.5-9B none Release: 2026-03-02	GLM 4.7 Flash GLM 4.7 Flash medium Release: 2026-01-19
Rank	#60	#62
Avg Score	3.4	3.1
Consistency	10.0	6.4
Cost per result	0.111	1.040
Total Cost	$0.005	$0.042
Tests Correct
Attempt pass rate	25.0%	41.7%
Flaky tests	0	7
Total Runs	48	48
Output Tokens	2,939	38,682
Reasoning Tokens	0	64,952
Response Time (avg)	1.06s	36.84s
Response Time (max)	5.91s	174.55s
Response Time (total)	16.95s	331.58s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Avg Score vs Response Time (avg)

Total Output Tokens

Avg Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	10.0	9.9	0.0%	0		1.02s	576	0
GLM 4.7 Flash	4.0	4.5	55.6%	2		27.09s	1,085	5,597

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	10.0	10.0	0.0%	0		5.91s	1,255	0
GLM 4.7 Flash	10.0	2.1	33.3%	1		65.57s	2,585	20,648

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	9.9	10.0	100.0%	0		847ms	249	0
GLM 4.7 Flash	5.0	10.0	50.0%	0		1.51s	584	2,755

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	10.0	10.0	0.0%	0		464ms	24	0
GLM 4.7 Flash	10.0	4.4	33.3%	2		174.55s	33,000	25,394

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	3.0	9.9	0.0%	0		552ms	99	0
GLM 4.7 Flash	10.0	9.7	0.0%	0		18.14s	18	2,138

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	5.5	10.0	50.0%	0		514ms	75	0
GLM 4.7 Flash	5.0	5.8	66.7%	1		2.97s	388	2,181

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	10.0	9.9	0.0%	0		683ms	388	0
GLM 4.7 Flash	10.0	7.2	11.1%	1		12.90s	798	5,225

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	10.0	10.0	100.0%	0		1.27s	273	0
GLM 4.7 Flash	10.0	10.0	100.0%	0		15.95s	224	1,014

Quick Compare

Switch Comparison Pair

Grok 4.1 FastnonevsGLM 4.7 Flashmedium MiMo-V2-FlashnonevsGLM 4.7 Flashmedium Mercury 2nonevsGLM 4.7 Flashmedium Nemotron 3 Super 120b A12bnoneFree AvailablevsGLM 4.7 Flashmedium Qwen3 Coder NextnonevsGLM 4.7 Flashmedium GPT-4o-mininonevsGLM 4.7 Flashmedium Kimi K2.5nonevsGLM 4.7 Flashmedium Trinity Large PreviewnoneFree AvailablevsGLM 4.7 Flashmedium Grok 4.20 BetanonevsGLM 4.7 Flashmedium MiniMax M2.5mediumvsQwen3.5-9Bnone GPT-5.4nonevsGLM 4.7 Flashmedium Hunter AlphanonevsGLM 4.7 Flashmedium