AI BENCHY Compare

Qwen: Qwen3.5-122B-A10B vs Z.ai: GLM 4.7 Flash

Last updated at: 2026-06-01

Metric	Qwen3.5-122B-A10B Qwen3.5-122B-A10B none Release: 2026-02-24	GLM 4.7 Flash GLM 4.7 Flash medium Release: 2026-01-19

Metric	Qwen3.5-122B-A10B Qwen3.5-122B-A10B none Release: 2026-02-24	GLM 4.7 Flash GLM 4.7 Flash medium Release: 2026-01-19
Score	5.4	4.5
Rank	#131	#155
Reliability	10.0	10.0
Consistency	9.5	6.7
Tests Correct
Attempt pass rate	33.3%	35.0%
Flaky tests	1	8
Total Runs	60	60
Cost per result	0.380	1.337
Total Cost	$0.019	$0.054
Input Price	$0.260 / 1M	$0.060 / 1M
Output Price	$2.080 / 1M	$0.400 / 1M
Output Tokens	3,374	43,754
Reasoning Tokens	0	89,079
Response Time (avg)	3.38s	35.10s
Response Time (max)	46.00s	174.55s
Response Time (total)	67.55s	456.24s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-122B-A10B	4.8	10.0	25.0%	0		1.59s	312	0
GLM 4.7 Flash	4.7	5.9	41.7%	2		14.95s	1,122	6,110

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-122B-A10B	4.0	5.5	33.3%	1		2.14s	684	0
GLM 4.7 Flash	3.4	6.0	16.7%	1		55.33s	4,981	22,387

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-122B-A10B	3.0	10.0	0.0%	0		46.00s	1,137	0
GLM 4.7 Flash	2.8	2.1	33.3%	1		65.57s	2,585	20,648

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-122B-A10B	10.0	10.0	100.0%	0		1.01s	243	0
GLM 4.7 Flash	6.3	10.0	50.0%	0		1.51s	584	2,755

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-122B-A10B	5.3	10.0	33.3%	0		465ms	15	0
GLM 4.7 Flash	3.5	4.4	33.3%	2		174.55s	33,000	25,394

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-122B-A10B	5.0	10.0	0.0%	0		1.12s	66	0
GLM 4.7 Flash	3.6	9.7	0.0%	0		18.14s	18	2,138

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-122B-A10B	6.3	10.0	50.0%	0		513ms	69	0
GLM 4.7 Flash	6.2	5.8	66.7%	1		2.97s	388	2,181

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-122B-A10B	3.8	10.0	0.0%	0		1.00s	575	0
GLM 4.7 Flash	2.9	7.2	11.1%	1		12.93s	781	5,255

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-122B-A10B	10.0	10.0	100.0%	0		2.04s	264	0
GLM 4.7 Flash	10.0	10.0	100.0%	0		15.95s	224	1,014

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-122B-A10B	3.0	10.0	0.0%	0		295ms	9	0
GLM 4.7 Flash	3.0	10.0	0.0%	0		11.13s	71	1,197

Quick Compare

Switch Comparison Pair

Ling-2.6-1TnonevsGLM 4.7 Flashmedium MiniMax M2.7mediumvsQwen3.5-122B-A10Bnone Elephant AlphamediumvsQwen3.5-122B-A10Bnone Mistral Small 4mediumvsQwen3.5-122B-A10Bnone MiniMax M2.5mediumvsQwen3.5-122B-A10Bnone Mercury 2nonevsGLM 4.7 Flashmedium MiMo-V2-FlashnonevsGLM 4.7 Flashmedium Qwen3.5-9BnonevsGLM 4.7 Flashmedium GPT-5.4 NanononevsGLM 4.7 Flashmedium Trinity Large PreviewnonevsGLM 4.7 Flashmedium Granite 4.1 8BnonevsGLM 4.7 Flashmedium CobuddymediumvsQwen3.5-122B-A10Bnone