AI BENCHY Compare

Qwen: Qwen3.6 35B A3B vs Z.ai: GLM 5

Last updated at: 2026-04-27

Metric	Qwen3.6 35B A3B Qwen3.6 35B A3B medium Release: 2026-04-20	GLM 5 GLM 5 medium Release: 2026-02-12

Metric	Qwen3.6 35B A3B Qwen3.6 35B A3B medium Release: 2026-04-20	GLM 5 GLM 5 medium Release: 2026-02-12
Score	8.8	8.4
Rank	#9	#18
Reliability	10.0	N/A
Consistency	9.5	8.2
Tests Correct
Attempt pass rate	83.3%	85.2%
Flaky tests	1	4
Total Runs	54	54
Cost per result	0.800	1.188
Total Cost	$0.104	$0.155
Input Price	$0.162 / 1M	$0.600 / 1M
Output Price	$0.966 / 1M	$2.080 / 1M
Output Tokens	14,256	20,163
Reasoning Tokens	98,005	58,337
Response Time (avg)	11.98s	23.34s
Response Time (max)	45.02s	79.09s
Response Time (total)	191.76s	233.40s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.6 35B A3B	10.0	10.0	100.0%	0		6.02s	1,154	12,385
GLM 5	10.0	10.0	100.0%	0		23.66s	480	7,056

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.6 35B A3B	10.0	10.0	100.0%	0		32.58s	3,294	15,116
GLM 5	10.0	10.0	100.0%	0		79.09s	330	19,814

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.6 35B A3B	0.0	0.0	0.0%	0		0ms	0	0
GLM 5	10.0	10.0	100.0%	0		28.96s	662	3,242

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.6 35B A3B	10.0	10.0	100.0%	0		12.99s	2,591	9,968
GLM 5	7.1	5.6	83.3%	1		8.90s	567	3,734

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.6 35B A3B	5.3	7.2	44.4%	1		22.50s	6,193	39,116
GLM 5	3.5	4.4	33.3%	2		0ms	13,176	14,137

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.6 35B A3B	4.4	9.9	0.0%	0		8.66s	129	4,569
GLM 5	6.1	3.1	66.7%	1		14.69s	2,020	2,248

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.6 35B A3B	10.0	10.0	100.0%	0		7.50s	219	7,404
GLM 5	10.0	10.0	100.0%	0		7.25s	1,001	2,129

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.6 35B A3B	10.0	10.0	100.0%	0		5.98s	676	9,447
GLM 5	10.0	10.0	100.0%	0		15.64s	1,694	4,983

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.6 35B A3B	0.0	0.0	0.0%	0		0ms	0	0
GLM 5	10.0	10.0	100.0%	0		15.93s	233	994

Quick Compare

Switch Comparison Pair

Gemini 3 Flash PreviewlowvsQwen3.6 35B A3Bmedium HY3 PreviewhighFree AvailablevsGLM 5medium HY3 PreviewlowFree AvailablevsGLM 5medium Gemini 3 Flash PreviewnonevsGLM 5medium GPT-5.5lowvsQwen3.6 35B A3Bmedium Qwen3.6 35B A3BmediumvsHY3 PreviewhighFree Available Gemini 3.1 Flash Lite PreviewlowvsGLM 5medium Claude Opus 4.7nonevsQwen3.6 35B A3Bmedium Gemini 3 Flash PreviewlowvsGLM 5medium GPT-5.2 ChatnonevsGLM 5medium Gemini 3.1 Flash Lite PreviewnonevsGLM 5medium DeepSeek V4 FlashhighvsGLM 5medium