Qwen3.6 35B A3B (medium) vs GLM 5.1

Compared models

Recommended model GLM 5.1

It has the best score here (6.5), while costing about 2.6x less than Qwen3.6 35B A3B (medium).

Metric	Qwen3.6 35B A3B Qwen3.6 35B A3B medium Release: 2026-04-20	GLM 5.1 GLM 5.1 none Release: 2026-04-07

Metric	Qwen3.6 35B A3B Qwen3.6 35B A3B medium Release: 2026-04-20	GLM 5.1 GLM 5.1 none Release: 2026-04-07
Score	6.5	6.5
Rank	#192	#196
Reliability	10.0	10.0
Consistency	9.0	8.2
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	58.0%	47.8%
Flaky tests	3	5
Total Runs	69	69
Cost per result	6.732	3.478
Total Cost	$0.812	$0.311
Input Price	$0.150 / 1M	$0.965 / 1M
Output Price	$1.000 / 1M	$3.032 / 1M
Total Input Tokens	282,192	258,956
Output Tokens	75,306	20,076
Reasoning Tokens	700,868	0
Response Time (avg)	59.92s	11.10s
Response Time (max)	817.57s	107.19s
Response Time (total)	1258.32s	255.39s
Parameters	35B total (3B active)	744B total (40B active)
Availability	Open source	Open source

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

medium

Reached the allocated time limit (300 seconds) without receiving showcase output.

none

Reached the allocated time limit (300 seconds) without receiving showcase output.

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.6 35B A3B	6.1	3.1	66.7%	1		88.48s	197,044	13,570	19,312
GLM 5.1	10.0	10.0	100.0%	0		107.19s	134,737	5,683	0

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.6 35B A3B	10.0	10.0	100.0%	0		6.02s	672	1,154	12,385
GLM 5.1	4.0	6.3	25.0%	2		2.11s	555	305	0

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.6 35B A3B	7.7	10.0	66.7%	0		50.55s	5,051	7,929	37,223
GLM 5.1	3.9	9.7	0.0%	0		4.96s	7,256	525	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.6 35B A3B	3.0	10.0	0.0%	0		817.57s	68,754	42,187	548,547
GLM 5.1	2.8	1.8	33.3%	2		46.88s	99,907	12,768	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.6 35B A3B	10.0	10.0	100.0%	0		12.99s	7,776	2,591	9,968
GLM 5.1	10.0	10.0	100.0%	0		1.08s	7,107	204	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.6 35B A3B	2.9	4.4	22.2%	2		25.39s	780	6,110	41,906
GLM 5.1	5.3	7.2	44.4%	1		2.27s	697	24	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.6 35B A3B	4.4	9.9	0.0%	0		8.66s	516	129	4,569
GLM 5.1	5.0	10.0	0.0%	0		790ms	477	39	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.6 35B A3B	10.0	10.0	100.0%	0		7.50s	699	219	7,404
GLM 5.1	9.8	10.0	100.0%	0		1.98s	636	66	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.6 35B A3B	8.0	10.0	66.7%	0		5.95s	696	655	9,228
GLM 5.1	7.7	10.0	66.7%	0		1.45s	609	151	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.6 35B A3B	3.0	10.0	0.0%	0		0ms	0	0	0
GLM 5.1	10.0	10.0	100.0%	0		10.68s	6,789	300	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.6 35B A3B	3.0	10.0	0.0%	0		32.90s	204	762	10,326
GLM 5.1	3.0	10.0	0.0%	0		2.34s	186	11	0

Switch Comparison Pair