Qwen3.5-27B (medium) vs GLM 5.3 (high)

Compared models

Recommended model GLM 5.3 (high)

Its score stays close to the best score here (7.8 vs 7.9), while costing about 1.9x less than Qwen3.5-27B (medium).

Metric	Qwen3.5-27B Qwen3.5-27B medium Release: 2026-02-24	GLM 5.3 GLM 5.3 high Release: 2026-08-20

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

medium

high

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	10.0	10.0	100.0%	0		146.48s	177,275	1,371	19,008
GLM 5.3	10.0	10.0	100.0%	0		40.72s	132,210	2,805	2,010

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	8.7	7.9	91.7%	1		19.75s	672	569	31,505
GLM 5.3	10.0	10.0	100.0%	0		3.72s	639	237	481

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	6.2	7.1	55.6%	1		160.69s	7,895	6,381	89,388
GLM 5.3	6.6	5.0	66.7%	2		18.89s	7,317	473	8,190

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	7.3	5.8	83.3%	1		595.19s	84,417	7,948	279,132
GLM 5.3	6.4	5.8	66.7%	1		63.96s	62,821	3,936	12,203

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	10.0	10.0	100.0%	0		30.26s	7,782	270	16,150
GLM 5.3	10.0	10.0	100.0%	0		3.55s	7,149	210	189

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	5.9	7.2	55.6%	1		89.39s	562	157	52,734
GLM 5.3	2.9	4.4	22.2%	2		112.33s	759	238	33,423

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	6.1	3.1	66.7%	1		101.41s	524	70	23,147
GLM 5.3	6.1	3.1	66.7%	1		8.00s	498	192	407

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	10.0	10.0	100.0%	0		19.66s	699	97	11,638
GLM 5.3	9.8	10.0	100.0%	0		3.62s	678	72	182

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	8.2	7.7	77.8%	1		59.60s	696	242	70,096
GLM 5.3	8.2	7.2	88.9%	1		4.74s	672	332	452

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	10.0	10.0	100.0%	0		7.45s	8,193	348	1,323
GLM 5.3	10.0	10.0	100.0%	0		17.05s	6,861	231	91

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	3.0	10.0	0.0%	0		85.11s	204	31	23,683
GLM 5.3	3.0	10.0	0.0%	0		21.98s	207	85	2,043

Switch Comparison Pair