Qwen3.5-27B (medium) vs GLM 5.3 FlashX (max)

Compared models

Recommended model GLM 5.3 FlashX (max)

It has the best score here (7.9), while costing about 1.8x less than Qwen3.5-27B (medium).

Metric	Qwen3.5-27B Qwen3.5-27B medium Release: 2026-02-24	GLM 5.3 FlashX GLM 5.3 FlashX max Release: 2026-09-21

Metric	Qwen3.5-27B Qwen3.5-27B medium Release: 2026-02-24	GLM 5.3 FlashX GLM 5.3 FlashX max Release: 2026-09-21
Score	7.9	7.9
Rank	#96	#97
Reliability	10.0	10.0
Consistency	7.9	8.0
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	76.8%	78.3%
Flaky tests	6	6
Total Runs	69	69
Cost per result	8.104	4.153
Total Cost	$1.135	$0.623
Input Price	$0.195 / 1M	$0.370 / 1M
Output Price	$1.560 / 1M	$1.250 / 1M
Total Input Tokens	288,919	322,894
Output Tokens	17,484	8,010
Reasoning Tokens	617,804	394,755
Response Time (avg)	114.73s	43.97s
Response Time (max)	1026.43s	390.70s
Response Time (total)	2638.74s	1011.29s
Parameters	27B	320B total (18B active)
Availability	Open source	Closed

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

medium

max

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	10.0	10.0	100.0%	0		146.48s	177,275	1,371	19,008
GLM 5.3 FlashX	6.1	3.1	66.7%	1		104.77s	221,683	1,709	25,322

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	8.7	7.9	91.7%	1		19.75s	672	569	31,505
GLM 5.3 FlashX	10.0	10.0	100.0%	0		2.65s	639	301	2,210

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	6.2	7.1	55.6%	1		160.69s	7,895	6,381	89,388
GLM 5.3 FlashX	8.2	7.2	88.9%	1		24.61s	7,317	463	36,503

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	7.3	5.8	83.3%	1		595.19s	84,417	7,948	279,132
GLM 5.3 FlashX	8.2	6.9	66.7%	1		45.23s	76,431	3,485	35,762

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	10.0	10.0	100.0%	0		30.26s	7,782	270	16,150
GLM 5.3 FlashX	10.0	10.0	100.0%	0		3.38s	7,149	223	2,262

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	5.9	7.2	55.6%	1		89.39s	562	157	52,734
GLM 5.3 FlashX	3.5	4.4	33.3%	2		224.00s	759	583	279,058

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	6.1	3.1	66.7%	1		101.41s	524	70	23,147
GLM 5.3 FlashX	10.0	10.0	100.0%	0		5.01s	498	209	1,290

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	10.0	10.0	100.0%	0		19.66s	699	97	11,638
GLM 5.3 FlashX	9.9	10.0	100.0%	0		2.23s	678	72	1,032

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	8.2	7.7	77.8%	1		59.60s	696	242	70,096
GLM 5.3 FlashX	8.2	7.7	77.8%	1		3.88s	672	456	2,848

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	10.0	10.0	100.0%	0		7.45s	8,193	348	1,323
GLM 5.3 FlashX	10.0	10.0	100.0%	0		9.39s	6,861	231	712

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Qwen3.5-27B	3.0	10.0	0.0%	0		85.11s	204	31	23,683
GLM 5.3 FlashX	3.0	10.0	0.0%	0		22.41s	207	278	7,756

Switch Comparison Pair