AI BENCHY Compare

Qwen: Qwen3 Coder Next vs Z.ai: GLM 5.1

Last updated at: 2026-04-07

Metric	Qwen3 Coder Next Qwen3 Coder Next medium Release: 2026-02-03	GLM 5.1 GLM 5.1 none Release: 2026-04-07

Metric	Qwen3 Coder Next Qwen3 Coder Next medium Release: 2026-02-03	GLM 5.1 GLM 5.1 none Release: 2026-04-07
Score	4.8	5.6
Rank	#85	#67
Consistency	9.2	8.2
Tests Correct
Attempt pass rate	25.5%	39.2%
Flaky tests	2	4
Total Runs	51	51
Cost per result	0.230	1.000
Total Cost	$0.007	$0.050
Input Price	$0.120 / 1M	$1.000 / 1M
Output Price	$0.750 / 1M	$3.200 / 1M
Output Tokens	2,941	3,219
Reasoning Tokens	0	0
Response Time (avg)	11.57s	4.01s
Response Time (max)	81.80s	32.57s
Response Time (total)	127.32s	68.23s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	3.5	8.1	16.7%	1		8.64s	1,252	0
GLM 5.1	4.0	6.3	25.0%	2		2.11s	305	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	3.0	10.0	0.0%	0		4.28s	317	0
GLM 5.1	2.8	2.1	33.3%	1		32.57s	2,129	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	6.5	10.0	50.0%	0		81.80s	246	0
GLM 5.1	10.0	10.0	100.0%	0		1.08s	204	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	5.3	10.0	33.3%	0		638ms	25	0
GLM 5.1	2.9	7.2	11.1%	1		1.99s	24	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	6.3	3.4	66.7%	1		1.39s	142	0
GLM 5.1	5.0	10.0	0.0%	0		790ms	39	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	4.8	10.0	0.0%	0		7.34s	63	0
GLM 5.1	8.3	10.0	50.0%	0		1.58s	66	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	3.1	10.0	0.0%	0		2.30s	641	0
GLM 5.1	5.7	10.0	33.3%	0		1.48s	152	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	10.0	10.0	100.0%	0		2.64s	255	0
GLM 5.1	10.0	10.0	100.0%	0		10.68s	300	0

Quick Compare

Switch Comparison Pair

GPT-5.4 MininonevsQwen3 Coder Nextmedium Mercury 2nonevsQwen3 Coder Nextmedium Mistral Small 4mediumvsGLM 5.1none MiniMax M2.5mediumFree AvailablevsGLM 5.1none GPT-4o-mininonevsQwen3 Coder Nextmedium gpt-oss-120bmediumFree AvailablevsGLM 5.1none Qwen3 Coder NextmediumvsGrok 4.1 Fastnone Qwen3 Coder NextmediumvsMiMo-V2-Flashnone Nemotron 3 SupernoneFree AvailablevsQwen3 Coder Nextmedium Mistral Small 4nonevsQwen3 Coder Nextmedium GPT-5.4 NanononevsQwen3 Coder Nextmedium Trinity Large PreviewnoneFree AvailablevsQwen3 Coder Nextmedium