AI BENCHY Compare

Qwen: Qwen3 Coder Next vs Z.ai: GLM 5.1

Last updated at: 2026-05-19

Metric	Qwen3 Coder Next Qwen3 Coder Next none Release: 2026-02-03	GLM 5.1 GLM 5.1 none Release: 2026-04-07

Metric	Qwen3 Coder Next Qwen3 Coder Next none Release: 2026-02-03	GLM 5.1 GLM 5.1 none Release: 2026-04-07
Score	5.2	5.7
Rank	#128	#108
Reliability	10.0	10.0
Consistency	9.7	8.0
Tests Correct
Attempt pass rate	29.8%	42.1%
Flaky tests	1	5
Total Runs	57	57
Cost per result	0.151	0.876
Total Cost	$0.008	$0.053
Input Price	$0.110 / 1M	$0.000 / 1M
Output Price	$0.800 / 1M	$0.000 / 1M
Output Tokens	3,629	3,731
Reasoning Tokens	0	0
Response Time (avg)	9.44s	4.23s
Response Time (max)	45.14s	32.57s
Response Time (total)	122.73s	80.36s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	3.6	10.0	0.0%	0		3.31s	1,321	0
GLM 5.1	4.0	6.3	25.0%	2		2.11s	305	0

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	7.3	3.7	66.7%	1		3.14s	585	0
GLM 5.1	5.1	9.1	0.0%	0		9.79s	501	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	3.0	10.0	0.0%	0		45.14s	317	0
GLM 5.1	2.8	2.1	33.3%	1		32.57s	2,129	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	6.5	10.0	50.0%	0		1.32s	246	0
GLM 5.1	10.0	10.0	100.0%	0		1.08s	204	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	5.3	10.0	33.3%	0		962ms	26	0
GLM 5.1	2.9	7.2	11.1%	1		1.99s	24	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	10.0	10.0	100.0%	0		1.34s	152	0
GLM 5.1	5.0	10.0	0.0%	0		790ms	39	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	6.3	10.0	50.0%	0		7.71s	63	0
GLM 5.1	9.8	10.0	100.0%	0		1.58s	66	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	3.0	10.0	0.0%	0		22.86s	652	0
GLM 5.1	6.1	7.8	44.4%	1		1.48s	152	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	10.0	10.0	100.0%	0		2.47s	255	0
GLM 5.1	10.0	10.0	100.0%	0		10.68s	300	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	3.0	10.0	0.0%	0		601ms	12	0
GLM 5.1	3.0	10.0	0.0%	0		2.34s	11	0

Quick Compare

Switch Comparison Pair

gpt-oss-120bmediumFree AvailablevsGLM 5.1none MiniMax M2.7mediumvsQwen3 Coder Nextnone CobuddymediumFree AvailablevsGLM 5.1none MiniMax M2.5mediumFree AvailablevsGLM 5.1none Mistral Small 4mediumvsGLM 5.1none Elephant AlphamediumvsGLM 5.1none Owl AlphamediumvsGLM 5.1none Elephant AlphamediumvsQwen3 Coder Nextnone Mistral Small 4mediumvsQwen3 Coder Nextnone MiniMax M2.5mediumFree AvailablevsQwen3 Coder Nextnone Nemotron 3 SupermediumFree AvailablevsGLM 5.1none GPT-5 NanomediumvsGLM 5.1none