AI BENCHY Compare

Qwen: Qwen3 Coder Next vs Z.ai: GLM 4.7 Flash

Last updated at: 2026-04-14

Metric	Qwen3 Coder Next Qwen3 Coder Next none Release: 2026-02-03	GLM 4.7 Flash GLM 4.7 Flash medium Release: 2026-01-19

Metric	Qwen3 Coder Next Qwen3 Coder Next none Release: 2026-02-03	GLM 4.7 Flash GLM 4.7 Flash medium Release: 2026-01-19
Score	5.1	4.6
Rank	#83	#89
Consistency	9.7	6.3
Tests Correct
Attempt pass rate	25.9%	38.9%
Flaky tests	1	8
Total Runs	54	54
Cost per result	0.188	1.126
Total Cost	$0.008	$0.046
Input Price	$0.150 / 1M	$0.060 / 1M
Output Price	$0.800 / 1M	$0.400 / 1M
Output Tokens	3,617	39,688
Reasoning Tokens	0	72,401
Response Time (avg)	10.18s	32.33s
Response Time (max)	45.14s	174.55s
Response Time (total)	122.13s	355.65s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	3.6	10.0	0.0%	0		3.31s	1,321	0
GLM 4.7 Flash	4.7	5.9	41.7%	2		14.95s	1,122	6,110

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	7.3	3.7	66.7%	1		3.14s	585	0
GLM 4.7 Flash	3.6	2.1	33.3%	1		21.26s	969	6,936

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	3.0	10.0	0.0%	0		45.14s	317	0
GLM 4.7 Flash	2.8	2.1	33.3%	1		65.57s	2,585	20,648

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	6.5	10.0	50.0%	0		1.32s	246	0
GLM 4.7 Flash	6.3	10.0	50.0%	0		1.51s	584	2,755

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	5.3	10.0	33.3%	0		962ms	26	0
GLM 4.7 Flash	3.5	4.4	33.3%	2		174.55s	33,000	25,394

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	10.0	10.0	100.0%	0		1.34s	152	0
GLM 4.7 Flash	3.6	9.7	0.0%	0		18.14s	18	2,138

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	4.8	10.0	0.0%	0		7.71s	63	0
GLM 4.7 Flash	6.2	5.8	66.7%	1		2.97s	388	2,181

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	3.2	10.0	0.0%	0		22.86s	652	0
GLM 4.7 Flash	2.9	7.2	11.1%	1		12.90s	798	5,225

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	10.0	10.0	100.0%	0		2.47s	255	0
GLM 4.7 Flash	10.0	10.0	100.0%	0		15.95s	224	1,014

Quick Compare

Switch Comparison Pair

MiMo-V2-FlashnonevsGLM 4.7 Flashmedium Grok 4.1 FastnonevsGLM 4.7 Flashmedium ElephantmediumvsQwen3 Coder Nextnone GPT-5.4 NanononevsGLM 4.7 Flashmedium MiniMax M2.7mediumvsQwen3 Coder Nextnone Mercury 2nonevsGLM 4.7 Flashmedium Qwen3.5-9BnonevsGLM 4.7 Flashmedium GPT-4o-mininonevsGLM 4.7 Flashmedium Nemotron 3 SupernoneFree AvailablevsGLM 4.7 Flashmedium Mistral Small 4mediumvsQwen3 Coder Nextnone GPT-5.4 MininonevsGLM 4.7 Flashmedium MiniMax M2.5mediumFree AvailablevsQwen3 Coder Nextnone