AI BENCHY Compare

Qwen: Qwen3 Coder Next vs Qwen: Qwen3 Coder Next

Last updated at: 2026-05-01

Metric	Qwen3 Coder Next Qwen3 Coder Next medium Release: 2026-02-03	Qwen3 Coder Next Qwen3 Coder Next none Release: 2026-02-03

Metric	Qwen3 Coder Next Qwen3 Coder Next medium Release: 2026-02-03	Qwen3 Coder Next Qwen3 Coder Next none Release: 2026-02-03
Score	4.9	5.3
Rank	#123	#108
Reliability	N/A	N/A
Consistency	8.7	9.7
Tests Correct
Attempt pass rate	33.3%	31.5%
Flaky tests	3	1
Total Runs	54	54
Cost per result	0.180	0.150
Total Cost	$0.008	$0.008
Input Price	$0.140 / 1M	$0.140 / 1M
Output Price	$0.800 / 1M	$0.800 / 1M
Output Tokens	3,241	3,617
Reasoning Tokens	0	0
Response Time (avg)	10.75s	10.18s
Response Time (max)	81.80s	45.14s
Response Time (total)	129.01s	122.13s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	3.5	8.1	16.7%	1		8.64s	1,252	0
Qwen3 Coder Next	3.6	10.0	0.0%	0		3.31s	1,321	0

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	4.7	1.6	66.7%	1		1.69s	300	0
Qwen3 Coder Next	7.3	3.7	66.7%	1		3.14s	585	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	3.0	10.0	0.0%	0		4.28s	317	0
Qwen3 Coder Next	3.0	10.0	0.0%	0		45.14s	317	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	6.5	10.0	50.0%	0		81.80s	246	0
Qwen3 Coder Next	6.5	10.0	50.0%	0		1.32s	246	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	5.3	10.0	33.3%	0		638ms	25	0
Qwen3 Coder Next	5.3	10.0	33.3%	0		962ms	26	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	6.3	3.4	66.7%	1		1.39s	142	0
Qwen3 Coder Next	10.0	10.0	100.0%	0		1.34s	152	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	6.3	10.0	50.0%	0		7.34s	63	0
Qwen3 Coder Next	6.3	10.0	50.0%	0		7.71s	63	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	3.1	10.0	0.0%	0		2.30s	641	0
Qwen3 Coder Next	3.2	10.0	0.0%	0		22.86s	652	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3 Coder Next	10.0	10.0	100.0%	0		2.64s	255	0
Qwen3 Coder Next	10.0	10.0	100.0%	0		2.47s	255	0

Quick Compare

Switch Comparison Pair

MiniMax M2.7mediumvsQwen3 Coder Nextnone Elephant AlphamediumvsQwen3 Coder Nextnone Nemotron 3 Nano Omni 30b A3b ReasoningmediumFree AvailablevsQwen3 Coder Nextnone Mercury 2nonevsQwen3 Coder Nextmedium Laguna Xs.2noneFree AvailablevsQwen3 Coder Nextmedium Laguna M.1noneFree AvailablevsQwen3 Coder Nextmedium GPT-4o-mininonevsQwen3 Coder Nextmedium Qwen3 Coder NextmediumvsMiMo-V2.5none Qwen3 Coder NextmediumvsHY3 PreviewnoneFree Available GPT-5.4 MininonevsQwen3 Coder Nextmedium GPT-5.4 NanononevsQwen3 Coder Nextmedium Elephant AlphanonevsQwen3 Coder Nextmedium