AI BENCHY Compare

Qwen: Qwen3.5-9B vs Qwen: Qwen3 Coder Next

Last updated at: 2026-04-26

Metric	Qwen3.5-9B Qwen3.5-9B none Release: 2026-03-02	Qwen3 Coder Next Qwen3 Coder Next none Release: 2026-02-03

Metric	Qwen3.5-9B Qwen3.5-9B none Release: 2026-03-02	Qwen3 Coder Next Qwen3 Coder Next none Release: 2026-02-03
Score	4.8	5.1
Rank	#105	#101
Reliability	N/A	N/A
Consistency	9.6	9.7
Tests Correct
Attempt pass rate	24.1%	25.9%
Flaky tests	1	1
Total Runs	54	54
Cost per result	0.116	0.188
Total Cost	$0.005	$0.008
Input Price	$0.100 / 1M	$0.140 / 1M
Output Price	$0.150 / 1M	$0.800 / 1M
Output Tokens	3,951	3,617
Reasoning Tokens	0	0
Response Time (avg)	1.47s	10.18s
Response Time (max)	5.91s	45.14s
Response Time (total)	26.43s	122.13s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	3.1	9.9	0.0%	0		1.71s	582	0
Qwen3 Coder Next	3.6	10.0	0.0%	0		3.31s	1,321	0

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	5.2	3.4	33.3%	1		5.69s	1,006	0
Qwen3 Coder Next	7.3	3.7	66.7%	1		3.14s	585	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	3.0	10.0	0.0%	0		5.91s	1,255	0
Qwen3 Coder Next	3.0	10.0	0.0%	0		45.14s	317	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	10.0	10.0	100.0%	0		847ms	249	0
Qwen3 Coder Next	6.5	10.0	50.0%	0		1.32s	246	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	3.0	10.0	0.0%	0		464ms	24	0
Qwen3 Coder Next	5.3	10.0	33.3%	0		962ms	26	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	4.4	9.9	0.0%	0		552ms	99	0
Qwen3 Coder Next	10.0	10.0	100.0%	0		1.34s	152	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	6.5	10.0	50.0%	0		514ms	75	0
Qwen3 Coder Next	4.8	10.0	0.0%	0		7.71s	63	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	3.2	9.9	0.0%	0		683ms	388	0
Qwen3 Coder Next	3.2	10.0	0.0%	0		22.86s	652	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	10.0	10.0	100.0%	0		1.27s	273	0
Qwen3 Coder Next	10.0	10.0	100.0%	0		2.47s	255	0

Quick Compare

Switch Comparison Pair

Elephant AlphamediumvsQwen3 Coder Nextnone MiniMax M2.7mediumvsQwen3 Coder Nextnone Qwen3.5-9BnonevsGLM 4.7 Flashmedium Elephant AlphamediumvsQwen3.5-9Bnone MiniMax M2.7mediumvsQwen3.5-9Bnone Qwen3 Coder NextnonevsGLM 4.7 Flashmedium Mistral Small 4mediumvsQwen3 Coder Nextnone MiniMax M2.5mediumFree AvailablevsQwen3 Coder Nextnone gpt-oss-120bmediumFree AvailablevsQwen3 Coder Nextnone Mistral Small 4mediumvsQwen3.5-9Bnone MiniMax M2.5mediumFree AvailablevsQwen3.5-9Bnone gpt-oss-120bmediumFree AvailablevsQwen3.5-9Bnone