AI BENCHY Compare

Qwen: Qwen3.5-9B vs Qwen: Qwen3 Coder Next

Last updated at: 2026-03-12

Metric	Qwen3.5-9B Qwen3.5-9B none Release: 2026-03-02	Qwen3 Coder Next Qwen3 Coder Next none Release: 2026-02-03

Metric	Qwen3.5-9B Qwen3.5-9B none Release: 2026-03-02	Qwen3 Coder Next Qwen3 Coder Next none Release: 2026-02-03
Rank	#60	#56
Avg Score	3.4	4.0
Consistency	10.0	10.0
Cost per result	0.111	0.174
Total Cost	$0.005	$0.007
Tests Correct
Attempt pass rate	25.0%	25.0%
Flaky tests	0	0
Total Runs	48	48
Output Tokens	2,939	3,026
Reasoning Tokens	0	0
Response Time (avg)	1.06s	11.68s
Response Time (max)	5.91s	45.14s
Response Time (total)	16.95s	116.76s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Avg Score vs Response Time (avg)

Total Output Tokens

Avg Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	10.0	9.9	0.0%	0		1.02s	576	0
Qwen3 Coder Next	2.3	10.0	0.0%	0		4.39s	1,315	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	10.0	10.0	0.0%	0		5.91s	1,255	0
Qwen3 Coder Next	10.0	10.0	0.0%	0		45.14s	317	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	9.9	10.0	100.0%	0		847ms	249	0
Qwen3 Coder Next	5.4	10.0	50.0%	0		1.32s	246	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	10.0	10.0	0.0%	0		464ms	24	0
Qwen3 Coder Next	4.0	10.0	33.3%	0		962ms	26	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	3.0	9.9	0.0%	0		552ms	99	0
Qwen3 Coder Next	10.0	10.0	100.0%	0		1.34s	152	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	5.5	10.0	50.0%	0		514ms	75	0
Qwen3 Coder Next	4.5	10.0	0.0%	0		7.71s	63	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	10.0	9.9	0.0%	0		683ms	388	0
Qwen3 Coder Next	1.3	10.0	0.0%	0		22.86s	652	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
Qwen3.5-9B	10.0	10.0	100.0%	0		1.27s	273	0
Qwen3 Coder Next	10.0	10.0	100.0%	0		2.47s	255	0

Quick Compare

Switch Comparison Pair

Qwen3.5-9BnonevsGLM 4.7 Flashmedium MiniMax M2.5mediumvsQwen3 Coder Nextnone Qwen3 Coder NextnonevsGLM 4.7 Flashmedium Qwen3 Coder NextnonevsGrok 4.20 Multi-Agent Betamedium gpt-oss-120bmediumFree AvailablevsQwen3 Coder Nextnone Mercury 2mediumvsQwen3 Coder Nextnone MiniMax M2.5mediumvsQwen3.5-9Bnone GPT-5 NanomediumvsQwen3 Coder Nextnone Qwen3.5-9BnonevsGrok 4.20 Multi-Agent Betamedium gpt-oss-120bmediumFree AvailablevsQwen3.5-9Bnone Nemotron 3 Super 120b A12bmediumFree AvailablevsQwen3 Coder Nextnone Mercury 2mediumvsQwen3.5-9Bnone