AI BENCHY Compare

NVIDIA: Nemotron 3 Super vs Qwen: Qwen3.5-9B

Summary

Nemotron 3 Super vs Qwen3.5-9B benchmark comparison: Nemotron 3 Super leads on average score with 5.8 vs 4.6. Qwen3.5-9B has the lower benchmark cost at $0.006 vs $0.021. Qwen3.5-9B is faster at 1.89s vs 32.00s, with pass rates of 41.3% vs 20.6%.

Recommended model: Qwen3.5-9B - It offers the best overall trade-off: a competitive score (4.6), lower cost than Nemotron 3 Super, and balanced response time.

Last updated at: 2026-06-10

Metric	Nemotron 3 Super Nemotron 3 Super medium Release: 2026-03-11 Free Available	Qwen3.5-9B Qwen3.5-9B none Release: 2026-03-02

Metric	Nemotron 3 Super Nemotron 3 Super medium Release: 2026-03-11 Free Available	Qwen3.5-9B Qwen3.5-9B none Release: 2026-03-02
Score	5.8	4.6
Rank	#106	#155
Reliability	10.0	10.0
Consistency	9.2	9.7
Tests Correct
Attempt pass rate	41.3%	20.6%
Flaky tests	2	1
Total Runs	63	63
Cost per result	0.004	0.123
Total Cost	$0.021	$0.006
Input Price	$0.090 / 1M	$0.100 / 1M
Output Price	$0.450 / 1M	$0.150 / 1M
Total Input Tokens	37,527	48,041
Output Tokens	14,850	3,952
Reasoning Tokens	33,754	0
Response Time (avg)	32.00s	1.89s
Response Time (max)	232.25s	6.03s
Response Time (total)	607.91s	39.68s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#106 Nemotron 3 Super

medium

No showcase result has been generated for this model yet.

Cost: $0.000
Time: -
Tokens: 0 tok

#155 Qwen3.5-9B

none

Invalid SVG

Cost: $0.000
Time: 300.0s
Tokens: 0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Nemotron 3 Super	8.3	10.0	75.0%	0		7.85s	686	748	1,305
Qwen3.5-9B	3.1	9.9	0.0%	0		1.71s	696	582	0

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Nemotron 3 Super	3.1	10.0	0.0%	0		147.32s	2,275	797	4,424
Qwen3.5-9B	3.9	7.8	11.1%	1		5.60s	7,913	1,042	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Nemotron 3 Super	10.0	10.0	100.0%	0		87.80s	15,561	2,021	9,996
Qwen3.5-9B	3.0	10.0	0.0%	0		5.91s	20,397	1,255	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Nemotron 3 Super	10.0	10.0	100.0%	0		18.16s	7,944	877	2,607
Qwen3.5-9B	10.0	10.0	100.0%	0		847ms	7,788	249	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Nemotron 3 Super	2.9	4.4	22.2%	2		16.19s	456	5,255	6,072
Qwen3.5-9B	3.0	10.0	0.0%	0		464ms	789	24	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Nemotron 3 Super	4.1	10.0	0.0%	0		6.91s	492	105	363
Qwen3.5-9B	4.4	9.9	0.0%	0		552ms	522	99	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Nemotron 3 Super	7.3	10.0	50.0%	0		6.97s	723	956	2,383
Qwen3.5-9B	6.5	10.0	50.0%	0		514ms	711	75	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Nemotron 3 Super	3.0	10.0	0.0%	0		3.15s	708	570	1,322
Qwen3.5-9B	3.2	10.0	0.0%	0		621ms	714	347	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Nemotron 3 Super	10.0	10.0	100.0%	0		39.75s	8,544	270	1,969
Qwen3.5-9B	10.0	10.0	100.0%	0		1.27s	8,301	273	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Nemotron 3 Super	3.0	10.0	0.0%	0		55.32s	138	3,251	3,313
Qwen3.5-9B	3.0	10.0	0.0%	0		2.32s	210	6	0

Quick Compare

Switch Comparison Pair