Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Nemotron 3 Nano Omni 30b A3b Reasoning vs Qwen: Qwen3.5-9B

Last updated at: 2026-04-29

Metric Nemotron 3 Nano Omni 30b A3b Reasoning Nemotron 3 Nano Omni 30b A3b Reasoning medium Release: 2026-04-28 Free Available Qwen3.5-9B Qwen3.5-9B none Release: 2026-03-02
Score 5.2 4.8
Rank #107 #120
Reliability 10.0 N/A
Consistency 5.9 9.6
Tests Correct
Attempt pass rate 47.9% 24.1%
Flaky tests 8 1
Total Runs 54 54
Cost per result 0.000 0.116
Total Cost $0.000 $0.005
Input Price $0.000 / 1M $0.100 / 1M
Output Price $0.000 / 1M $0.150 / 1M
Output Tokens 50,628 3,951
Reasoning Tokens 184,655 0
Response Time (avg) 14.46s 1.47s
Response Time (max) 147.45s 5.91s
Response Time (total) 231.37s 26.43s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Nemotron 3 Nano Omni 30b A3b Reasoning 7.0 5.9 75.0% 2 2.17s 2,490 3,481
Qwen3.5-9B 3.1 9.9 0.0% 0 1.71s 582 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Nemotron 3 Nano Omni 30b A3b Reasoning 3.3 1.7 33.3% 1 38.09s 6,097 30,508
Qwen3.5-9B 5.2 3.4 33.3% 1 5.69s 1,006 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Nemotron 3 Nano Omni 30b A3b Reasoning 0.0 0.0 0.0% 0 0ms 0 0
Qwen3.5-9B 3.0 10.0 0.0% 0 5.91s 1,255 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Nemotron 3 Nano Omni 30b A3b Reasoning 7.3 5.9 83.3% 1 2.72s 890 2,811
Qwen3.5-9B 10.0 10.0 100.0% 0 847ms 249 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Nemotron 3 Nano Omni 30b A3b Reasoning 2.9 7.2 11.1% 1 56.67s 40,404 142,623
Qwen3.5-9B 3.0 10.0 0.0% 0 464ms 24 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Nemotron 3 Nano Omni 30b A3b Reasoning 4.8 9.9 0.0% 0 1.43s 41 850
Qwen3.5-9B 4.4 9.9 0.0% 0 552ms 99 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Nemotron 3 Nano Omni 30b A3b Reasoning 6.9 6.3 66.7% 1 1.53s 192 1,728
Qwen3.5-9B 6.5 10.0 50.0% 0 514ms 75 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Nemotron 3 Nano Omni 30b A3b Reasoning 3.5 4.4 33.3% 2 1.56s 514 2,654
Qwen3.5-9B 3.2 9.9 0.0% 0 683ms 388 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Nemotron 3 Nano Omni 30b A3b Reasoning 0.0 0.0 0.0% 0 0ms 0 0
Qwen3.5-9B 10.0 10.0 100.0% 0 1.27s 273 0

Quick Compare

Switch Comparison Pair