Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Nemotron 3 Ultra 550b A55b vs Qwen: Qwen3.5 Plus 2026-02-15

Summary

Nemotron 3 Ultra 550b A55b vs Qwen3.5 Plus 2026-02-15 benchmark comparison: Nemotron 3 Ultra 550b A55b leads on average score with 8.1 vs 8.0. Nemotron 3 Ultra 550b A55b has the lower benchmark cost at $0.158 vs $0.310. Nemotron 3 Ultra 550b A55b is faster at 15.05s vs 73.79s, with pass rates of 69.8% vs 73.0%.

Recommended model: Nemotron 3 Ultra 550b A55b - It has the best score here (8.1), while costing about 2.0x less than Qwen3.5 Plus 2026-02-15.

Last updated at: 2026-07-02

Metric Nemotron 3 Ultra 550b A55b Nemotron 3 Ultra 550b A55b medium Release: 2026-06-04 Free Available Qwen3.5 Plus 2026-02-15 Qwen3.5 Plus 2026-02-15 medium Release: 2026-02-15
Score 8.1 8.0
Rank #26 #28
Reliability 9.7 10.0
Consistency 8.8 8.8
Tests Correct
Attempt pass rate 69.8% 73.0%
Flaky tests 3 3
Total Runs 63 63
Cost per result 0.000 2.445
Total Cost $0.158 $0.310
Input Price $0.500 / 1M $0.260 / 1M
Output Price $2.200 / 1M $1.560 / 1M
Total Input Tokens 46,813 40,918
Output Tokens 18,002 2,159
Reasoning Tokens 53,091 189,604
Response Time (avg) 15.05s 73.79s
Response Time (max) 43.93s 266.69s
Response Time (total) 316.09s 1033.07s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#26 Nemotron 3 Ultra 550b A55b

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

#28 Qwen3.5 Plus 2026-02-15

medium
Cost
$0.011
Time
125.5s
Tokens
7,040 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 8.62s 780 835 1,485
Qwen3.5 Plus 2026-02-15 8.2 7.9 83.3% 1 45.78s 672 205 21,236
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 8.4 7.4 88.9% 1 26.53s 7,686 2,854 17,725
Qwen3.5 Plus 2026-02-15 6.6 7.1 44.4% 1 180.70s 6,950 420 80,595
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 9.8 10.0 100.0% 0 43.93s 17,574 1,040 3,590
Qwen3.5 Plus 2026-02-15 10.0 10.0 100.0% 0 46.85s 14,934 421 7,906
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 5.68s 7,989 473 1,285
Qwen3.5 Plus 2026-02-15 10.0 10.0 100.0% 0 46.91s 7,782 270 14,916
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 3.5 4.4 33.3% 2 24.90s 858 11,169 16,249
Qwen3.5 Plus 2026-02-15 5.3 10.0 33.3% 0 17.50s 444 35 16,680
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 3.7 9.5 0.0% 0 2.52s 360 70 235
Qwen3.5 Plus 2026-02-15 4.7 1.6 66.7% 1 79.86s 344 73 8,675
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 9.8 10.0 100.0% 0 6.35s 765 182 1,243
Qwen3.5 Plus 2026-02-15 10.0 10.0 100.0% 0 31.93s 699 101 7,704
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 5.5 9.9 33.3% 0 3.54s 792 771 2,055
Qwen3.5 Plus 2026-02-15 10.0 10.0 100.0% 0 32.50s 696 301 13,853
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 7.72s 9,781 304 984
Qwen3.5 Plus 2026-02-15 10.0 10.0 100.0% 0 7.54s 8,193 309 909
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 3.0 10.0 0.0% 0 38.47s 228 304 8,240
Qwen3.5 Plus 2026-02-15 3.0 10.0 0.0% 0 103.81s 204 24 17,130

Quick Compare

Switch Comparison Pair

DeepSeek V4 FlashhighvsNemotron 3 Ultra 550b A55bmediumFree AvailableClaude Opus 4.8lowvsQwen3.5 Plus 2026-02-15mediumDeepSeek V4 FlashhighvsQwen3.5 Plus 2026-02-15mediumQwen3.5 Plus 2026-02-15mediumvsStep 3.7 FlashlowNemotron 3 Ultra 550b A55bmediumFree AvailablevsGPT-5.2 ChatnoneClaude Opus 4.8lowvsNemotron 3 Ultra 550b A55bmediumFree AvailableDeepSeek V4 ProhighvsQwen3.5 Plus 2026-02-15mediumNemotron 3 Ultra 550b A55bmediumFree AvailablevsStep 3.7 FlashlowGPT-5.2 ChatnonevsQwen3.5 Plus 2026-02-15mediumGPT-5.3 ChatnonevsQwen3.5 Plus 2026-02-15mediumDeepSeek V4 ProhighvsNemotron 3 Ultra 550b A55bmediumFree AvailableNemotron 3 Ultra 550b A55bmediumFree AvailablevsGPT-5.3 Chatnone