Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Nemotron 3 Ultra 550b A55b vs Qwen: Qwen3.5 Plus 2026-02-15

Summary

Nemotron 3 Ultra 550b A55b vs Qwen3.5 Plus 2026-02-15 benchmark comparison: Nemotron 3 Ultra 550b A55b leads on average score with 8.1 vs 5.8. Qwen3.5 Plus 2026-02-15 has the lower benchmark cost at $0.016 vs $0.158. Qwen3.5 Plus 2026-02-15 is faster at 2.31s vs 15.05s, with pass rates of 69.8% vs 46.0%.

Recommended model: Qwen3.5 Plus 2026-02-15 - It offers the best overall trade-off: a competitive score (5.8), lower cost than Nemotron 3 Ultra 550b A55b, and balanced response time.

Last updated at: 2026-06-18

Metric Nemotron 3 Ultra 550b A55b Nemotron 3 Ultra 550b A55b medium Release: 2026-06-04 Free Available Qwen3.5 Plus 2026-02-15 Qwen3.5 Plus 2026-02-15 none Release: 2026-02-15
Score 8.1 5.8
Rank #26 #106
Reliability 9.7 10.0
Consistency 8.8 9.4
Tests Correct
Attempt pass rate 69.8% 46.0%
Flaky tests 3 2
Total Runs 63 63
Cost per result 0.000 0.204
Total Cost $0.158 $0.016
Input Price $0.500 / 1M $0.260 / 1M
Output Price $2.200 / 1M $1.560 / 1M
Total Input Tokens 46,813 45,864
Output Tokens 18,002 2,480
Reasoning Tokens 53,091 0
Response Time (avg) 15.05s 2.31s
Response Time (max) 43.93s 6.65s
Response Time (total) 316.09s 34.63s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#26 Nemotron 3 Ultra 550b A55b

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

#106 Qwen3.5 Plus 2026-02-15

none
Cost
$0.012
Time
153.2s
Tokens
7,787 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 8.62s 780 835 1,485
Qwen3.5 Plus 2026-02-15 4.8 10.0 25.0% 0 1.91s 696 517 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 8.4 7.4 88.9% 1 26.53s 7,686 2,854 17,725
Qwen3.5 Plus 2026-02-15 4.3 7.9 11.1% 1 2.05s 7,913 473 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 9.8 10.0 100.0% 0 43.93s 17,574 1,040 3,590
Qwen3.5 Plus 2026-02-15 3.0 10.0 0.0% 0 6.65s 18,304 314 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 5.68s 7,989 473 1,285
Qwen3.5 Plus 2026-02-15 10.0 10.0 100.0% 0 1.89s 7,794 243 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 3.5 4.4 33.3% 2 24.90s 858 11,169 16,249
Qwen3.5 Plus 2026-02-15 5.3 10.0 33.3% 0 1.17s 789 17 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 3.7 9.5 0.0% 0 2.52s 360 70 235
Qwen3.5 Plus 2026-02-15 4.4 3.0 33.3% 1 2.26s 522 117 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 9.8 10.0 100.0% 0 6.35s 765 182 1,243
Qwen3.5 Plus 2026-02-15 10.0 10.0 100.0% 0 1.67s 711 72 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 5.5 9.9 33.3% 0 3.54s 792 771 2,055
Qwen3.5 Plus 2026-02-15 7.7 10.0 66.7% 0 2.71s 714 494 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 7.72s 9,781 304 984
Qwen3.5 Plus 2026-02-15 10.0 10.0 100.0% 0 3.33s 8,211 222 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 3.0 10.0 0.0% 0 38.47s 228 304 8,240
Qwen3.5 Plus 2026-02-15 3.0 10.0 0.0% 0 1.11s 210 11 0

Quick Compare

Switch Comparison Pair

North Mini CodemediumFree AvailablevsQwen3.5 Plus 2026-02-15noneDeepSeek V4 FlashhighvsNemotron 3 Ultra 550b A55bmediumFree AvailableGemini 3.1 Flash LiteminimalvsQwen3.5 Plus 2026-02-15noneNemotron 3 Ultra 550b A55bmediumFree AvailablevsGPT-5.2 ChatnoneNemotron 3 Ultra 550b A55bmediumFree AvailablevsStep 3.7 FlashlowGemma 4 31BmediumFree AvailablevsQwen3.5 Plus 2026-02-15noneNemotron 3 SupermediumFree AvailablevsQwen3.5 Plus 2026-02-15noneDeepSeek V4 ProhighvsNemotron 3 Ultra 550b A55bmediumFree AvailableGemini 3.1 Flash LitelowvsQwen3.5 Plus 2026-02-15noneNemotron 3 Ultra 550b A55bmediumFree AvailablevsGPT-5.3 ChatnoneGemini 3.1 Flash Lite PreviewlowvsQwen3.5 Plus 2026-02-15noneMiniMax M2.7mediumvsQwen3.5 Plus 2026-02-15none