Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Nemotron 3 Ultra 550b A55b vs Qwen3.6 Plus Preview

Summary

Nemotron 3 Ultra 550b A55b vs Qwen3.6 Plus Preview benchmark comparison: Nemotron 3 Ultra 550b A55b leads on average score with 8.1 vs 5.8. Qwen3.6 Plus Preview has the lower benchmark cost at $0.000 vs $0.158. Nemotron 3 Ultra 550b A55b is faster at 15.05s vs 15.25s, with pass rates of 69.8% vs 42.9%.

Recommended model: Nemotron 3 Ultra 550b A55b - It has the strongest score in this comparison (8.1) and the best overall balance of cost and response time across all 2 models.

Last updated at: 2026-06-18

Metric Nemotron 3 Ultra 550b A55b Nemotron 3 Ultra 550b A55b medium Release: 2026-06-04 Free Available Qwen3.6 Plus Preview Qwen3.6 Plus Preview medium Release: 2026-04-20 Free Available
Score 8.1 5.8
Rank #26 #113
Reliability 9.7 N/A
Consistency 8.8 9.0
Tests Correct
Attempt pass rate 69.8% 42.9%
Flaky tests 3 0
Total Runs 63 57
Cost per result 0.000 0.000
Total Cost $0.158 $0.000
Input Price $0.500 / 1M $0.000 / 1M
Output Price $2.200 / 1M $0.000 / 1M
Total Input Tokens 46,813 32,639
Output Tokens 18,002 1,153
Reasoning Tokens 53,091 62,197
Response Time (avg) 15.05s 15.25s
Response Time (max) 43.93s 43.55s
Response Time (total) 316.09s 182.96s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#26 Nemotron 3 Ultra 550b A55b

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

#113 Qwen3.6 Plus Preview

medium
No showcase result has been generated for this model yet.
Cost
$0.000
Time
-
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 8.62s 780 835 1,485
Qwen3.6 Plus Preview 8.3 10.0 75.0% 0 11.69s 501 61 5,812
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 8.4 7.4 88.9% 1 26.53s 7,686 2,854 17,725
Qwen3.6 Plus Preview 9.8 3.3 0.0% 0 0ms 0 0 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 9.8 10.0 100.0% 0 43.93s 17,574 1,040 3,590
Qwen3.6 Plus Preview 10.0 10.0 100.0% 0 34.95s 14,934 452 13,073
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 5.68s 7,989 473 1,285
Qwen3.6 Plus Preview 10.0 10.0 100.0% 0 14.95s 7,782 270 10,706
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 3.5 4.4 33.3% 2 24.90s 858 11,169 16,249
Qwen3.6 Plus Preview 3.0 10.0 0.0% 0 22.08s 665 49 26,895
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 3.7 9.5 0.0% 0 2.52s 360 70 235
Qwen3.6 Plus Preview 3.0 10.0 0.0% 0 0ms 0 0 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 9.8 10.0 100.0% 0 6.35s 765 182 1,243
Qwen3.6 Plus Preview 6.5 10.0 50.0% 0 3.40s 381 27 1,383
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 5.5 9.9 33.3% 0 3.54s 792 771 2,055
Qwen3.6 Plus Preview 5.3 10.0 33.3% 0 7.52s 183 27 2,998
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 7.72s 9,781 304 984
Qwen3.6 Plus Preview 10.0 10.0 100.0% 0 5.87s 8,193 267 1,330
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 3.0 10.0 0.0% 0 38.47s 228 304 8,240
Qwen3.6 Plus Preview 3.0 10.0 0.0% 0 0ms 0 0 0

Quick Compare

Switch Comparison Pair

DeepSeek V4 FlashhighvsNemotron 3 Ultra 550b A55bmediumFree AvailableNemotron 3 Ultra 550b A55bmediumFree AvailablevsGPT-5.2 ChatnoneNemotron 3 Ultra 550b A55bmediumFree AvailablevsStep 3.7 FlashlowDeepSeek V4 ProhighvsNemotron 3 Ultra 550b A55bmediumFree AvailableNemotron 3 Ultra 550b A55bmediumFree AvailablevsGPT-5.3 ChatnoneGemini 3 Flash PreviewlowvsNemotron 3 Ultra 550b A55bmediumFree AvailableClaude Sonnet 4.6nonevsNemotron 3 Ultra 550b A55bmediumFree AvailableClaude Opus 4.8nonevsNemotron 3 Ultra 550b A55bmediumFree AvailableDeepSeek V4 PrononevsNemotron 3 Ultra 550b A55bmediumFree AvailableNemotron 3 Ultra 550b A55bmediumFree AvailablevsQwen3.7 PlusnoneNemotron 3 Ultra 550b A55bmediumFree AvailablevsGLM 5.2noneNemotron 3 Ultra 550b A55bmediumFree AvailablevsStep 3.7 Flashhigh