Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Nemotron 3 Ultra 550b A55b vs Qwen: Qwen3.6 Max Preview

Summary

Nemotron 3 Ultra 550b A55b vs Qwen3.6 Max Preview benchmark comparison: Qwen3.6 Max Preview leads on average score with 8.5 vs 7.5. Nemotron 3 Ultra 550b A55b has the lower benchmark cost at $0.177 vs $0.960. Nemotron 3 Ultra 550b A55b is faster at 15.05s vs 59.63s, with pass rates of 69.8% vs 81.0%.

Recommended model: Nemotron 3 Ultra 550b A55b - It offers the best overall trade-off: a competitive score (7.5), lower cost than Qwen3.6 Max Preview, and balanced response time.

Last updated at: 2026-06-10

Metric Nemotron 3 Ultra 550b A55b Nemotron 3 Ultra 550b A55b medium Release: 2026-06-04 Free Available Qwen3.6 Max Preview Qwen3.6 Max Preview medium Release: 2026-04-20
Score 7.5 8.5
Rank #42 #15
Reliability 9.7 10.0
Consistency 8.8 9.3
Tests Correct
Attempt pass rate 69.8% 81.0%
Flaky tests 3 2
Total Runs 63 63
Cost per result 0.000 7.024
Total Cost $0.177 $0.960
Input Price $0.500 / 1M $1.040 / 1M
Output Price $2.500 / 1M $6.240 / 1M
Total Input Tokens 46,813 42,362
Output Tokens 18,002 2,273
Reasoning Tokens 53,091 144,367
Response Time (avg) 15.05s 59.63s
Response Time (max) 43.93s 238.07s
Response Time (total) 316.09s 1252.17s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#42 Nemotron 3 Ultra 550b A55b

medium
No showcase result has been generated for this model yet.
Cost
$0.000
Time
-
Tokens
0 tok

#15 Qwen3.6 Max Preview

medium
Cost
$0.024
Time
76.5s
Tokens
3,861 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 8.62s 780 835 1,485
Qwen3.6 Max Preview 10.0 10.0 100.0% 0 22.13s 672 228 10,075
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 8.4 7.4 88.9% 1 26.53s 7,686 2,854 17,725
Qwen3.6 Max Preview 8.8 7.8 88.9% 1 146.48s 7,895 427 52,957
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 9.8 10.0 100.0% 0 43.93s 17,574 1,040 3,590
Qwen3.6 Max Preview 10.0 10.0 100.0% 0 121.49s 14,934 390 14,575
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 5.68s 7,989 473 1,285
Qwen3.6 Max Preview 10.0 10.0 100.0% 0 41.15s 7,782 270 10,106
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 3.5 4.4 33.3% 2 24.90s 858 11,169 16,249
Qwen3.6 Max Preview 2.9 7.2 11.1% 1 95.91s 771 60 30,371
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 3.7 9.5 0.0% 0 2.52s 360 70 235
Qwen3.6 Max Preview 10.0 10.0 100.0% 0 32.24s 516 129 3,510
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 9.8 10.0 100.0% 0 6.35s 765 182 1,243
Qwen3.6 Max Preview 10.0 10.0 100.0% 0 24.31s 699 103 5,848
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 5.5 9.9 33.3% 0 3.54s 792 771 2,055
Qwen3.6 Max Preview 10.0 10.0 100.0% 0 24.32s 696 329 7,693
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 7.72s 9,781 304 984
Qwen3.6 Max Preview 10.0 10.0 100.0% 0 18.32s 8,193 309 1,571
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 3.0 10.0 0.0% 0 38.47s 228 304 8,240
Qwen3.6 Max Preview 3.0 10.0 0.0% 0 60.56s 204 28 7,661

Quick Compare

Switch Comparison Pair

Gemini 3 Flash PreviewnonevsNemotron 3 Ultra 550b A55bmediumFree AvailableGemini 3.1 Flash Lite PreviewlowvsNemotron 3 Ultra 550b A55bmediumFree AvailableGemini 3 Flash PreviewlowvsQwen3.6 Max PreviewmediumNemotron 3 Ultra 550b A55bmediumFree AvailablevsQwen3.7 MaxnoneGemini 3.5 FlashminimalvsNemotron 3 Ultra 550b A55bmediumFree AvailableNemotron 3 Ultra 550b A55bmediumFree AvailablevsStep 3.7 FlashlowDeepSeek V4 FlashhighvsNemotron 3 Ultra 550b A55bmediumFree AvailableGemini 3.1 Flash Lite PreviewnonevsNemotron 3 Ultra 550b A55bmediumFree AvailableGemini 3.1 Flash LitelowvsNemotron 3 Ultra 550b A55bmediumFree AvailableNemotron 3 Ultra 550b A55bmediumFree AvailablevsGPT-5.3 ChatnoneGemini 3.5 FlashnonevsQwen3.6 Max PreviewmediumNemotron 3 Ultra 550b A55bmediumFree AvailablevsGPT-5.2 Chatnone