#88

Nemotron 3 Ultra

NVIDIA Release: 2026-06-04 Tested on: 2026-08-14 02:39 nvidia/nemotron-3-ultra-550b-a55b::medium

550B total (55B active)MoEWeights available

(medium) (none)

Summary

Nemotron 3 Ultra scores 7.6 on AI BENCHY and ranks #88. It has 9.8 reliability, a 66.7% pass rate, $0.567 total cost, and 33.62s average response time.

What makes Nemotron 3 Ultra unique: It stands out most in Anti-AI Tricks, where it ranks #1, while General Intelligence is its weakest area at #16.

Model facts

Researched on 2026-08-12

Reported

Parameters: 550B total (55B active)
Architecture: MoE
Availability: Weights available
License: NVIDIA Open Model

Parameter source Availability source

Score

7.6

Consistency

8.8

Reliability

9.8

Total Cost (Current Price)

$0.567 ↕ New

Tested at: $0.000

Total Output Tokens

184,405

Total Input Tokens

233,415

Input Price

$0.600 / 1M

Output Price

$2.400 / 1M

Tests Correct

Wrong Tests: 9

Attempt pass rate: 66.7%

Flaky tests

Flaky tests had mixed outcomes across runs (at least one pass and one fail).

Response Time (avg)

33.62s

Response Time (max): 392.56s

Response Time (total): 739.59s

Wrong answer: 7 API error: 1 Invalid tool call: 1

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#88 Nemotron 3 Ultra

medium

Invalid SVG

Cost: $0.000
Time: 300.0s
Tokens: 0 tok

Run history

Tested on	Score	Reliability	Tests Correct	Total Cost	Compare
2026-08-14 02:39 Re-test	7.6	9.8		$0.567