#125

Nemotron 3 Ultra

NVIDIA Release: 2026-06-04 Tested on: 2026-07-16 22:48 nvidia/nemotron-3-ultra-550b-a55b::none

(medium) (none)

Summary

Nemotron 3 Ultra scores 6.1 on AI BENCHY and ranks #125. It has 10.0 reliability, a 42.4% pass rate, $0.095 total cost, and 3.87s average response time.

Score

6.1

Consistency

9.3

Reliability

10.0

Total Cost (Current Price)

$0.095 ↕ New

Tested at: $0.000

Total Output Tokens

9,474

Total Input Tokens

101,275

Input Price

$0.600 / 1M

Output Price

$3.600 / 1M

Tests Correct

Wrong Tests: 14

Attempt pass rate: 42.4%

Flaky tests

Flaky tests had mixed outcomes across runs (at least one pass and one fail).

Response Time (avg)

3.87s

Response Time (max): 37.50s

Response Time (total): 85.15s

Wrong answer: 12 API error: 1 Did not follow instructions: 1

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#125 Nemotron 3 Ultra

none

Cost: $0.000
Time: 149.6s
Tokens: 3,405 tok

Run history

Tested on	Score	Reliability	Tests Correct	Total Cost	Compare
2026-07-16 22:48 New test added	6.1	10.0		$0.095