Navigate
Advertise here

Claude Sonnet 5.5 (medium) vs Nemotron 3 Super (medium)

The average score is effectively tied at 5.7 vs 5.7. Nemotron 3 Super (medium) has the lower benchmark cost at $0.054 vs $0.672. Claude Sonnet 5.5 (medium) is faster at 6.07s vs 52.31s, with pass rates of 37.9% vs 40.9%.

Last updated at: 2026-09-29

Compared models

Rank
#266
Total Output Tokens
32,980
Response Time (avg)
6.07s
Total Cost
$0.672
Rank
#267
Total Output Tokens
115,574
Response Time (avg)
52.31s
Total Cost
$0.054
Recommended model Nemotron 3 Super (medium)

It has the best score here (5.7), while costing about 12.5x less than Claude Sonnet 5.5 (medium).

Detailed comparison

Metric Claude Sonnet 5.5 Claude Sonnet 5.5 medium Release: 2026-09-29 Nemotron 3 Super Nemotron 3 Super medium Release: 2026-03-11 Free Available
Score 5.7 5.7
Rank #266 #267
Reliability 10.0 9.1
Consistency 9.7 8.9
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 37.9% 40.9%
Flaky tests 1 3
Total Runs 66 66
Cost per result 8.392 0.004
Total Cost $0.672 $0.054
Input Price $2.000 / 1M $0.080 / 1M
Output Price $10.000 / 1M $0.450 / 1M
Total Input Tokens 170,771 81,438
Output Tokens 23,185 17,674
Reasoning Tokens 9,795 97,900
Response Time (avg) 6.07s 52.31s
Response Time (max) 26.16s 431.98s
Response Time (total) 133.62s 1046.21s
Parameters ~1T total (~100B active) 120B total (12B active)
Availability Closed Weights available

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#266 Claude Sonnet 5.5

medium
Cost
$0.024
Time
17.4s
Tokens
2,525 tok

#267 Nemotron 3 Super

medium
Cost
$0.000
Time
272.6s
Tokens
5,296 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Sonnet 5.5 3.4 9.7 0.0% 0 6.07s 10,608 6,767 0
Nemotron 3 Super 3.1 10.0 0.0% 0 147.32s 2,275 797 4,424

Quick Compare

Switch Comparison Pair