Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Anthropic: Claude Fable 5 vs Nemotron 3 Ultra 550b A55b

Summary

Claude Fable 5 vs Nemotron 3 Ultra 550b A55b benchmark comparison: Claude Fable 5 leads on average score with 8.7 vs 7.5. Nemotron 3 Ultra 550b A55b has the lower benchmark cost at $0.177 vs $3.165. Nemotron 3 Ultra 550b A55b is faster at 15.05s vs 17.01s, with pass rates of 82.5% vs 69.8%.

Recommended model: Nemotron 3 Ultra 550b A55b - It offers the best overall trade-off: a competitive score (7.5), lower cost than Claude Fable 5, and balanced response time.

Last updated at: 2026-06-10

Metric Claude Fable 5 Claude Fable 5 medium Release: 2026-06-10 Nemotron 3 Ultra 550b A55b Nemotron 3 Ultra 550b A55b medium Release: 2026-06-04 Free Available
Score 8.7 7.5
Rank #12 #42
Reliability 10.0 9.7
Consistency 9.6 8.8
Tests Correct
Attempt pass rate 82.5% 69.8%
Flaky tests 1 3
Total Runs 63 63
Cost per result 18.614 0.000
Total Cost $3.165 $0.177
Input Price $10.000 / 1M $0.500 / 1M
Output Price $50.000 / 1M $2.500 / 1M
Total Input Tokens 58,383 46,813
Output Tokens 41,340 18,002
Reasoning Tokens 10,269 53,091
Response Time (avg) 17.01s 15.05s
Response Time (max) 80.80s 43.93s
Response Time (total) 357.17s 316.09s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#12 Claude Fable 5

medium
Cost
$0.606
Time
156.7s
Tokens
12,264 tok

#42 Nemotron 3 Ultra 550b A55b

medium
No showcase result has been generated for this model yet.
Cost
$0.000
Time
-
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Fable 5 10.0 10.0 100.0% 0 6.20s 834 530 402
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 8.62s 780 835 1,485
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Fable 5 10.0 10.0 100.0% 0 15.59s 10,590 7,383 1,318
Nemotron 3 Ultra 550b A55b 8.4 7.4 88.9% 1 26.53s 7,686 2,854 17,725
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Fable 5 10.0 10.0 100.0% 0 33.70s 20,937 2,353 1,599
Nemotron 3 Ultra 550b A55b 9.8 10.0 100.0% 0 43.93s 17,574 1,040 3,590
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Fable 5 10.0 10.0 100.0% 0 7.18s 10,503 521 363
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 5.68s 7,989 473 1,285
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Fable 5 5.3 7.2 44.4% 1 53.40s 975 25,215 5,001
Nemotron 3 Ultra 550b A55b 3.5 4.4 33.3% 2 24.90s 858 11,169 16,249
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Fable 5 10.0 10.0 100.0% 0 7.42s 708 366 144
Nemotron 3 Ultra 550b A55b 3.7 9.5 0.0% 0 2.52s 360 70 235
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Fable 5 10.0 10.0 100.0% 0 5.90s 909 139 202
Nemotron 3 Ultra 550b A55b 9.8 10.0 100.0% 0 6.35s 765 182 1,243
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Fable 5 7.7 10.0 66.7% 0 5.18s 894 402 324
Nemotron 3 Ultra 550b A55b 5.5 9.9 33.3% 0 3.54s 792 771 2,055
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Fable 5 10.0 10.0 100.0% 0 16.96s 11,775 729 344
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 7.72s 9,781 304 984
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Fable 5 3.0 10.0 0.0% 0 25.64s 258 3,702 572
Nemotron 3 Ultra 550b A55b 3.0 10.0 0.0% 0 38.47s 228 304 8,240

Quick Compare

Switch Comparison Pair

Gemini 3 Flash PreviewnonevsNemotron 3 Ultra 550b A55bmediumFree AvailableGemini 3.1 Flash Lite PreviewlowvsNemotron 3 Ultra 550b A55bmediumFree AvailableNemotron 3 Ultra 550b A55bmediumFree AvailablevsQwen3.7 MaxnoneGemini 3.5 FlashminimalvsNemotron 3 Ultra 550b A55bmediumFree AvailableNemotron 3 Ultra 550b A55bmediumFree AvailablevsStep 3.7 FlashlowDeepSeek V4 FlashhighvsNemotron 3 Ultra 550b A55bmediumFree AvailableGemini 3.1 Flash Lite PreviewnonevsNemotron 3 Ultra 550b A55bmediumFree AvailableGemini 3.1 Flash LitelowvsNemotron 3 Ultra 550b A55bmediumFree AvailableClaude Fable 5mediumvsGemini 3 Flash PreviewlowNemotron 3 Ultra 550b A55bmediumFree AvailablevsGPT-5.3 ChatnoneClaude Fable 5mediumvsGPT-5.5lowNemotron 3 Ultra 550b A55bmediumFree AvailablevsGPT-5.2 Chatnone