Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Nemotron 3 Ultra 550b A55b vs OpenAI: GPT-5.3 Chat

Last updated at: 2026-06-04

Metric Nemotron 3 Ultra 550b A55b Nemotron 3 Ultra 550b A55b medium Release: 2026-06-04 Free Available GPT-5.3 Chat GPT-5.3 Chat none Release: 2026-03-03
Score 7.5 7.2
Rank #41 #63
Reliability 9.7 10.0
Consistency 8.8 8.1
Tests Correct
Attempt pass rate 69.8% 66.7%
Flaky tests 3 5
Total Runs 63 63
Cost per result 0.000 3.605
Total Cost $0.000 $0.433
Input Price $0.000 / 1M $1.750 / 1M
Output Price $0.000 / 1M $14.000 / 1M
Total Input Tokens 46,813 34,209
Output Tokens 18,002 26,617
Reasoning Tokens 53,091 0
Response Time (avg) 15.05s 6.34s
Response Time (max) 43.93s 18.33s
Response Time (total) 316.09s 133.13s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 8.62s 780 835 1,485
GPT-5.3 Chat 6.7 8.1 58.3% 1 3.86s 606 3,167 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 8.4 7.4 88.9% 1 26.53s 7,686 2,854 17,725
GPT-5.3 Chat 5.6 4.7 55.6% 2 10.52s 7,302 6,632 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 9.8 10.0 100.0% 0 43.93s 17,574 1,040 3,590
GPT-5.3 Chat 10.0 10.0 100.0% 0 11.96s 11,019 2,614 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 5.68s 7,989 473 1,285
GPT-5.3 Chat 10.0 10.0 100.0% 0 2.21s 7,140 942 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 3.5 4.4 33.3% 2 24.90s 858 11,169 16,249
GPT-5.3 Chat 3.5 4.4 33.3% 2 13.01s 723 8,264 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 3.7 9.5 0.0% 0 2.52s 360 70 235
GPT-5.3 Chat 4.6 10.0 0.0% 0 1.99s 477 319 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 9.8 10.0 100.0% 0 6.35s 765 182 1,243
GPT-5.3 Chat 9.8 10.0 100.0% 0 3.51s 660 1,491 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 5.5 9.9 33.3% 0 3.54s 792 771 2,055
GPT-5.3 Chat 10.0 10.0 100.0% 0 2.99s 642 1,758 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 7.72s 9,781 304 984
GPT-5.3 Chat 10.0 10.0 100.0% 0 8.36s 5,445 861 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3 Ultra 550b A55b 3.0 10.0 0.0% 0 38.47s 228 304 8,240
GPT-5.3 Chat 3.0 10.0 0.0% 0 4.38s 195 569 0

Quick Compare

Switch Comparison Pair

GPT-5.3 ChatnonevsMiMo-V2-FlashmediumGPT-5.3 ChatnonevsStep 3.5 FlashmediumGemini 3.1 Flash LitelowvsGPT-5.3 ChatnoneKimi K2.6mediumFree AvailablevsGPT-5.3 ChatnoneGPT-5.3 ChatnonevsGLM 5V TurbomediumGPT-5.3 ChatnonevsGrok 4.20mediumGPT-5.3 ChatnonevsStep 3.7 FlashlowGPT-5.3 ChatnonevsQwen3.5-35B-A3BmediumGPT-5.3 ChatnonevsMiMo-V2.5mediumGemini 3 Flash PreviewnonevsNemotron 3 Ultra 550b A55bmediumFree AvailableGPT-5.3 ChatnonevsGLM 5.1mediumGemini 3.1 Flash Lite PreviewlowvsNemotron 3 Ultra 550b A55bmediumFree Available