Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Google: Gemini 2.5 Flash vs Nemotron 3 Ultra 550b A55b

Summary

Gemini 2.5 Flash vs Nemotron 3 Ultra 550b A55b benchmark comparison: Gemini 2.5 Flash leads on average score with 8.2 vs 8.1. Nemotron 3 Ultra 550b A55b has the lower benchmark cost at $0.177 vs $0.379. Nemotron 3 Ultra 550b A55b is faster at 15.05s vs 15.49s, with pass rates of 69.8% vs 69.8%.

Recommended model: Nemotron 3 Ultra 550b A55b - Its score stays close to the best score here (8.1 vs 8.2), while costing about 2.1x less than Gemini 2.5 Flash.

Last updated at: 2026-06-12

Metric Gemini 2.5 Flash Gemini 2.5 Flash medium Release: 2025-06-17 Nemotron 3 Ultra 550b A55b Nemotron 3 Ultra 550b A55b medium Release: 2026-06-04 Free Available
Score 8.2 8.1
Rank #27 #29
Reliability 10.0 9.7
Consistency 9.6 8.8
Tests Correct
Attempt pass rate 69.8% 69.8%
Flaky tests 1 3
Total Runs 63 63
Cost per result 2.701 0.000
Total Cost $0.379 $0.177
Input Price $0.300 / 1M $0.500 / 1M
Output Price $2.500 / 1M $2.500 / 1M
Total Input Tokens 34,476 46,813
Output Tokens 1,930 18,002
Reasoning Tokens 145,145 53,091
Response Time (avg) 15.49s 15.05s
Response Time (max) 95.48s 43.93s
Response Time (total) 325.39s 316.09s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#27 Gemini 2.5 Flash

medium
Invalid SVG
Cost
$0.000
Time
274.0s
Tokens
0 tok

#29 Nemotron 3 Ultra 550b A55b

medium
No showcase result has been generated for this model yet.
Cost
$0.000
Time
-
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 2.5 Flash 8.4 10.0 75.0% 0 6.30s 492 255 10,233
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 8.62s 780 835 1,485
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 2.5 Flash 7.8 10.0 66.7% 0 41.01s 6,669 543 32,303
Nemotron 3 Ultra 550b A55b 8.4 7.4 88.9% 1 26.53s 7,686 2,854 17,725
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 2.5 Flash 10.0 10.0 100.0% 0 28.44s 12,522 303 11,922
Nemotron 3 Ultra 550b A55b 9.8 10.0 100.0% 0 43.93s 17,574 1,040 3,590
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 2.5 Flash 10.0 10.0 100.0% 0 4.06s 7,257 279 2,325
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 5.68s 7,989 473 1,285
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 2.5 Flash 5.9 7.2 55.6% 1 37.34s 633 18 80,702
Nemotron 3 Ultra 550b A55b 3.5 4.4 33.3% 2 24.90s 858 11,169 16,249
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 2.5 Flash 4.8 10.0 0.0% 0 4.86s 486 92 1,899
Nemotron 3 Ultra 550b A55b 3.7 9.5 0.0% 0 2.52s 360 70 235
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 2.5 Flash 9.8 10.0 100.0% 0 2.62s 615 69 1,203
Nemotron 3 Ultra 550b A55b 9.8 10.0 100.0% 0 6.35s 765 182 1,243
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 2.5 Flash 7.7 10.0 66.7% 0 3.18s 558 126 2,499
Nemotron 3 Ultra 550b A55b 5.5 9.9 33.3% 0 3.54s 792 771 2,055
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 2.5 Flash 10.0 10.0 100.0% 0 6.20s 5,088 234 1,140
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 7.72s 9,781 304 984
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 2.5 Flash 3.0 10.0 0.0% 0 2.76s 156 11 919
Nemotron 3 Ultra 550b A55b 3.0 10.0 0.0% 0 38.47s 228 304 8,240

Quick Compare

Switch Comparison Pair

DeepSeek V4 FlashhighvsGemini 2.5 FlashmediumDeepSeek V4 FlashhighvsNemotron 3 Ultra 550b A55bmediumFree AvailableGemini 2.5 FlashmediumvsGPT-5.2 ChatnoneNemotron 3 Ultra 550b A55bmediumFree AvailablevsGPT-5.2 ChatnoneNemotron 3 Ultra 550b A55bmediumFree AvailablevsStep 3.7 FlashlowGemini 2.5 FlashmediumvsStep 3.7 FlashlowNemotron 3 Ultra 550b A55bmediumFree AvailablevsGPT-5.3 ChatnoneGemini 2.5 FlashmediumvsGPT-5.3 ChatnoneGemini 3 Flash PreviewlowvsNemotron 3 Ultra 550b A55bmediumFree AvailableClaude Sonnet 4.6nonevsNemotron 3 Ultra 550b A55bmediumFree AvailableClaude Opus 4.8nonevsNemotron 3 Ultra 550b A55bmediumFree AvailableClaude Sonnet 4.6nonevsGemini 2.5 Flashmedium