Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Google: Gemini 3.1 Pro Preview vs Nemotron 3 Ultra 550b A55b

Summary

Gemini 3.1 Pro Preview vs Nemotron 3 Ultra 550b A55b benchmark comparison: Gemini 3.1 Pro Preview leads on average score with 9.2 vs 8.1. Nemotron 3 Ultra 550b A55b has the lower benchmark cost at $0.158 vs $1.054. Nemotron 3 Ultra 550b A55b is faster at 15.05s vs 20.14s, with pass rates of 90.5% vs 69.8%.

Recommended model: Gemini 3.1 Pro Preview - It has the strongest score in this comparison (9.2) and the best overall balance of cost and response time across all 2 models.

Last updated at: 2026-06-18

Metric Gemini 3.1 Pro Preview Gemini 3.1 Pro Preview medium Release: 2026-02-19 Nemotron 3 Ultra 550b A55b Nemotron 3 Ultra 550b A55b medium Release: 2026-06-04 Free Available
Score 9.2 8.1
Rank #7 #26
Reliability 10.0 9.7
Consistency 10.0 8.8
Tests Correct
Attempt pass rate 90.5% 69.8%
Flaky tests 0 3
Total Runs 63 63
Cost per result 5.546 0.000
Total Cost $1.054 $0.158
Input Price $2.000 / 1M $0.500 / 1M
Output Price $12.000 / 1M $2.200 / 1M
Total Input Tokens 41,617 46,813
Output Tokens 1,977 18,002
Reasoning Tokens 78,896 53,091
Response Time (avg) 20.14s 15.05s
Response Time (max) 88.68s 43.93s
Response Time (total) 281.92s 316.09s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#7 Gemini 3.1 Pro Preview

medium
Cost
$0.115
Time
87.2s
Tokens
9,629 tok

#26 Nemotron 3 Ultra 550b A55b

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Pro Preview 10.0 10.0 100.0% 0 7.90s 498 112 3,218
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 8.62s 780 835 1,485
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Pro Preview 7.9 9.9 66.7% 0 40.17s 8,124 435 41,247
Nemotron 3 Ultra 550b A55b 8.4 7.4 88.9% 1 26.53s 7,686 2,854 17,725
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Pro Preview 9.5 10.0 100.0% 0 40.61s 17,240 432 9,281
Nemotron 3 Ultra 550b A55b 9.8 10.0 100.0% 0 43.93s 17,574 1,040 3,590
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Pro Preview 10.0 10.0 100.0% 0 7.72s 7,265 279 3,904
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 5.68s 7,989 473 1,285
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Pro Preview 7.7 10.0 66.7% 0 32.73s 635 18 12,424
Nemotron 3 Ultra 550b A55b 3.5 4.4 33.3% 2 24.90s 858 11,169 16,249
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Pro Preview 10.0 10.0 100.0% 0 11.77s 490 108 1,179
Nemotron 3 Ultra 550b A55b 3.7 9.5 0.0% 0 2.52s 360 70 235
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Pro Preview 10.0 10.0 100.0% 0 9.56s 621 72 2,236
Nemotron 3 Ultra 550b A55b 9.8 10.0 100.0% 0 6.35s 765 182 1,243
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Pro Preview 10.0 10.0 100.0% 0 6.90s 570 235 3,128
Nemotron 3 Ultra 550b A55b 5.5 9.9 33.3% 0 3.54s 792 771 2,055
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Pro Preview 10.0 10.0 100.0% 0 23.15s 6,018 274 982
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 7.72s 9,781 304 984
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Pro Preview 10.0 10.0 100.0% 0 6.27s 156 12 1,297
Nemotron 3 Ultra 550b A55b 3.0 10.0 0.0% 0 38.47s 228 304 8,240

Quick Compare

Switch Comparison Pair

Gemini 3.1 Pro PreviewmediumvsGPT-5.5lowDeepSeek V4 FlashhighvsNemotron 3 Ultra 550b A55bmediumFree AvailableNemotron 3 Ultra 550b A55bmediumFree AvailablevsGPT-5.2 ChatnoneNemotron 3 Ultra 550b A55bmediumFree AvailablevsStep 3.7 FlashlowDeepSeek V4 ProhighvsNemotron 3 Ultra 550b A55bmediumFree AvailableNemotron 3 Ultra 550b A55bmediumFree AvailablevsGPT-5.3 ChatnoneGemini 3.1 Pro PreviewmediumvsGPT-5.2 ChatnoneGemini 3 Flash PreviewlowvsNemotron 3 Ultra 550b A55bmediumFree AvailableClaude Sonnet 4.6nonevsNemotron 3 Ultra 550b A55bmediumFree AvailableClaude Opus 4.8nonevsNemotron 3 Ultra 550b A55bmediumFree AvailableDeepSeek V4 FlashhighvsGemini 3.1 Pro PreviewmediumDeepSeek V4 PrononevsNemotron 3 Ultra 550b A55bmediumFree Available