Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Google: Gemini 3.1 Flash Lite Preview vs Nemotron 3 Ultra 550b A55b

Summary

Gemini 3.1 Flash Lite Preview vs Nemotron 3 Ultra 550b A55b benchmark comparison: Gemini 3.1 Flash Lite Preview leads on average score with 6.5 vs 6.1. Gemini 3.1 Flash Lite Preview has the lower benchmark cost at $0.026 vs $0.027. Nemotron 3 Ultra 550b A55b is faster at 2.27s vs 2.77s, with pass rates of 61.9% vs 44.4%.

Recommended model: Gemini 3.1 Flash Lite Preview - It has the strongest score in this comparison (6.5) and the best overall balance of cost and response time across all 2 models.

Last updated at: 2026-06-18

Metric Gemini 3.1 Flash Lite Preview Gemini 3.1 Flash Lite Preview low Release: 2026-03-03 Nemotron 3 Ultra 550b A55b Nemotron 3 Ultra 550b A55b none Release: 2026-06-04 Free Available
Score 6.5 6.1
Rank #82 #99
Reliability 10.0 10.0
Consistency 10.0 9.2
Tests Correct
Attempt pass rate 61.9% 44.4%
Flaky tests 0 2
Total Runs 63 63
Cost per result 0.196 0.000
Total Cost $0.026 $0.027
Input Price $0.250 / 1M $0.500 / 1M
Output Price $1.500 / 1M $2.200 / 1M
Total Input Tokens 32,715 43,326
Output Tokens 2,286 2,138
Reasoning Tokens 9,166 0
Response Time (avg) 2.77s 2.27s
Response Time (max) 11.91s 13.49s
Response Time (total) 58.12s 47.65s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#82 Gemini 3.1 Flash Lite Preview

low
Cost
$0.002
Time
3.7s
Tokens
1,203 tok

#99 Nemotron 3 Ultra 550b A55b

none
Cost
$0.000
Time
149.6s
Tokens
3,405 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Flash Lite Preview 8.3 10.0 75.0% 0 2.12s 506 462 1,638
Nemotron 3 Ultra 550b A55b 3.5 8.0 16.7% 1 2.35s 696 239 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Flash Lite Preview 5.5 10.0 33.3% 0 1.39s 8,138 660 1,060
Nemotron 3 Ultra 550b A55b 5.5 10.0 33.3% 0 1.02s 7,623 369 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Flash Lite Preview 3.0 10.0 0.0% 0 11.91s 8,381 225 762
Nemotron 3 Ultra 550b A55b 3.0 10.0 0.0% 0 4.79s 15,558 357 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Flash Lite Preview 10.0 10.0 100.0% 0 3.00s 7,455 291 696
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 1.94s 7,944 249 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Flash Lite Preview 5.3 10.0 33.3% 0 2.36s 641 18 1,212
Nemotron 3 Ultra 550b A55b 5.3 10.0 33.3% 0 698ms 789 27 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Flash Lite Preview 4.0 10.0 0.0% 0 1.54s 490 69 384
Nemotron 3 Ultra 550b A55b 5.0 10.0 0.0% 0 13.49s 516 101 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Flash Lite Preview 10.0 10.0 100.0% 0 1.49s 621 72 753
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 1.46s 723 69 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Flash Lite Preview 10.0 10.0 100.0% 0 1.69s 566 243 1,248
Nemotron 3 Ultra 550b A55b 5.9 7.2 55.6% 1 1.06s 726 352 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Flash Lite Preview 10.0 10.0 100.0% 0 9.54s 5,757 237 993
Nemotron 3 Ultra 550b A55b 10.0 10.0 100.0% 0 2.99s 8,544 264 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemini 3.1 Flash Lite Preview 3.0 10.0 0.0% 0 1.35s 160 9 420
Nemotron 3 Ultra 550b A55b 3.0 10.0 0.0% 0 1.83s 207 111 0

Quick Compare

Switch Comparison Pair

Gemini 3.1 Flash LiteminimalvsNemotron 3 Ultra 550b A55bnoneFree AvailableGemini 3.1 Flash Lite PreviewlowvsQwen3.6 27BmediumGemini 3.1 Flash Lite PreviewlowvsStep 3.5 FlashmediumGemini 3.1 Flash Lite PreviewlowvsGPT-5 NanomediumGemini 3.1 Flash Lite PreviewlowvsNemotron 3 SupermediumFree AvailableGemini 3.1 Flash Lite PreviewlowvsQwen3.5-35B-A3BmediumGemini 3.1 Flash Lite Previewlowvsgpt-oss-120bmediumFree AvailableNorth Mini CodemediumFree AvailablevsNemotron 3 Ultra 550b A55bnoneFree AvailableGemini 3.1 Flash Lite PreviewlowvsGPT-5.5noneGemini 3.1 Flash Lite PreviewlowvsMiMo-V2.5mediumGemini 3.1 Flash Lite PreviewlowvsQwen3.6 35B A3BmediumNemotron 3 Ultra 550b A55bnoneFree AvailablevsQwen3.5-35B-A3Bmedium