Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Nemotron 3.5 Lightning vs Grok 4.20

Nemotron 3.5 Lightning leads on average score with 3.8 vs 3.4. Nemotron 3.5 Lightning has the lower benchmark cost at $0.009 vs $0.057. Grok 4.20 is faster at 1.11s vs 15.92s, with pass rates of 15.9% vs 26.1%.

Last updated at: 2026-11-13

Compared models

Rank
#453
Total Output Tokens
4,779
Response Time (avg)
15.92s
Total Cost
$0.009
Rank
#463
Total Output Tokens
1,923
Response Time (avg)
1.11s
Total Cost
$0.057
Recommended model Nemotron 3.5 Lightning

It has the best score here (3.8), while costing about 7.0x less than Grok 4.20.

Detailed comparison

Metric Nemotron 3.5 Lightning Nemotron 3.5 Lightning none Release: 2026-08-11 Free Available Grok 4.20 Grok 4.20 none Release: 2026-03-31
Score 3.8 3.4
Rank #453 #463
Reliability 9.8 N/A
Consistency 9.3 7.8
Attempts 69/69 54/69
Tests Correct
Attempt pass rate 15.9% 26.1%
Flaky tests 2 0
Total Runs 69 54
Cost per result 0.000 1.570
Total Cost $0.009 $0.057
Input Price $0.060 / 1M $1.250 / 1M
Output Price $0.160 / 1M $2.500 / 1M
Cache Read Price $0.030 / 1M $0.200 / 1M
Cache Write Price N/A N/A
Total Input Tokens 97,418 41,313
Output Tokens 4,779 1,923
Reasoning Tokens 0 0
Response Time (avg) 15.92s 1.11s
Response Time (max) 339.57s 6.04s
Response Time (total) 366.20s 19.96s
Parameters 30B total (3B active) ~1T total (~100B active)
Availability Weights available Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#453 Nemotron 3.5 Lightning

none
Cost
$0.000
Time
101.6s
Tokens
6,775 tok

#463 xAI: Grok 4.20

none
Cost
$0.004
Time
6.5s
Tokens
1,367 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3.5 Lightning 3.1 7.2 11.1% 1 1.55s 7,623 589 0
Grok 4.20 1.1 3.1 0.0% 0 1.22s 1,074 312 0

Switch Comparison Pair