Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Granite 4.2 8B (high) vs Nemotron 3.5 Lightning (low)

Nemotron 3.5 Lightning (low) leads on average score with 4.8 vs 4.6. Granite 4.2 8B (high) has the lower benchmark cost at $0.084 vs $0.140. Nemotron 3.5 Lightning (low) is faster at 59.81s vs 235.89s, with pass rates of 39.4% vs 42.4%.

Last updated at: 2026-09-02

Rank
#276
Total Output Tokens
612,215
Response Time (avg)
235.89s
Total Cost
$0.084
Rank
#264
Total Output Tokens
665,174
Response Time (avg)
59.81s
Total Cost
$0.140
Recommended model Nemotron 3.5 Lightning (low)

It has the best score here (4.8), while responding about 3.9x faster than Granite 4.2 8B (high).

Detailed comparison

Metric Granite 4.2 8B Granite 4.2 8B high Release: 2026-09-02 Nemotron 3.5 Lightning Nemotron 3.5 Lightning low Release: 2026-08-11 Free Available
Score 4.6 4.8
Rank #276 #264
Reliability 7.6 9.8
Consistency 6.3 6.8
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 39.4% 42.4%
Flaky tests 10 9
Total Runs 66 66
Cost per result 2.085 0.000
Total Cost $0.084 $0.140
Input Price $0.100 / 1M $0.080 / 1M
Output Price $0.150 / 1M $0.200 / 1M
Total Input Tokens 43,278 138,792
Output Tokens 181,083 142,972
Reasoning Tokens 431,132 522,202
Response Time (avg) 235.89s 59.81s
Response Time (max) 685.87s 312.21s
Response Time (total) 5189.64s 1315.80s
Parameters 8B 30B total (3B active)
Availability Open source Weights available

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#276 IBM: Granite 4.2 8B

high
Provider returned error
Cost
$0.000
Time
0.2s
Tokens
0 tok

#264 Nemotron 3.5 Lightning

low
Cost
$0.000
Time
32.2s
Tokens
6,089 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.2 8B 3.8 4.3 33.3% 2 515.34s 7,047 42,438 154,749
Nemotron 3.5 Lightning 4.0 7.8 11.1% 1 224.42s 7,522 72,614 262,558

Quick Compare

Switch Comparison Pair

Ring-2.6-1TnonevsNemotron 3.5 LightninglowFree AvailableNemotron 3.5 LightninglowFree AvailablevsHy4 previewnoneNemotron 3.5 LightninglowFree AvailablevsGPT-5.4 NanononeTrinity Large ThinkinghighvsNemotron 3.5 LightninglowFree AvailableGranite 4.2 8BhighvsQwen3 Coder NextmediumGranite 4.2 8BhighvsMiniMax M2.5mediumLing-2.6-flashnonevsNemotron 3.5 LightninglowFree AvailableGranite 4.2 8BhighvsMercury 2noneKAT-Coder-Air V2.5nonevsNemotron 3.5 LightninglowFree AvailableNemotron 3.5 LightninglowFree AvailablevsGLM 4.7 FlashnoneTrinity Large PreviewnonevsNemotron 3.5 LightninglowFree AvailableCobuddymediumvsGranite 4.2 8Bhigh