Navigate
AI BENCHY
Advertise here

Granite 4.2 8B vs Nemotron 3.5 Lightning (low)

Nemotron 3.5 Lightning (low) leads on average score with 4.8 vs 4.3. Granite 4.2 8B has the lower benchmark cost at $0.026 vs $0.140. Nemotron 3.5 Lightning (low) is faster at 59.81s vs 86.27s, with pass rates of 16.7% vs 42.4%.

Last updated at: 2026-09-02

Rank
#285
Total Output Tokens
130,805
Response Time (avg)
86.27s
Total Cost
$0.026
Rank
#264
Total Output Tokens
665,174
Response Time (avg)
59.81s
Total Cost
$0.140
Recommended model Nemotron 3.5 Lightning (low)

It has the strongest score in this comparison (4.8) and the best overall balance of cost and response time across all 2 models.

Detailed comparison

Metric Granite 4.2 8B Granite 4.2 8B none Release: 2026-09-02 Nemotron 3.5 Lightning Nemotron 3.5 Lightning low Release: 2026-08-11 Free Available
Score 4.3 4.8
Rank #285 #264
Reliability 8.6 9.8
Consistency 9.3 6.8
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 16.7% 42.4%
Flaky tests 2 9
Total Runs 66 66
Cost per result 0.847 0.000
Total Cost $0.026 $0.140
Input Price $0.100 / 1M $0.080 / 1M
Output Price $0.150 / 1M $0.200 / 1M
Total Input Tokens 57,786 138,792
Output Tokens 130,805 142,972
Reasoning Tokens 0 522,202
Response Time (avg) 86.27s 59.81s
Response Time (max) 747.17s 312.21s
Response Time (total) 1897.96s 1315.80s
Parameters 8B 30B total (3B active)
Availability Open source Weights available

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#285 IBM: Granite 4.2 8B

none
Provider returned error
Cost
$0.000
Time
0.2s
Tokens
0 tok

#264 Nemotron 3.5 Lightning

low
Cost
$0.000
Time
32.2s
Tokens
6,089 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.2 8B 5.5 10.0 33.3% 0 105.60s 8,358 47,944 0
Nemotron 3.5 Lightning 4.0 7.8 11.1% 1 224.42s 7,522 72,614 262,558

Quick Compare

Switch Comparison Pair

Ring-2.6-1TnonevsNemotron 3.5 LightninglowFree AvailableNemotron 3.5 LightninglowFree AvailablevsHy4 previewnoneNemotron 3.5 LightninglowFree AvailablevsGPT-5.4 NanononeGranite 4.2 8BnonevsGLM 4.7 FlashmediumTrinity Large ThinkinghighvsNemotron 3.5 LightninglowFree AvailableLing-2.6-flashnonevsNemotron 3.5 LightninglowFree AvailableKAT-Coder-Air V2.5nonevsNemotron 3.5 LightninglowFree AvailableNemotron 3.5 LightninglowFree AvailablevsGLM 4.7 FlashnoneTrinity Large PreviewnonevsNemotron 3.5 LightninglowFree AvailableMercury 2.5 PreviewnonevsNemotron 3.5 LightninglowFree AvailableNemotron 3.5 LightninglowFree AvailablevsGPT-4o-mininoneCobuddymediumvsNemotron 3.5 LightninglowFree Available