Navigate
Advertise here

Granite 4.2 8B (high) vs Nemotron 3.5 Lightning (medium)

The average score is effectively tied at 4.7 vs 4.7. Nemotron 3.5 Lightning (medium) has the lower benchmark cost at $0.129 vs $0.161. Nemotron 3.5 Lightning (medium) is faster at 81.93s vs 235.35s, with pass rates of 37.7% vs 47.8%.

Last updated at: 2026-10-01

Compared models

Rank
#318
Total Output Tokens
661,367
Response Time (avg)
235.35s
Total Cost
$0.161
Rank
#315
Total Output Tokens
766,130
Response Time (avg)
81.93s
Total Cost
$0.129
Recommended model Nemotron 3.5 Lightning (medium)

It has the best score here (4.7), while responding about 2.9x faster than Granite 4.2 8B (high).

Detailed comparison

Metric Granite 4.2 8B Granite 4.2 8B high Release: 2026-09-02 Nemotron 3.5 Lightning Nemotron 3.5 Lightning medium Release: 2026-08-11 Free Available
Score 4.7 4.7
Rank #318 #315
Reliability 8.2 9.8
Consistency 6.4 5.8
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 37.7% 47.8%
Flaky tests 10 12
Total Runs 69 69
Cost per result 2.751 0.000
Total Cost $0.161 $0.129
Input Price $0.060 / 1M $0.060 / 1M
Output Price $0.250 / 1M $0.160 / 1M
Total Input Tokens 282,658 195,780
Output Tokens 198,563 167,746
Reasoning Tokens 462,804 598,384
Response Time (avg) 235.35s 81.93s
Response Time (max) 685.87s 437.11s
Response Time (total) 5413.09s 1884.31s
Parameters 8B 30B total (3B active)
Availability Open source Weights available

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#318 IBM: Granite 4.2 8B

high
Provider returned error
Cost
$0.000
Time
0.2s
Tokens
0 tok

#315 Nemotron 3.5 Lightning

medium
Cost
$0.000
Time
130.5s
Tokens
6,750 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.2 8B 3.8 4.3 33.3% 2 515.34s 7,047 42,438 154,749
Nemotron 3.5 Lightning 4.4 5.1 33.3% 2 285.47s 7,623 78,065 297,359

Quick Compare

Switch Comparison Pair

Granite 4.2 8BhighvsLaguna S 2.1noneFree AvailableMercury 2.5 PreviewnonevsNemotron 3.5 LightningmediumFree AvailableNorth Mini CodenoneFree AvailablevsNemotron 3.5 LightningmediumFree AvailableNorth Mini CodenoneFree AvailablevsGranite 4.2 8BhighGranite 4.2 8BhighvsQwen3 Coder NextmediumNemotron 3.5 LightningmediumFree AvailablevsLaguna S 2.1noneFree AvailableGranite 4.2 8BhighvsMercury 2.5 PreviewnoneDeepSeek V3.2nonevsGranite 4.2 8BhighGranite 4.2 8BhighvsGPT-5.4 NanononeNemotron 3.5 LightningmediumFree AvailablevsGLM 4.7 FlashnoneGranite 4.2 8BhighvsLaguna S 2.1lowFree AvailableDeepSeek V3.2nonevsNemotron 3.5 LightningmediumFree Available