Navigate
Advertise here

Granite 4.1 8B vs Nemotron 3.5 Lightning (low)

Nemotron 3.5 Lightning (low) leads on average score with 4.8 vs 4.0. Granite 4.1 8B has the lower benchmark cost at $0.007 vs $0.139. Granite 4.1 8B is faster at 1.44s vs 59.81s, with pass rates of 9.1% vs 42.4%.

Last updated at: 2026-09-23

Compared models

Rank
#339
Total Output Tokens
5,996
Response Time (avg)
1.44s
Total Cost
$0.007
Rank
#311
Total Output Tokens
665,174
Response Time (avg)
59.81s
Total Cost
$0.139
Recommended model Granite 4.1 8B

It offers the best overall trade-off: a competitive score (4.0), lower cost than Nemotron 3.5 Lightning (low), and balanced response time.

Detailed comparison

Metric Granite 4.1 8B Granite 4.1 8B none Release: 2026-05-01 Nemotron 3.5 Lightning Nemotron 3.5 Lightning low Release: 2026-08-11 Free Available
Score 4.0 4.8
Rank #339 #311
Reliability 10.0 9.8
Consistency 10.0 6.8
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 9.1% 42.4%
Flaky tests 0 9
Total Runs 66 66
Cost per result 0.315 0.000
Total Cost $0.007 $0.139
Input Price $0.050 / 1M $0.070 / 1M
Output Price $0.100 / 1M $0.200 / 1M
Total Input Tokens 113,836 138,792
Output Tokens 5,996 142,972
Reasoning Tokens 0 522,202
Response Time (avg) 1.44s 59.81s
Response Time (max) 16.67s 312.21s
Response Time (total) 31.75s 1315.80s
Parameters 8B 30B total (3B active)
Availability Open source Weights available

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#339 IBM: Granite 4.1 8B

none
Cost
$0.001
Time
3.2s
Tokens
491 tok

#311 Nemotron 3.5 Lightning

low
Cost
$0.000
Time
32.2s
Tokens
6,089 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.1 8B 4.5 10.0 0.0% 0 775ms 8,344 525 0
Nemotron 3.5 Lightning 4.0 7.8 11.1% 1 224.42s 7,522 72,614 262,558

Quick Compare

Switch Comparison Pair

Ring-2.6-1TnonevsNemotron 3.5 LightninglowFree AvailableNemotron 3.5 LightninglowFree AvailablevsHy4 previewnoneNemotron 3.5 LightninglowFree AvailablevsGPT-5.4 NanononeTrinity Large ThinkinghighvsNemotron 3.5 LightninglowFree AvailableLing-2.6-flashnonevsNemotron 3.5 LightninglowFree AvailableKAT-Coder-Air V2.5nonevsNemotron 3.5 LightninglowFree AvailableNemotron 3.5 LightninglowFree AvailablevsGLM 4.7 FlashnoneTrinity Large PreviewnonevsNemotron 3.5 LightninglowFree AvailableMercury 2.5 PreviewnonevsNemotron 3.5 LightninglowFree AvailableNemotron 3.5 LightninglowFree AvailablevsGPT-4o-mininoneCobuddymediumvsNemotron 3.5 LightninglowFree AvailableGranite 4.1 8BnonevsLing 3.0 Tinyhigh