Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Granite 4.2 8B — low vs medium

The average score is effectively tied at 5.1 vs 5.2. medium has the lower benchmark cost at $0.009 vs $0.012. medium is faster at 45.97s vs 54.36s, with pass rates of 31.8% vs 34.9%.

Last updated at: 2026-09-02

Rank
#247
Total Output Tokens
27,928
Response Time (avg)
54.36s
Total Cost
$0.012
Rank
#243
Total Output Tokens
19,330
Response Time (avg)
45.97s
Total Cost
$0.009
Recommended model medium

It has the strongest score in this comparison (5.2) and the best overall balance of cost and response time across all 2 models.

Detailed comparison

Metric Granite 4.2 8B Granite 4.2 8B low Release: 2026-09-02 Granite 4.2 8B Granite 4.2 8B medium Release: 2026-09-02
Score 5.1 5.2
Rank #247 #243
Reliability 9.0 8.7
Consistency 10.0 9.6
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 31.8% 34.9%
Flaky tests 0 1
Total Runs 66 66
Cost per result 0.167 0.117
Total Cost $0.012 $0.009
Input Price $0.100 / 1M $0.100 / 1M
Output Price $0.150 / 1M $0.150 / 1M
Total Input Tokens 74,721 52,909
Output Tokens 9,205 7,058
Reasoning Tokens 18,723 12,272
Response Time (avg) 54.36s 45.97s
Response Time (max) 566.80s 557.96s
Response Time (total) 1195.97s 1011.42s
Parameters 8B 8B
Availability Open source Open source

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#247 IBM: Granite 4.2 8B

low
Provider returned error
Cost
$0.000
Time
0.2s
Tokens
0 tok

#243 IBM: Granite 4.2 8B

medium
Provider returned error
Cost
$0.000
Time
0.2s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.2 8B 5.5 10.0 33.3% 0 13.01s 8,439 2,469 2,984
Granite 4.2 8B 5.5 10.0 33.3% 0 12.09s 8,439 2,445 3,900

Quick Compare

Switch Comparison Pair