Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Granite 4.2 8B (medium) vs Laguna XS 2.1

Laguna XS 2.1 leads on average score with 5.3 vs 5.2. Laguna XS 2.1 has the lower benchmark cost at $0.008 vs $0.009. Laguna XS 2.1 is faster at 1.55s vs 45.97s, with pass rates of 34.9% vs 30.3%.

Last updated at: 2026-09-04

Rank
#254
Total Output Tokens
19,330
Response Time (avg)
45.97s
Total Cost
$0.009
Rank
#247
Total Output Tokens
13,377
Response Time (avg)
1.55s
Total Cost
$0.008
Recommended model Laguna XS 2.1

It has the best score here (5.3), while responding about 29.7x faster than Granite 4.2 8B (medium).

Detailed comparison

Metric Granite 4.2 8B Granite 4.2 8B medium Release: 2026-09-02 Laguna XS 2.1 Laguna XS 2.1 none Release: 2026-07-02 Free Available
Score 5.2 5.3
Rank #254 #247
Reliability 8.7 10.0
Consistency 9.6 9.0
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 34.9% 30.3%
Flaky tests 1 3
Total Runs 66 66
Cost per result 0.117 0.143
Total Cost $0.009 $0.008
Input Price $0.100 / 1M $0.060 / 1M
Output Price $0.150 / 1M $0.120 / 1M
Total Input Tokens 52,909 91,607
Output Tokens 7,058 13,377
Reasoning Tokens 12,272 0
Response Time (avg) 45.97s 1.55s
Response Time (max) 557.96s 19.02s
Response Time (total) 1011.42s 34.01s
Parameters 8B 33B total (3B active)
Availability Open source Weights available

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#254 IBM: Granite 4.2 8B

medium
Provider returned error
Cost
$0.000
Time
0.2s
Tokens
0 tok

#247 Laguna XS 2.1

none
Cost
$0.001
Time
27.6s
Tokens
4,344 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.2 8B 5.5 10.0 33.3% 0 12.09s 8,439 2,445 3,900
Laguna XS 2.1 4.3 7.8 22.2% 1 623ms 7,995 562 0

Quick Compare

Switch Comparison Pair