Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Granite 4.2 8B (high) vs Mercury 2.5 Preview (default)

The average score is effectively tied at 4.7 vs 4.7. Mercury 2.5 Preview (default) has the lower benchmark cost at $0.023 vs $0.111. Mercury 2.5 Preview (default) is faster at 7.05s vs 235.35s, with pass rates of 37.7% vs 29.0%.

Last updated at: 2026-11-16

Compared models

Rank
#423
Total Output Tokens
576,052
Response Time (avg)
235.35s
Total Cost
$0.111
Rank
#419
Total Output Tokens
86,367
Response Time (avg)
7.05s
Total Cost
$0.023
Recommended model Mercury 2.5 Preview (default)

It has the best score here (4.7), while costing about 4.8x less than Granite 4.2 8B (high).

Detailed comparison

Metric Granite 4.2 8B Granite 4.2 8B high Release: 2026-09-02 Mercury 2.5 Preview Mercury 2.5 Preview default Release: 2026-09-02
Score 4.7 4.7
Rank #423 #419
Reliability 8.2 9.9
Consistency 6.4 8.3
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 37.7% 29.0%
Flaky tests 10 5
Total Runs 69 69
Cost per result 2.751 0.559
Total Cost $0.111 $0.023
Input Price $0.060 / 1M $0.040 / 1M
Output Price $0.250 / 1M $0.150 / 1M
Cache Read Price $0.015 / 1M N/A
Cache Write Price N/A N/A
Total Input Tokens 282,658 250,541
Output Tokens 198,563 86,367
Reasoning Tokens 462,804 0
Response Time (avg) 235.35s 7.05s
Response Time (max) 685.87s 84.96s
Response Time (total) 5413.09s 162.25s
Parameters 8B ~100B
Availability Open source Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#423 IBM: Granite 4.2 8B

high
Provider returned error
Cost
$0.000
Time
0.2s
Tokens
0 tok

#419 Mercury 2.5 Preview

default
Invalid SVG
Cost
$0.001
Time
3.3s
Tokens
3,122 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.2 8B 3.8 4.3 33.3% 2 515.34s 7,047 42,438 154,749
Mercury 2.5 Preview 4.7 7.9 22.2% 1 459ms 7,850 650 0

Switch Comparison Pair