Navigate
Advertise here

Granite 4.1 8b (default) vs Mercury 2.5

Mercury 2.5 leads on average score with 4.1 vs 3.8. Granite 4.1 8b (default) has the lower benchmark cost at $0.007 vs $0.026. Granite 4.1 8b (default) is faster at 1.38s vs 5.10s, with pass rates of 8.7% vs 24.6%.

Last updated at: 2026-10-19

Compared models

Rank
#405
Total Output Tokens
5,996
Response Time (avg)
1.38s
Total Cost
$0.007
Rank
#397
Total Output Tokens
89,958
Response Time (avg)
5.10s
Total Cost
$0.026
Recommended model Granite 4.1 8b (default)

Its score stays close to the best score here (3.8 vs 4.1), while costing about 4.1x less than Mercury 2.5.

Detailed comparison

Metric Granite 4.1 8b Granite 4.1 8b default Release: 2026-05-01 Mercury 2.5 Mercury 2.5 none Release: 2026-09-08
Score 3.8 4.1
Rank #405 #397
Reliability 10.0 10.0
Consistency 10.0 7.6
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 8.7% 24.6%
Flaky tests 0 7
Total Runs 69 69
Cost per result 0.315 1.298
Total Cost $0.007 $0.026
Input Price $0.050 / 1M $0.040 / 1M
Output Price $0.100 / 1M $0.150 / 1M
Cache Read Price N/A $0.004 / 1M
Cache Write Price N/A N/A
Total Input Tokens 113,836 311,488
Output Tokens 5,996 89,958
Reasoning Tokens 0 0
Response Time (avg) 1.38s 5.10s
Response Time (max) 16.67s 63.41s
Response Time (total) 31.81s 117.24s
Parameters 8B ~100B
Availability Open source Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#405 Granite 4.1 8b

default
Cost
$0.001
Time
3.2s
Tokens
491 tok

#397 Mercury 2.5

none
Cost
$0.001
Time
2.7s
Tokens
2,749 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.1 8b 4.5 10.0 0.0% 0 775ms 8,344 525 0
Mercury 2.5 3.7 7.0 22.2% 1 12.50s 7,888 61,297 0

Quick Compare

Switch Comparison Pair

Granite 4.1 8bdefaultvsNemotron 3.5 LightningnoneFree AvailableMercury 2.5nonevsQwen3.5-9BmediumMercury 2.5nonevsGLM 4.7 FlashmediumGranite 4.1 8bdefaultvsXing4.0 29b A4bmediumFree AvailableGranite 4.1 8bdefaultvsLing 3.0 TinyhighGranite 4.1 8bdefaultvsLing 3.0 TinylowMercury 2.5nonevsMiniMax M2.5mediumGranite 4.1 8bdefaultvsLing 3.0 TinymediumGranite 4.1 8bdefaultvsQwen3.5-9BmediumCobuddymediumFree AvailablevsMercury 2.5noneMercury 2.5nonevsLing 3.0 TinydefaultTrinity Large PreviewdefaultFree AvailablevsMercury 2.5none