Granite 4.2 8B vs Mercury 2

Compared models

Rank: #375
Total Output Tokens: 133,268
Response Time (avg): 84.66s
Total Cost: $0.037

Rank: #377
Total Output Tokens: 9,709
Response Time (avg): 1.18s
Total Cost: $0.033

Recommended model Mercury 2

Its score stays close to the best score here (4.4 vs 4.4), while responding about 71.8x faster than Granite 4.2 8B.

Detailed comparison

Metric	Granite 4.2 8B Granite 4.2 8B none Release: 2026-09-02	Mercury 2 Mercury 2 none Release: 2026-02-24

Metric	Granite 4.2 8B Granite 4.2 8B none Release: 2026-09-02	Mercury 2 Mercury 2 none Release: 2026-02-24
Score	4.4	4.4
Rank	#375	#377
Reliability	9.1	10.0
Consistency	9.3	9.2
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	15.9%	23.2%
Flaky tests	2	2
Total Runs	69	69
Cost per result	1.206	0.812
Total Cost	$0.037	$0.033
Input Price	$0.060 / 1M	$0.250 / 1M
Output Price	$0.250 / 1M	$0.750 / 1M
Cache Read Price	$0.015 / 1M	$0.025 / 1M
Cache Write Price	N/A	N/A
Total Input Tokens	226,872	100,634
Output Tokens	133,268	9,609
Reasoning Tokens	0	100
Response Time (avg)	84.66s	1.18s
Response Time (max)	747.17s	9.00s
Response Time (total)	1947.17s	27.14s
Parameters	8B	~100B
Availability	Open source	Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#375 IBM: Granite 4.2 8B

none

Provider returned error

Cost: $0.000
Time: 0.2s
Tokens: 0 tok

#377 Mercury 2

none

Cost: $0.002
Time: 1.8s
Tokens: 1,514 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	5.0	10.0	0.0%	0		49.21s	169,086	2,463	0
Mercury 2	3.0	10.0	0.0%	0		9.00s	10,997	80	45

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	4.9	8.1	33.3%	1		17.77s	669	6,026	0
Mercury 2	3.0	10.0	0.0%	0		483ms	631	286	0

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	5.5	10.0	33.3%	0		105.60s	8,358	47,944	0
Mercury 2	3.4	9.6	0.0%	0		1.03s	7,229	3,088	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	3.0	10.0	0.0%	0		424.28s	30,500	29,755	0
Mercury 2	3.0	10.0	0.0%	0		2.56s	65,412	5,215	41

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	2.9	5.8	16.7%	1		1.05s	7,629	237	0
Mercury 2	7.3	5.9	83.3%	1		667ms	6,362	180	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	3.0	10.0	0.0%	0		53.62s	696	38,145	0
Mercury 2	5.9	7.2	55.6%	1		500ms	1,717	52	14

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	5.0	10.0	0.0%	0		770ms	534	153	0
Mercury 2	4.8	10.0	0.0%	0		628ms	495	159	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	3.0	10.0	0.0%	0		79.50s	375	1,275	0
Mercury 2	6.5	10.0	50.0%	0		551ms	691	82	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	3.0	10.0	0.0%	0		107.60s	472	6,964	0
Mercury 2	3.1	10.0	0.0%	0		535ms	694	251	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	10.0	10.0	100.0%	0		1.39s	8,331	291	0
Mercury 2	10.0	10.0	100.0%	0		1.27s	6,193	197	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	3.0	10.0	0.0%	0		14.60s	222	15	0
Mercury 2	3.0	10.0	0.0%	0		548ms	213	19	0

Switch Comparison Pair

CobuddymediumFree AvailablevsMercury 2none Trinity Large PreviewdefaultFree AvailablevsGranite 4.2 8Bnone Granite 4.2 8BnonevsKAT Coder AIR V2.5default CobuddymediumFree AvailablevsGranite 4.2 8Bnone Mercury 2nonevsMiniMax M2.5medium Trinity Large PreviewdefaultFree AvailablevsMercury 2none Mercury 2nonevsKAT Coder AIR V2.5default Granite 4.2 8BnonevsRing 2.6 1tdefault Granite 4.2 8BnonevsLing 2.6 Flashdefault Granite 4.2 8BnonevsMiniMax M2.5medium Mercury 2nonevsRing 2.6 1tdefault Mercury 2nonevsGLM 4.7 Flashmedium