Gemma 4 26B A4B vs Granite 4.2 8B (low)

Compared models

Recommended model Gemma 4 26B A4B

It has the best score here (5.5), while responding about 5.5x faster than Granite 4.2 8B (low).

Metric	Gemma 4 26B A4B Gemma 4 26B A4B none Release: 2026-04-03 Free Available	Granite 4.2 8B Granite 4.2 8B low Release: 2026-09-02

Metric	Gemma 4 26B A4B Gemma 4 26B A4B none Release: 2026-04-03 Free Available	Granite 4.2 8B Granite 4.2 8B low Release: 2026-09-02
Score	5.5	5.3
Rank	#271	#283
Reliability	10.0	9.2
Consistency	9.6	9.7
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	42.0%	33.3%
Flaky tests	1	1
Total Runs	69	69
Cost per result	0.339	0.508
Total Cost	$0.031	$0.036
Input Price	$0.090 / 1M	$0.060 / 1M
Output Price	$0.300 / 1M	$0.250 / 1M
Cache Read Price	$0.050 / 1M	$0.015 / 1M
Cache Write Price	N/A	N/A
Total Input Tokens	280,126	332,917
Output Tokens	17,306	18,989
Reasoning Tokens	0	42,362
Response Time (avg)	10.55s	58.20s
Response Time (max)	75.76s	566.80s
Response Time (total)	242.57s	1338.65s
Parameters	25.2B total (3.8B active)	8B
Availability	Open source	Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

none

low

Provider returned error

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	5.0	10.0	0.0%	0		75.76s	148,869	1,525	0
Granite 4.2 8B	6.1	3.1	66.7%	1		142.68s	258,196	9,784	23,639

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	8.3	10.0	75.0%	0		1.28s	852	230	0
Granite 4.2 8B	8.3	10.0	75.0%	0		11.68s	777	1,463	898

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	3.7	7.2	22.2%	1		4.16s	7,736	476	0
Granite 4.2 8B	5.5	10.0	33.3%	0		13.01s	8,439	2,469	2,984

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	3.0	10.0	0.0%	0		37.23s	104,894	14,266	0
Granite 4.2 8B	3.0	10.0	0.0%	0		298.21s	46,805	4,085	13,637

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	10.0	10.0	100.0%	0		1.70s	8,352	285	0
Granite 4.2 8B	6.5	10.0	50.0%	0		1.39s	7,683	270	75

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	5.3	10.0	33.3%	0		2.10s	878	27	0
Granite 4.2 8B	5.3	10.0	33.3%	0		26.16s	876	154	290

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	4.0	10.0	0.0%	0		3.54s	576	85	0
Granite 4.2 8B	4.0	10.0	0.0%	0		659ms	561	108	24

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	6.3	10.0	50.0%	0		690ms	795	75	0
Granite 4.2 8B	3.0	10.0	0.0%	0		75.80s	402	84	378

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	6.2	10.0	33.3%	0		744ms	828	114	0
Granite 4.2 8B	3.0	10.0	0.0%	0		90.84s	517	181	82

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	10.0	10.0	100.0%	0		57.10s	6,123	210	0
Granite 4.2 8B	10.0	10.0	100.0%	0		2.23s	8,412	358	265

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 26B A4B	3.0	10.0	0.0%	0		778ms	223	13	0
Granite 4.2 8B	3.0	10.0	0.0%	0		5.53s	249	33	90

Switch Comparison Pair