#13

Gemma 4 26B A4B

Google · Release: 2026-04-03 · google/gemma-4-26b-a4b-it::medium

8.3

Consistency

8.9

$0.025

Total Output Tokens

52,367

Input Price

$0.130 / 1M

Output Price

$0.400 / 1M

Wrong Tests: 4

Attempt pass rate: 80.4%

Flaky tests

2

Flaky tests had mixed outcomes across runs (at least one pass and one fail).

Response Time (avg)

17.38s

Response Time (max): 73.55s

Response Time (total): 278.01s

Wrong answer: 2 Did not follow instructions: 1 Timed out: 1

Charts

Choose the first model, then click a second model to open a side-by-side page.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Quick Compare

Gemma 4 26B A4BmediumvsQwen3.5 Plus 2026-02-15medium Gemma 4 26B A4BmediumvsQwen3.5-27Bmedium Gemma 4 26B A4BmediumvsQwen3.6 PlusmediumFree Available Gemma 4 26B A4BmediumvsGLM 5medium Gemma 4 26B A4BmediumvsGemini 3 Flash Previewmedium Gemma 4 26B A4BmediumvsGemini 3.1 Pro Previewmedium Gemma 4 26B A4BmediumvsQwen3.6 Plus Previewmedium

Category Breakdown

Category	Score	Consistency	Tests Correct
Anti-AI Tricks	10.0	10.0
Combined	9.6	10.0
Data parsing and extraction	10.0	10.0
Domain specific	2.9	4.4
General Intelligence	10.0	10.0
Instructions following	10.0	10.0
Puzzle Solving	7.9	9.6
Tool Calling	10.0	10.0

Compared models