#53

Gemma 4 26B A4B

Google · Release: 2026-04-03 · google/gemma-4-26b-a4b-it::none

6.3

Consistency

9.1

$0.005

Total Output Tokens

1,335

Input Price

$0.130 / 1M

Output Price

$0.400 / 1M

Wrong Tests: 10

Attempt pass rate: 47.1%

Flaky tests

2

Flaky tests had mixed outcomes across runs (at least one pass and one fail).

Response Time (avg)

6.56s

Response Time (max): 57.10s

Response Time (total): 111.54s

Wrong answer: 7 Did not follow instructions: 3

Charts

Choose the first model, then click a second model to open a side-by-side page.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Quick Compare

Gemma 4 26B A4BnonevsDeepSeek V3.2none Gemma 4 26B A4BnonevsMiMo-V2-Omninone Gemma 4 26B A4BnonevsGPT-5 Nanomedium Gemma 4 26B A4BnonevsGLM 5none Gemma 4 26B A4BnonevsGrok 4.20 Multi Agent Betamedium Gemma 4 26B A4BnonevsGemini 3 Flash Previewmedium Gemma 4 26B A4BnonevsGemini 3.1 Pro Previewmedium Gemma 4 26B A4BnonevsQwen3.6 Plus Previewmedium

Category Breakdown

Category	Score	Consistency	Tests Correct
Anti-AI Tricks	8.3	10.0
Combined	3.0	10.0
Data parsing and extraction	10.0	10.0
Domain specific	3.6	7.2
General Intelligence	4.0	10.0
Instructions following	4.4	6.9
Puzzle Solving	5.7	10.0
Tool Calling	10.0	10.0

Compared models