#14

Gemma 4 31B

Google Release: 2026-04-02 Tested on: 2026-05-08 14:19 google/gemma-4-31b-it::medium

(medium) (none)

8.2

Consistency

9.6

6.7

$0.023

Total Output Tokens

52,390

Input Price

$0.130 / 1M

Output Price

$0.380 / 1M

Wrong Tests: 5

Attempt pass rate: 77.2%

Flaky tests

1

Flaky tests had mixed outcomes across runs (at least one pass and one fail).

Response Time (avg)

28.72s

Response Time (max): 90.14s

Response Time (total): 488.27s

API error: 2 Wrong answer: 2 Timed out: 1

Charts

Choose the first model, then click a second model to open a side-by-side page.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Quick Compare

Gemma 4 31BmediumFree AvailablevsSeed-2.0-Litemedium Gemma 4 31BmediumFree AvailablevsGPT-5.3-Codexmedium Gemma 4 31BmediumFree AvailablevsGemini 3 PRO Previewmedium Gemma 4 31BmediumFree AvailablevsQwen3.6 Max Previewmedium Gemma 4 31BmediumFree AvailablevsGemini 3 Flash Previewmedium Gemma 4 31BmediumFree AvailablevsGemini 3.1 Pro Previewmedium Gemma 4 31BmediumFree AvailablevsRing 2.6 1tmediumFree Available

Category Breakdown

Category	Score	Consistency	Tests Correct
Anti-AI Tricks	10.0	10.0
Coding	4.7	1.6
Combined	3.0	10.0
Data parsing and extraction	10.0	10.0
Domain specific	7.7	10.0
General Intelligence	10.0	10.0
Instructions following	10.0	10.0
Puzzle Solving	9.9	10.0
Tool Calling	3.0	10.0
Trivia	3.0	10.0

Compared models