#47

Gemma 4 31B

Google · Release: 2026-04-02 · google/gemma-4-31b-it::none

6.7

Consistency

10.0

$0.002

Total Output Tokens

660

Input Price

$0.140 / 1M

Output Price

$0.400 / 1M

Wrong Tests: 8

Attempt pass rate: 52.9%

Flaky tests

0

Flaky tests had mixed outcomes across runs (at least one pass and one fail).

Response Time (avg)

2.55s

Response Time (max): 4.68s

Response Time (total): 38.20s

Wrong answer: 5 API error: 2 Did not follow instructions: 1

Charts

Choose the first model, then click a second model to open a side-by-side page.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Quick Compare

Gemma 4 31BnonevsNemotron 3 SupermediumFree Available Gemma 4 31BnonevsQwen3.5 Plus 2026-02-15none Gemma 4 31BnonevsGrok 4.1 Fastmedium Gemma 4 31BnonevsHunter Alphamedium Gemma 4 31BnonevsGLM 5none Gemma 4 31BnonevsGemini 3 Flash Previewmedium Gemma 4 31BnonevsGemini 3.1 Pro Previewmedium Gemma 4 31BnonevsQwen3.6 PlusmediumFree Available

Category Breakdown

Category	Score	Consistency	Tests Correct
Anti-AI Tricks	6.5	10.0
Combined	3.0	10.0
Data parsing and extraction	10.0	10.0
Domain specific	7.7	10.0
General Intelligence	10.0	10.0
Instructions following	6.5	10.0
Puzzle Solving	5.5	10.0
Tool Calling	3.0	10.0

Compared models