Gemini 3.1 Flash Lite (medium) vs Gemma 4 31B (medium)

Compared models

Recommended model Gemini 3.1 Flash Lite (medium)

It has the best score here (6.9), while responding about 12.6x faster than Gemma 4 31B (medium).

Metric	Gemini 3.1 Flash Lite Gemini 3.1 Flash Lite medium Release: 2026-05-08	Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available

Metric	Gemini 3.1 Flash Lite Gemini 3.1 Flash Lite medium Release: 2026-05-08	Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available
Score	6.9	6.9
Rank	#163	#165
Reliability	10.0	10.0
Consistency	9.2	8.7
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	59.4%	66.7%
Flaky tests	2	3
Total Runs	69	69
Cost per result	1.177	1.195
Total Cost	$0.153	$0.117
Input Price	$0.250 / 1M	$0.090 / 1M
Output Price	$1.500 / 1M	$0.340 / 1M
Total Input Tokens	228,023	251,164
Output Tokens	10,779	36,112
Reasoning Tokens	53,188	241,203
Response Time (avg)	6.27s	78.76s
Response Time (max)	47.78s	437.40s
Response Time (total)	144.10s	1653.96s
Parameters	~150B total (~10B active)	30.7B
Availability	Closed	Open source

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

medium

medium

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.1 Flash Lite	5.0	10.0	0.0%	0		47.78s	123,098	1,611	0
Gemma 4 31B	10.0	10.0	100.0%	0		82.13s	156,195	1,713	8,181

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.1 Flash Lite	9.1	10.0	75.0%	0		2.39s	502	604	4,201
Gemma 4 31B	10.0	10.0	100.0%	0		12.89s	816	962	2,046

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.1 Flash Lite	5.5	10.0	33.3%	0		3.81s	8,134	459	8,978
Gemma 4 31B	4.3	5.8	22.2%	1		219.76s	5,568	11,098	33,212

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.1 Flash Lite	7.2	9.1	50.0%	0		18.55s	80,983	7,241	20,231
Gemma 4 31B	2.9	5.8	16.7%	1		433.11s	77,035	12,112	157,552

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.1 Flash Lite	10.0	10.0	100.0%	0		2.60s	7,362	279	2,845
Gemma 4 31B	10.0	10.0	100.0%	0		21.11s	8,334	1,822	2,951

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.1 Flash Lite	2.9	7.2	11.1%	1		3.93s	650	15	7,223
Gemma 4 31B	5.3	7.2	44.4%	1		59.92s	853	4,280	18,729

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.1 Flash Lite	10.0	10.0	100.0%	0		2.60s	488	84	1,142
Gemma 4 31B	10.0	10.0	100.0%	0		9.57s	567	105	888

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.1 Flash Lite	9.9	10.0	100.0%	0		2.59s	623	75	3,320
Gemma 4 31B	10.0	10.0	100.0%	0		12.76s	777	533	2,035

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.1 Flash Lite	7.6	7.2	77.8%	1		1.95s	568	165	2,450
Gemma 4 31B	9.9	10.0	100.0%	0		26.91s	801	1,795	5,595

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.1 Flash Lite	10.0	10.0	100.0%	0		4.55s	5,457	234	921
Gemma 4 31B	3.0	10.0	0.0%	0		0ms	0	0	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemini 3.1 Flash Lite	3.0	10.0	0.0%	0		3.08s	158	12	1,877
Gemma 4 31B	3.0	10.0	0.0%	0		90.14s	218	1,692	10,014

Switch Comparison Pair