Google: Gemma 4 31B vs Poolside: Laguna XS 2.1

Laguna XS 2.1 (medium) leads on average score with 6.5 vs 6.3. Laguna XS 2.1 (medium) has the lower benchmark cost at $0.068 vs $0.116. Laguna XS 2.1 (medium) is faster at 47.93s vs 75.38s, with pass rates of 68.2% vs 42.4%.

Recommended modelLaguna XS 2.1 (medium)It has the best score here (6.5), while costing about 1.7x less than Gemma 4 31B (medium).

Last updated at: 2026-07-25

Metric	Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available	Laguna XS 2.1 Laguna XS 2.1 medium Release: 2026-07-02 Free Available

Metric	Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available	Laguna XS 2.1 Laguna XS 2.1 medium Release: 2026-07-02 Free Available
Score	6.3	6.5
Rank	#121	#112
Reliability	10.0	10.0
Consistency	9.0	9.6
Tests Correct
Attempt pass rate	68.2%	42.4%
Flaky tests	2	1
Total Runs	66	66
Cost per result	1.044	0.746
Total Cost	$0.116	$0.068
Input Price	$0.140 / 1M	$0.060 / 1M
Output Price	$0.400 / 1M	$0.120 / 1M
Total Input Tokens	94,992	118,989
Output Tokens	34,468	30,750
Reasoning Tokens	223,278	491,833
Response Time (avg)	75.38s	47.93s
Response Time (max)	437.40s	422.72s
Response Time (total)	1507.52s	1054.49s

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#121 Gemma 4 31B

medium

Cost: $0.002
Time: 45.7s
Tokens: 2,696 tok

#112 Laguna XS 2.1

medium

Cost: $0.001
Time: 30.6s
Tokens: 4,678 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		12.89s	816	962	2,046
Laguna XS 2.1	4.8	10.0	25.0%	0		41.96s	774	353	73,090

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	4.3	5.8	22.2%	1		219.76s	5,568	11,098	33,212
Laguna XS 2.1	5.5	10.0	33.3%	0		70.35s	7,995	23,767	83,258

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	2.9	5.8	16.7%	1		433.11s	77,035	12,112	157,552
Laguna XS 2.1	6.3	10.0	50.0%	0		218.07s	91,698	5,496	229,064

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		21.11s	8,334	1,822	2,951
Laguna XS 2.1	10.0	10.0	100.0%	0		4.50s	7,734	234	3,129

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	7.7	10.0	66.7%	0		38.48s	876	4,349	8,985
Laguna XS 2.1	2.9	7.2	11.1%	1		65.66s	834	17	91,533

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		9.57s	567	105	888
Laguna XS 2.1	5.0	10.0	0.0%	0		4.15s	537	119	1,375

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	10.0	10.0	100.0%	0		12.76s	777	533	2,035
Laguna XS 2.1	9.8	10.0	100.0%	0		2.57s	753	82	1,844

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	9.9	10.0	100.0%	0		26.91s	801	1,795	5,595
Laguna XS 2.1	5.3	10.0	33.3%	0		3.43s	771	357	3,355

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	3.0	10.0	0.0%	0		0ms	0	0	0
Laguna XS 2.1	10.0	10.0	100.0%	0		3.01s	7,638	309	748

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Gemma 4 31B	3.0	10.0	0.0%	0		90.14s	218	1,692	10,014
Laguna XS 2.1	3.0	10.0	0.0%	0		10.88s	255	16	4,437

Quick Compare

Switch Comparison Pair

Laguna XS 2.1mediumFree AvailablevsQwen3.5-27Bnone Gemini 3.1 Flash Lite PreviewlowvsLaguna XS 2.1mediumFree Available Gemma 4 31BmediumFree AvailablevsLongCat 2.0none Gemini 3.1 Flash LitelowvsLaguna XS 2.1mediumFree Available Claude Sonnet 5nonevsGemma 4 31BmediumFree Available Gemini 3.1 Flash Lite PreviewnonevsLaguna XS 2.1mediumFree Available Laguna XS 2.1mediumFree AvailablevsQwen3.5 Plus 2026-02-15none Laguna XS 2.1mediumFree AvailablevsQwen3.6 Max Previewnone Gemma 4 31BmediumFree AvailablevsLing 3.0 FlashhighFree Available Seed-2.0-LitenonevsGemma 4 31BmediumFree Available Gemma 4 31BmediumFree AvailablevsGPT-5.6 Lunalow LongCat 2.0highvsLaguna XS 2.1mediumFree Available