Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Google: Gemma 4 26B A4B vs Poolside: Laguna XS 2.1

Summary

Gemma 4 26B A4B vs Laguna XS 2.1 benchmark comparison: Gemma 4 26B A4B leads on average score with 7.2 vs 7.0. Laguna XS 2.1 has the lower benchmark cost at $0.036 vs $0.045. Laguna XS 2.1 is faster at 30.08s vs 63.41s, with pass rates of 69.8% vs 44.4%.

Recommended model: Laguna XS 2.1 - Its score stays close to the best score here (7.0 vs 7.2), while responding about 2.1x faster than Gemma 4 26B A4B.

Last updated at: 2026-07-02

Metric Gemma 4 26B A4B Gemma 4 26B A4B medium Release: 2026-04-03 Free Available Laguna XS 2.1 Laguna XS 2.1 medium Release: 2026-07-02 Free Available
Score 7.2 7.0
Rank #61 #67
Reliability 10.0 10.0
Consistency 9.2 9.6
Tests Correct
Attempt pass rate 69.8% 44.4%
Flaky tests 2 1
Total Runs 63 63
Cost per result 0.361 0.392
Total Cost $0.045 $0.036
Input Price $0.060 / 1M $0.060 / 1M
Output Price $0.330 / 1M $0.120 / 1M
Total Input Tokens 40,252 45,324
Output Tokens 28,000 25,761
Reasoning Tokens 100,490 268,677
Response Time (avg) 63.41s 30.08s
Response Time (max) 369.32s 155.23s
Response Time (total) 1268.28s 631.77s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#61 Gemma 4 26B A4B

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

#67 Laguna XS 2.1

medium
Cost
$0.001
Time
30.6s
Tokens
4,678 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 6.20s 816 1,142 3,045
Laguna XS 2.1 4.8 10.0 25.0% 0 41.96s 774 353 73,090
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.9 10.0 0.0% 0 272.54s 5,062 14,838 44,567
Laguna XS 2.1 5.5 10.0 33.3% 0 70.35s 7,995 23,767 83,258
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 9.6 10.0 100.0% 0 73.55s 17,092 5,415 13,112
Laguna XS 2.1 9.6 10.0 100.0% 0 13.43s 18,033 507 5,908
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 16.51s 8,334 1,567 2,827
Laguna XS 2.1 10.0 10.0 100.0% 0 4.50s 7,734 234 3,129
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.9 4.4 22.2% 2 23.62s 516 2,469 7,105
Laguna XS 2.1 2.9 7.2 11.1% 1 65.66s 834 17 91,533
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 29.76s 567 25 5,075
Laguna XS 2.1 5.0 10.0 0.0% 0 4.15s 537 119 1,375
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 17.54s 777 887 4,470
Laguna XS 2.1 9.8 10.0 100.0% 0 2.57s 753 82 1,844
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 5.79s 801 410 2,128
Laguna XS 2.1 5.3 10.0 33.3% 0 3.43s 771 357 3,355
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 9.01s 6,096 450 1,256
Laguna XS 2.1 10.0 10.0 100.0% 0 3.01s 7,638 309 748
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.0 10.0 0.0% 0 180.87s 191 797 16,905
Laguna XS 2.1 3.0 10.0 0.0% 0 10.88s 255 16 4,437

Quick Compare

Switch Comparison Pair

Gemma 4 26B A4BmediumFree AvailablevsQwen3.7 PlusnoneDeepSeek V4 PrononevsGemma 4 26B A4BmediumFree AvailableGemma 4 26B A4BmediumFree AvailablevsGLM 5.2noneLaguna XS 2.1mediumFree AvailablevsStep 3.7 FlashhighClaude Opus 4.8nonevsGemma 4 26B A4BmediumFree AvailableGemini 3.5 FlashnonevsLaguna XS 2.1mediumFree AvailableGemma 4 26B A4BmediumFree AvailablevsStep 3.7 FlashhighLaguna XS 2.1mediumFree AvailablevsGLM 5.2noneLaguna XS 2.1mediumFree AvailablevsQwen3.7 PlusnoneDeepSeek V4 PrononevsLaguna XS 2.1mediumFree AvailableClaude Sonnet 4.6nonevsGemma 4 26B A4BmediumFree AvailableGemini 3 Flash PreviewnonevsLaguna XS 2.1mediumFree Available