Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Google: Gemma 4 26B A4B vs Google: Gemma 4 31B

Last updated at: 2026-04-16

Metric Gemma 4 26B A4B Gemma 4 26B A4B medium Release: 2026-04-03 Free Available Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available
Score 8.0 8.3
Rank #24 #14
Consistency 9.0 9.2
Tests Correct
Attempt pass rate 75.9% 79.6%
Flaky tests 2 2
Total Runs 54 54
Cost per result 0.214 0.136
Total Cost $0.028 $0.018
Input Price $0.070 / 1M $0.130 / 1M
Output Price $0.400 / 1M $0.380 / 1M
Output Tokens 15,928 12,734
Reasoning Tokens 44,631 27,950
Response Time (avg) 25.03s 24.88s
Response Time (max) 147.47s 70.97s
Response Time (total) 425.48s 398.13s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 6.20s 1,142 3,045
Gemma 4 31B 10.0 10.0 100.0% 0 12.89s 962 2,046
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.8 10.0 0.0% 0 147.47s 3,516 4,676
Gemma 4 31B 4.7 1.6 66.7% 1 70.97s 3,166 5,449
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 9.6 10.0 100.0% 0 73.55s 5,415 13,112
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 16.51s 1,567 2,827
Gemma 4 31B 10.0 10.0 100.0% 0 21.11s 1,822 2,951
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.9 4.4 22.2% 2 23.62s 2,469 7,105
Gemma 4 31B 7.7 10.0 66.7% 0 38.48s 4,349 8,985
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 29.76s 25 5,075
Gemma 4 31B 10.0 10.0 100.0% 0 9.57s 105 888
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 17.54s 887 4,470
Gemma 4 31B 10.0 10.0 100.0% 0 12.76s 533 2,035
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 7.9 9.6 66.7% 0 8.52s 457 3,065
Gemma 4 31B 8.8 7.9 88.9% 1 27.63s 1,797 5,596
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 9.01s 450 1,256
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0

Quick Compare

Switch Comparison Pair

Gemma 4 26B A4BmediumFree AvailablevsGPT-5.2 ChatnoneGemma 4 26B A4BmediumFree AvailablevsGPT-5.3 ChatnoneGemma 4 31BmediumFree AvailablevsGPT-5.2 ChatnoneClaude Sonnet 4.6nonevsGemma 4 26B A4BmediumFree AvailableGemma 4 31BmediumFree AvailablevsGPT-5.3 ChatnoneClaude Opus 4.7nonevsGemma 4 31BmediumFree AvailableClaude Sonnet 4.6nonevsGemma 4 31BmediumFree AvailableClaude Opus 4.7nonevsGemma 4 26B A4BmediumFree AvailableGemma 4 26B A4BmediumFree AvailablevsQwen3.5 Plus 2026-02-15noneGemma 4 26B A4BmediumFree AvailablevsGLM 5noneGemma 4 31BmediumFree AvailablevsQwen3.5 Plus 2026-02-15noneGemma 4 26B A4BmediumFree AvailablevsMiMo-V2-Omninone