Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Google: Gemma 4 26B A4B vs Grok 4.20 Multi Agent Beta

Last updated at: 2026-04-04

Metric Gemma 4 26B A4B Gemma 4 26B A4B none Release: 2026-04-03 Grok 4.20 Multi Agent Beta Grok 4.20 Multi Agent Beta medium Release: 2026-03-12
Score 6.3 6.2
Rank #53 #55
Consistency 9.1 7.2
Tests Correct
Attempt pass rate 47.1% 54.9%
Flaky tests 2 6
Total Runs 51 51
Cost per result 0.068 82.962
Total Cost $0.005 $4.978
Input Price $0.130 / 1M $0.000 / 1M
Output Price $0.400 / 1M $0.000 / 1M
Output Tokens 1,335 298,948
Reasoning Tokens 0 296,529
Response Time (avg) 6.56s 8.64s
Response Time (max) 57.10s 35.28s
Response Time (total) 111.54s 129.64s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 8.3 10.0 75.0% 0 1.28s 230 0
Grok 4.20 Multi Agent Beta 6.9 5.8 75.0% 2 3.46s 33,706 33,077
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.0 10.0 0.0% 0 30.53s 309 0
Grok 4.20 Multi Agent Beta 3.0 10.0 0.0% 0 0ms 0 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 1.70s 285 0
Grok 4.20 Multi Agent Beta 10.0 10.0 100.0% 0 5.54s 25,306 25,051
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.6 7.2 22.2% 1 2.49s 27 0
Grok 4.20 Multi Agent Beta 2.9 7.2 11.1% 1 24.67s 164,609 163,647
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 4.0 10.0 0.0% 0 3.54s 85 0
Grok 4.20 Multi Agent Beta 5.8 2.8 66.7% 1 6.40s 15,848 15,746
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 4.4 6.9 16.7% 1 1.08s 75 0
Grok 4.20 Multi Agent Beta 8.3 10.0 50.0% 0 4.63s 25,457 25,322
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 5.7 10.0 33.3% 0 739ms 114 0
Grok 4.20 Multi Agent Beta 7.2 5.1 77.8% 2 5.01s 34,022 33,686
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 57.10s 210 0
Grok 4.20 Multi Agent Beta 3.0 10.0 0.0% 0 0ms 0 0

Quick Compare

Switch Comparison Pair

Gemma 4 26B A4BnonevsGPT-5 NanomediumGemma 4 26B A4BnonevsMercury 2mediumDeepSeek V3.2nonevsGrok 4.20 Multi Agent BetamediumQwen3.5-FlashnonevsGrok 4.20 Multi Agent BetamediumGrok 4.20 Multi Agent BetamediumvsMiMo-V2-OmninoneGrok 4.20 Multi Agent BetamediumvsGLM 5V TurbononeSeed-2.0-LitenonevsGrok 4.20 Multi Agent BetamediumGemma 4 26B A4Bnonevsgpt-oss-120bmediumFree AvailableGemini 2.5 FlashnonevsGrok 4.20 Multi Agent BetamediumQwen3.5-35B-A3BnonevsGrok 4.20 Multi Agent BetamediumHunter AlphanonevsGrok 4.20 Multi Agent BetamediumGemma 4 26B A4BnonevsMiniMax M2.5mediumFree Available