Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Google: Gemma 4 26B A4B vs OpenAI: GPT-5.5

Last updated at: 2026-05-19

Metric Gemma 4 26B A4B Gemma 4 26B A4B medium Release: 2026-04-03 Free Available GPT-5.5 GPT-5.5 none Release: 2026-04-24
Score 7.7 6.7
Rank #43 #79
Reliability 10.0 10.0
Consistency 8.7 8.7
Tests Correct
Attempt pass rate 73.7% 59.7%
Flaky tests 3 3
Total Runs 57 57
Cost per result 0.260 1.961
Total Cost $0.034 $0.197
Input Price $0.060 / 1M $5.000 / 1M
Output Price $0.330 / 1M $30.000 / 1M
Output Tokens 16,725 1,928
Reasoning Tokens 61,536 0
Response Time (avg) 33.69s 1.99s
Response Time (max) 180.87s 5.56s
Response Time (total) 606.35s 37.87s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 6.20s 1,142 3,045
GPT-5.5 6.9 7.9 66.7% 1 1.31s 213 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.8 10.0 0.0% 0 147.47s 3,516 4,676
GPT-5.5 10.0 10.0 100.0% 0 2.05s 426 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 9.6 10.0 100.0% 0 73.55s 5,415 13,112
GPT-5.5 3.0 10.0 0.0% 0 5.56s 300 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 16.51s 1,567 2,827
GPT-5.5 10.0 10.0 100.0% 0 1.18s 222 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.9 4.4 22.2% 2 23.62s 2,469 7,105
GPT-5.5 2.9 7.2 11.1% 1 1.31s 52 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 29.76s 25 5,075
GPT-5.5 10.0 10.0 100.0% 0 3.41s 124 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 17.54s 887 4,470
GPT-5.5 6.2 5.8 66.7% 1 1.15s 81 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 7.7 7.3 77.8% 1 8.52s 457 3,065
GPT-5.5 7.7 10.0 66.7% 0 1.36s 245 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 9.01s 450 1,256
GPT-5.5 10.0 10.0 100.0% 0 3.90s 247 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.0 10.0 0.0% 0 180.87s 797 16,905
GPT-5.5 3.0 10.0 0.0% 0 5.01s 18 0

Quick Compare

Switch Comparison Pair

GPT-5.5nonevsQwen3.6 27BmediumGemma 4 26B A4BmediumFree AvailablevsGPT-5.2 ChatnoneKimi K2.5mediumvsGPT-5.5noneGemini 3.1 Flash LiteminimalvsGPT-5.5noneGemma 4 26B A4BmediumFree AvailablevsGPT-5.3 ChatnoneGPT-5.5nonevsGrok 4.20mediumDeepSeek V4 ProhighvsGPT-5.5noneDeepSeek V4 FlashhighFree AvailablevsGemma 4 26B A4BmediumFree AvailableGPT-5.5nonevsGrok 4.1 FastmediumMercury 2mediumvsGPT-5.5noneGPT-5.5nonevsMiMo-V2-OmnimediumGemma 4 26B A4BmediumFree AvailablevsQwen3.6 Max Previewnone