Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Google: Gemma 4 26B A4B vs OpenAI: GPT-5.5

Summary

Gemma 4 26B A4B vs GPT-5.5 benchmark comparison: GPT-5.5 leads on average score with 9.3 vs 5.5. Gemma 4 26B A4B has the lower benchmark cost at $0.004 vs $0.907. Gemma 4 26B A4B is faster at 5.91s vs 9.76s, with pass rates of 44.4% vs 85.7%.

Recommended model: GPT-5.5 - It has the strongest score in this comparison (9.3) and the best overall balance of cost and response time across all 2 models.

Last updated at: 2026-07-02

Metric Gemma 4 26B A4B Gemma 4 26B A4B none Release: 2026-04-03 Free Available GPT-5.5 GPT-5.5 low Release: 2026-04-24
Score 5.5 9.3
Rank #125 #4
Reliability 10.0 10.0
Consistency 9.2 10.0
Tests Correct
Attempt pass rate 44.4% 85.7%
Flaky tests 2 0
Total Runs 63 63
Cost per result 0.068 5.035
Total Cost $0.004 $0.907
Input Price $0.060 / 1M $5.000 / 1M
Output Price $0.330 / 1M $30.000 / 1M
Total Input Tokens 40,038 34,209
Output Tokens 1,824 2,046
Reasoning Tokens 0 22,460
Response Time (avg) 5.91s 9.76s
Response Time (max) 57.10s 56.19s
Response Time (total) 124.05s 204.92s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#125 Gemma 4 26B A4B

none
Cost
$0.001
Time
39.5s
Tokens
790 tok

#4 GPT-5.5

low
Cost
$0.068
Time
37.0s
Tokens
2,339 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 8.3 10.0 75.0% 0 1.28s 852 230 0
GPT-5.5 10.0 10.0 100.0% 0 4.41s 606 238 1,020
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.7 7.2 22.2% 1 4.16s 7,736 476 0
GPT-5.5 10.0 10.0 100.0% 0 15.04s 7,302 423 6,402
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.0 10.0 0.0% 0 30.53s 13,650 309 0
GPT-5.5 10.0 10.0 100.0% 0 9.56s 11,019 303 717
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 1.70s 8,352 285 0
GPT-5.5 10.0 10.0 100.0% 0 3.28s 7,140 228 157
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.6 7.2 22.2% 1 2.49s 903 27 0
GPT-5.5 5.3 10.0 33.3% 0 28.05s 723 69 11,609
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 4.0 10.0 0.0% 0 3.54s 576 85 0
GPT-5.5 10.0 10.0 100.0% 0 5.17s 477 133 245
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 6.3 10.0 50.0% 0 690ms 795 75 0
GPT-5.5 9.9 10.0 100.0% 0 3.74s 660 93 415
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 6.2 10.0 33.3% 0 744ms 828 114 0
GPT-5.5 10.0 10.0 100.0% 0 4.74s 642 279 954
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 57.10s 6,123 210 0
GPT-5.5 10.0 10.0 100.0% 0 4.96s 5,445 250 101
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.0 10.0 0.0% 0 778ms 223 13 0
GPT-5.5 3.0 10.0 0.0% 0 10.06s 195 30 840

Quick Compare

Switch Comparison Pair

GPT-5.5lowvsQwen3.7 MaxmediumClaude Fable 5mediumvsGPT-5.5lowGemini 3.1 Pro PreviewmediumvsGPT-5.5lowGemini 3.5 FlashmediumvsGPT-5.5lowGemini 3 Flash PreviewmediumvsGPT-5.5lowGemma 4 26B A4BnoneFree AvailablevsMiniMax M2.7mediumNorth Mini CodemediumFree AvailablevsGemma 4 26B A4BnoneFree AvailableGemma 4 26B A4BnoneFree AvailablevsMistral Small 4mediumGPT-5.5lowvsQwen3.6 Max PreviewmediumClaude Opus 4.8mediumvsGPT-5.5lowGemini 3.5 FlashhighvsGPT-5.5lowCobuddymediumvsGemma 4 26B A4BnoneFree Available