Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Google: Gemma 4 26B A4B vs OpenAI: GPT-5.5

Summary

Gemma 4 26B A4B vs GPT-5.5 benchmark comparison: GPT-5.5 leads on average score with 9.3 vs 7.2. Gemma 4 26B A4B has the lower benchmark cost at $0.045 vs $0.907. GPT-5.5 is faster at 9.76s vs 63.41s, with pass rates of 69.8% vs 85.7%.

Recommended model: GPT-5.5 - It has the best score here (9.3), while responding about 6.5x faster than Gemma 4 26B A4B.

Last updated at: 2026-07-02

Metric Gemma 4 26B A4B Gemma 4 26B A4B medium Release: 2026-04-03 Free Available GPT-5.5 GPT-5.5 low Release: 2026-04-24
Score 7.2 9.3
Rank #61 #4
Reliability 10.0 10.0
Consistency 9.2 10.0
Tests Correct
Attempt pass rate 69.8% 85.7%
Flaky tests 2 0
Total Runs 63 63
Cost per result 0.361 5.035
Total Cost $0.045 $0.907
Input Price $0.060 / 1M $5.000 / 1M
Output Price $0.330 / 1M $30.000 / 1M
Total Input Tokens 40,252 34,209
Output Tokens 28,000 2,046
Reasoning Tokens 100,490 22,460
Response Time (avg) 63.41s 9.76s
Response Time (max) 369.32s 56.19s
Response Time (total) 1268.28s 204.92s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#61 Gemma 4 26B A4B

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

#4 GPT-5.5

low
Cost
$0.068
Time
37.0s
Tokens
2,339 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 6.20s 816 1,142 3,045
GPT-5.5 10.0 10.0 100.0% 0 4.41s 606 238 1,020
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.9 10.0 0.0% 0 272.54s 5,062 14,838 44,567
GPT-5.5 10.0 10.0 100.0% 0 15.04s 7,302 423 6,402
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 9.6 10.0 100.0% 0 73.55s 17,092 5,415 13,112
GPT-5.5 10.0 10.0 100.0% 0 9.56s 11,019 303 717
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 16.51s 8,334 1,567 2,827
GPT-5.5 10.0 10.0 100.0% 0 3.28s 7,140 228 157
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.9 4.4 22.2% 2 23.62s 516 2,469 7,105
GPT-5.5 5.3 10.0 33.3% 0 28.05s 723 69 11,609
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 29.76s 567 25 5,075
GPT-5.5 10.0 10.0 100.0% 0 5.17s 477 133 245
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 17.54s 777 887 4,470
GPT-5.5 9.9 10.0 100.0% 0 3.74s 660 93 415
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 5.79s 801 410 2,128
GPT-5.5 10.0 10.0 100.0% 0 4.74s 642 279 954
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 9.01s 6,096 450 1,256
GPT-5.5 10.0 10.0 100.0% 0 4.96s 5,445 250 101
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.0 10.0 0.0% 0 180.87s 191 797 16,905
GPT-5.5 3.0 10.0 0.0% 0 10.06s 195 30 840

Quick Compare

Switch Comparison Pair

Gemma 4 26B A4BmediumFree AvailablevsQwen3.7 PlusnoneDeepSeek V4 PrononevsGemma 4 26B A4BmediumFree AvailableGemma 4 26B A4BmediumFree AvailablevsGLM 5.2noneGPT-5.5lowvsQwen3.7 MaxmediumClaude Opus 4.8nonevsGemma 4 26B A4BmediumFree AvailableGemma 4 26B A4BmediumFree AvailablevsStep 3.7 FlashhighClaude Fable 5mediumvsGPT-5.5lowGemini 3.1 Pro PreviewmediumvsGPT-5.5lowClaude Sonnet 4.6nonevsGemma 4 26B A4BmediumFree AvailableGemini 3.5 FlashmediumvsGPT-5.5lowGemini 3 Flash PreviewmediumvsGPT-5.5lowGemma 4 26B A4BmediumFree AvailablevsQwen3.7 Maxnone