Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Google: Gemma 4 26B A4B vs OpenAI: GPT-5.3 Chat

Last updated at: 2026-04-04

Metric Gemma 4 26B A4B Gemma 4 26B A4B medium Release: 2026-04-03 GPT-5.3 Chat GPT-5.3 Chat none Release: 2026-03-03
Score 8.3 7.6
Rank #13 #33
Consistency 8.9 8.6
Tests Correct
Attempt pass rate 80.4% 66.7%
Flaky tests 2 3
Total Runs 51 51
Cost per result 0.189 3.177
Total Cost $0.025 $0.318
Input Price $0.130 / 1M $1.750 / 1M
Output Price $0.400 / 1M $14.000 / 1M
Output Tokens 12,412 19,348
Reasoning Tokens 39,955 0
Response Time (avg) 17.38s 5.68s
Response Time (max) 73.55s 18.33s
Response Time (total) 278.01s 96.58s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 6.20s 1,142 3,045
GPT-5.3 Chat 6.7 8.1 58.3% 1 3.86s 3,167 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 9.6 10.0 100.0% 0 73.55s 5,415 13,112
GPT-5.3 Chat 10.0 10.0 100.0% 0 11.96s 2,614 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 16.51s 1,567 2,827
GPT-5.3 Chat 10.0 10.0 100.0% 0 2.21s 942 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.9 4.4 22.2% 2 23.62s 2,469 7,105
GPT-5.3 Chat 3.5 4.4 33.3% 2 13.01s 8,264 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 29.76s 25 5,075
GPT-5.3 Chat 4.6 10.0 0.0% 0 1.99s 319 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 17.54s 887 4,470
GPT-5.3 Chat 8.3 10.0 50.0% 0 3.29s 1,455 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 7.9 9.6 66.7% 0 8.52s 457 3,065
GPT-5.3 Chat 10.0 10.0 100.0% 0 2.93s 1,726 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 9.01s 450 1,256
GPT-5.3 Chat 10.0 10.0 100.0% 0 8.36s 861 0

Quick Compare

Switch Comparison Pair

GPT-5.3 ChatnonevsMiMo-V2-FlashmediumClaude Opus 4.6mediumvsGPT-5.3 ChatnoneGPT-5.3 ChatnonevsGLM 5V TurbomediumSeed-2.0-MinimediumvsGPT-5.3 ChatnoneGPT-5.3 ChatnonevsQwen3.5-35B-A3BmediumGPT-5.3 ChatnonevsStep 3.5 FlashmediumFree AvailableGPT-5.3 ChatnonevsGrok 4.20 BetamediumGPT-5.3 ChatnonevsMiMo-V2-OmnimediumKimi K2.5mediumvsGPT-5.3 ChatnoneClaude Sonnet 4.6mediumvsGPT-5.3 ChatnoneGPT-5.3 ChatnonevsMiMo-V2-PromediumGPT-5.3 ChatnonevsQwen3.5-Flashmedium