Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Google: Gemma 4 26B A4B vs OpenAI: GPT-5.2 Chat

Last updated at: 2026-04-04

Metric Gemma 4 26B A4B Gemma 4 26B A4B medium Release: 2026-04-03 GPT-5.2 Chat GPT-5.2 Chat none Release: 2025-12-11
Score 8.3 7.8
Rank #13 #30
Consistency 8.9 8.6
Tests Correct
Attempt pass rate 80.4% 74.5%
Flaky tests 2 3
Total Runs 51 51
Cost per result 0.189 2.462
Total Cost $0.025 $0.271
Input Price $0.130 / 1M $1.750 / 1M
Output Price $0.400 / 1M $14.000 / 1M
Output Tokens 12,412 16,001
Reasoning Tokens 39,955 0
Response Time (avg) 17.38s 6.72s
Response Time (max) 73.55s 38.52s
Response Time (total) 278.01s 114.20s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 6.20s 1,142 3,045
GPT-5.2 Chat 8.7 7.9 91.7% 1 3.40s 1,807 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 9.6 10.0 100.0% 0 73.55s 5,415 13,112
GPT-5.2 Chat 10.0 10.0 100.0% 0 9.12s 1,243 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 16.51s 1,567 2,827
GPT-5.2 Chat 10.0 10.0 100.0% 0 3.05s 980 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.9 4.4 22.2% 2 23.62s 2,469 7,105
GPT-5.2 Chat 5.3 10.0 33.3% 0 17.78s 7,810 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 29.76s 25 5,075
GPT-5.2 Chat 4.4 3.0 33.3% 1 3.20s 335 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 17.54s 887 4,470
GPT-5.2 Chat 7.5 6.1 83.3% 1 5.46s 1,528 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 7.9 9.6 66.7% 0 8.52s 457 3,065
GPT-5.2 Chat 7.7 10.0 66.7% 0 4.42s 1,743 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 9.01s 450 1,256
GPT-5.2 Chat 10.0 10.0 100.0% 0 4.68s 555 0

Quick Compare

Switch Comparison Pair

GPT-5.2 ChatnonevsStep 3.5 FlashmediumFree AvailableGPT-5.2 ChatnonevsGLM 5V TurbomediumGPT-5.2 ChatnonevsGrok 4.20 BetamediumGPT-5.2 ChatnonevsMiMo-V2-OmnimediumClaude Sonnet 4.6mediumvsGPT-5.2 ChatnoneGPT-5.2 ChatnonevsMiMo-V2-PromediumGPT-5.2 ChatnonevsQwen3.5-FlashmediumGPT-5.2 ChatnonevsMiMo-V2-FlashmediumGemini 3.1 Flash Lite PreviewlowvsGPT-5.2 ChatnoneGPT-5.2 ChatnonevsGLM 5 TurbomediumClaude Opus 4.6mediumvsGPT-5.2 ChatnoneGemini 3.1 Flash Lite PreviewmediumvsGPT-5.2 Chatnone