Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Google: Gemma 4 26B A4B vs OpenAI: GPT-5.2 Chat

Last updated at: 2026-05-19

Metric Gemma 4 26B A4B Gemma 4 26B A4B medium Release: 2026-04-03 Free Available GPT-5.2 Chat GPT-5.2 Chat none Release: 2025-12-11
Score 7.7 7.6
Rank #43 #46
Reliability 10.0 10.0
Consistency 8.7 8.8
Tests Correct
Attempt pass rate 73.7% 71.9%
Flaky tests 3 3
Total Runs 57 57
Cost per result 0.260 2.572
Total Cost $0.034 $0.309
Input Price $0.060 / 1M $1.750 / 1M
Output Price $0.330 / 1M $14.000 / 1M
Output Tokens 16,725 18,585
Reasoning Tokens 61,536 0
Response Time (avg) 33.69s 6.85s
Response Time (max) 180.87s 38.52s
Response Time (total) 606.35s 130.06s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 6.20s 1,142 3,045
GPT-5.2 Chat 8.7 7.9 91.7% 1 3.40s 1,807 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.8 10.0 0.0% 0 147.47s 3,516 4,676
GPT-5.2 Chat 10.0 10.0 100.0% 0 8.97s 1,345 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 9.6 10.0 100.0% 0 73.55s 5,415 13,112
GPT-5.2 Chat 10.0 10.0 100.0% 0 9.12s 1,243 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 16.51s 1,567 2,827
GPT-5.2 Chat 10.0 10.0 100.0% 0 3.05s 980 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.9 4.4 22.2% 2 23.62s 2,469 7,105
GPT-5.2 Chat 5.3 10.0 33.3% 0 17.78s 7,810 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 29.76s 25 5,075
GPT-5.2 Chat 4.4 3.0 33.3% 1 3.20s 335 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 17.54s 887 4,470
GPT-5.2 Chat 7.3 5.9 83.3% 1 5.46s 1,528 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 7.7 7.3 77.8% 1 8.52s 457 3,065
GPT-5.2 Chat 7.7 10.0 66.7% 0 4.42s 1,743 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 9.01s 450 1,256
GPT-5.2 Chat 10.0 10.0 100.0% 0 4.68s 555 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.0 10.0 0.0% 0 180.87s 797 16,905
GPT-5.2 Chat 3.0 10.0 0.0% 0 6.89s 1,239 0

Quick Compare

Switch Comparison Pair

Kimi K2.6mediumvsGPT-5.2 ChatnoneGPT-5.2 ChatnonevsStep 3.5 FlashmediumGemini 3.1 Flash LitelowvsGPT-5.2 ChatnoneGPT-5.2 ChatnonevsQwen3.5-FlashmediumGPT-5.2 ChatnonevsGLM 5.1mediumGPT-5.2 ChatnonevsMiMo-V2-PromediumDeepSeek V4 FlashhighFree AvailablevsGPT-5.2 ChatnoneGPT-5.2 ChatnonevsGLM 5V TurbomediumGPT-5.2 ChatnonevsQwen3.6 FlashmediumGemma 4 26B A4BmediumFree AvailablevsGPT-5.3 ChatnoneDeepSeek V4 FlashhighFree AvailablevsGemma 4 26B A4BmediumFree AvailableClaude Sonnet 4.6mediumvsGPT-5.2 Chatnone