Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Google: Gemma 4 31B vs OpenAI: GPT-5.2 Chat

Last updated at: 2026-05-10

Metric Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available GPT-5.2 Chat GPT-5.2 Chat none Release: 2025-12-11
Score 8.2 7.6
Rank #14 #41
Reliability 6.7 10.0
Consistency 9.6 8.8
Tests Correct
Attempt pass rate 77.2% 71.9%
Flaky tests 1 3
Total Runs 57 57
Cost per result 0.158 2.572
Total Cost $0.023 $0.309
Input Price $0.130 / 1M $1.750 / 1M
Output Price $0.380 / 1M $14.000 / 1M
Output Tokens 14,426 18,585
Reasoning Tokens 37,964 0
Response Time (avg) 28.72s 6.85s
Response Time (max) 90.14s 38.52s
Response Time (total) 488.27s 130.06s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 12.89s 962 2,046
GPT-5.2 Chat 8.7 7.9 91.7% 1 3.40s 1,807 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 4.7 1.6 66.7% 1 70.97s 3,166 5,449
GPT-5.2 Chat 10.0 10.0 100.0% 0 8.97s 1,345 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
GPT-5.2 Chat 10.0 10.0 100.0% 0 9.12s 1,243 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 21.11s 1,822 2,951
GPT-5.2 Chat 10.0 10.0 100.0% 0 3.05s 980 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 7.7 10.0 66.7% 0 38.48s 4,349 8,985
GPT-5.2 Chat 5.3 10.0 33.3% 0 17.78s 7,810 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 9.57s 105 888
GPT-5.2 Chat 4.4 3.0 33.3% 1 3.20s 335 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 12.76s 533 2,035
GPT-5.2 Chat 7.3 5.9 83.3% 1 5.46s 1,528 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 9.9 10.0 100.0% 0 27.63s 1,797 5,596
GPT-5.2 Chat 7.7 10.0 66.7% 0 4.42s 1,743 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
GPT-5.2 Chat 10.0 10.0 100.0% 0 4.68s 555 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 90.14s 1,692 10,014
GPT-5.2 Chat 3.0 10.0 0.0% 0 6.89s 1,239 0

Quick Compare

Switch Comparison Pair

Kimi K2.6mediumvsGPT-5.2 ChatnoneGPT-5.2 ChatnonevsStep 3.5 FlashmediumGemini 3.1 Flash LitelowvsGPT-5.2 ChatnoneGPT-5.2 ChatnonevsQwen3.5-FlashmediumGemma 4 26B A4BmediumFree AvailablevsGPT-5.2 ChatnoneGPT-5.2 ChatnonevsGLM 5.1mediumGPT-5.2 ChatnonevsMiMo-V2-PromediumDeepSeek V4 FlashhighvsGPT-5.2 ChatnoneGPT-5.2 ChatnonevsGLM 5V TurbomediumGPT-5.2 ChatnonevsQwen3.6 FlashmediumClaude Sonnet 4.6mediumvsGPT-5.2 ChatnoneGPT-5.2 ChatnonevsQwen3.5 Plus 2026-04-20medium