Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Google: Gemma 4 31B vs OpenAI: GPT-5.5

Last updated at: 2026-05-10

Metric Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available GPT-5.5 GPT-5.5 none Release: 2026-04-24
Score 8.2 6.7
Rank #14 #74
Reliability 6.7 10.0
Consistency 9.6 8.7
Tests Correct
Attempt pass rate 77.2% 59.7%
Flaky tests 1 3
Total Runs 57 57
Cost per result 0.158 1.961
Total Cost $0.023 $0.197
Input Price $0.130 / 1M $5.000 / 1M
Output Price $0.380 / 1M $30.000 / 1M
Output Tokens 14,426 1,928
Reasoning Tokens 37,964 0
Response Time (avg) 28.72s 1.99s
Response Time (max) 90.14s 5.56s
Response Time (total) 488.27s 37.87s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 12.89s 962 2,046
GPT-5.5 6.9 7.9 66.7% 1 1.31s 213 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 4.7 1.6 66.7% 1 70.97s 3,166 5,449
GPT-5.5 10.0 10.0 100.0% 0 2.05s 426 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
GPT-5.5 3.0 10.0 0.0% 0 5.56s 300 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 21.11s 1,822 2,951
GPT-5.5 10.0 10.0 100.0% 0 1.18s 222 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 7.7 10.0 66.7% 0 38.48s 4,349 8,985
GPT-5.5 2.9 7.2 11.1% 1 1.31s 52 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 9.57s 105 888
GPT-5.5 10.0 10.0 100.0% 0 3.41s 124 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 12.76s 533 2,035
GPT-5.5 6.2 5.8 66.7% 1 1.15s 81 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 9.9 10.0 100.0% 0 27.63s 1,797 5,596
GPT-5.5 7.7 10.0 66.7% 0 1.36s 245 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
GPT-5.5 10.0 10.0 100.0% 0 3.90s 247 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 90.14s 1,692 10,014
GPT-5.5 3.0 10.0 0.0% 0 5.01s 18 0

Quick Compare

Switch Comparison Pair

GPT-5.5nonevsQwen3.6 27BmediumKimi K2.5mediumvsGPT-5.5noneGemini 3.1 Flash LiteminimalvsGPT-5.5noneGPT-5.5nonevsGrok 4.20mediumDeepSeek V4 ProhighvsGPT-5.5noneGPT-5.5nonevsGrok 4.1 FastmediumMercury 2mediumvsGPT-5.5noneGPT-5.5nonevsMiMo-V2-OmnimediumDeepSeek V3.2mediumvsGPT-5.5noneGPT-5.5nonevsQwen3.5-35B-A3BmediumSeed-2.0-MinimediumvsGPT-5.5noneGPT-5.5nonevsMiMo-V2-Flashmedium