Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Google: Gemma 4 31B vs OpenAI: GPT-5.5

Last updated at: 2026-05-22

Metric Gemma 4 31B Gemma 4 31B none Release: 2026-04-02 Free Available GPT-5.5 GPT-5.5 none Release: 2026-04-24
Score 6.7 6.5
Rank #76 #86
Reliability 10.0 10.0
Consistency 10.0 8.7
Tests Correct
Attempt pass rate 50.0% 56.7%
Flaky tests 0 3
Total Runs 60 60
Cost per result 0.030 2.165
Total Cost $0.003 $0.217
Input Price $0.120 / 1M $5.000 / 1M
Output Price $0.370 / 1M $30.000 / 1M
Output Tokens 1,398 1,949
Reasoning Tokens 0 0
Response Time (avg) 3.84s 1.94s
Response Time (max) 26.13s 5.56s
Response Time (total) 69.13s 38.86s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 6.5 10.0 50.0% 0 1.85s 45 0
GPT-5.5 6.9 7.9 66.7% 1 1.31s 213 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 6.8 10.0 50.0% 0 14.84s 726 0
GPT-5.5 6.8 10.0 50.0% 0 1.52s 447 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
GPT-5.5 3.0 10.0 0.0% 0 5.56s 300 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 2.25s 285 0
GPT-5.5 10.0 10.0 100.0% 0 1.18s 222 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 7.7 10.0 66.7% 0 3.22s 27 0
GPT-5.5 2.9 7.2 11.1% 1 1.31s 52 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 2.09s 117 0
GPT-5.5 10.0 10.0 100.0% 0 3.41s 124 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 6.5 10.0 50.0% 0 2.84s 78 0
GPT-5.5 6.2 5.8 66.7% 1 1.15s 81 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 6.5 10.0 33.3% 0 2.95s 108 0
GPT-5.5 7.7 10.0 66.7% 0 1.36s 245 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
GPT-5.5 10.0 10.0 100.0% 0 3.90s 247 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 1.25s 12 0
GPT-5.5 3.0 10.0 0.0% 0 5.01s 18 0

Quick Compare

Switch Comparison Pair

Gemma 4 31BnoneFree AvailablevsGrok 4.20mediumGemma 4 31BnoneFree AvailablevsKimi K2.5mediumGPT-5.5nonevsQwen3.6 27BmediumDeepSeek V4 ProhighvsGemma 4 31BnoneFree AvailableDeepSeek V4 ProhighvsGPT-5.5noneGemma 4 31BnoneFree AvailablevsQwen3.6 27BmediumKimi K2.5mediumvsGPT-5.5noneGemini 3.1 Flash LiteminimalvsGPT-5.5noneGPT-5.5nonevsGrok 4.20mediumGemma 4 31BnoneFree AvailablevsGPT-5 MinimediumGemma 4 31BnoneFree AvailablevsMiMo-V2-OmnimediumDeepSeek V3.2mediumvsGemma 4 31BnoneFree Available