Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Google: Gemma 4 31B vs OpenAI: GPT-5.5

Last updated at: 2026-04-24

Metric Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 Free Available GPT-5.5 GPT-5.5 medium Release: 2026-04-24
Score 8.3 9.0
Rank #16 #5
Reliability N/A N/A
Consistency 9.2 9.2
Tests Correct
Attempt pass rate 79.6% 87.0%
Flaky tests 2 2
Total Runs 54 54
Cost per result 0.136 19.226
Total Cost $0.018 $2.884
Input Price $0.130 / 1M $5.000 / 1M
Output Price $0.380 / 1M $30.000 / 1M
Output Tokens 12,734 1,920
Reasoning Tokens 27,950 89,632
Response Time (avg) 24.88s 32.75s
Response Time (max) 70.97s 332.10s
Response Time (total) 398.13s 589.59s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 12.89s 962 2,046
GPT-5.5 10.0 10.0 100.0% 0 4.66s 250 1,335
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 4.7 1.6 66.7% 1 70.97s 3,166 5,449
GPT-5.5 10.0 10.0 100.0% 0 9.09s 318 1,391
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
GPT-5.5 10.0 10.0 100.0% 0 19.29s 312 2,841
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 21.11s 1,822 2,951
GPT-5.5 10.0 10.0 100.0% 0 4.18s 234 593
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 7.7 10.0 66.7% 0 38.48s 4,349 8,985
GPT-5.5 5.3 7.2 44.4% 1 164.14s 67 79,625
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 9.57s 105 888
GPT-5.5 10.0 10.0 100.0% 0 4.16s 138 223
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 12.76s 533 2,035
GPT-5.5 10.0 10.0 100.0% 0 3.36s 93 538
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 8.8 7.9 88.9% 1 27.63s 1,797 5,596
GPT-5.5 8.6 7.9 77.8% 1 6.78s 250 2,254
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
GPT-5.5 10.0 10.0 100.0% 0 10.57s 258 832

Quick Compare

Switch Comparison Pair

Gemma 4 31BmediumFree AvailablevsHY3 PreviewhighFree AvailableGemini 3 Flash PreviewlowvsGPT-5.5mediumClaude Opus 4.7nonevsGPT-5.5mediumGemma 4 31BmediumFree AvailablevsHY3 PreviewlowFree AvailableGemma 4 31BmediumFree AvailablevsGPT-5.2 ChatnoneGPT-5.5mediumvsHY3 PreviewhighFree AvailableDeepSeek V4 FlashhighvsGemma 4 31BmediumFree AvailableGemma 4 31BmediumFree AvailablevsGPT-5.3 ChatnoneClaude Opus 4.7nonevsGemma 4 31BmediumFree AvailableGPT-5.5mediumvsHY3 PreviewlowFree AvailableGemini 3 Flash PreviewnonevsGPT-5.5mediumGemini 3.1 Flash Lite PreviewlowvsGPT-5.5medium