Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Google: Gemma 4 31B vs OpenAI: GPT-5 Nano

Last updated at: 2026-04-02

Metric Gemma 4 31B Gemma 4 31B none Release: 2026-04-02 GPT-5 Nano GPT-5 Nano medium Release: 2025-08-07
Score 6.7 6.2
Rank #47 #52
Consistency 10.0 6.7
Tests Correct
Attempt pass rate 52.9% 58.8%
Flaky tests 0 7
Total Runs 51 51
Cost per result 0.023 0.864
Total Cost $0.002 $0.061
Input Price $0.140 / 1M $0.050 / 1M
Output Price $0.400 / 1M $0.400 / 1M
Output Tokens 660 4,500
Reasoning Tokens 0 143,296
Response Time (avg) 2.55s 44.47s
Response Time (max) 4.68s 204.02s
Response Time (total) 38.20s 444.74s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 6.5 10.0 50.0% 0 1.85s 45 0
GPT-5 Nano 6.5 7.9 58.3% 1 25.50s 1,221 21,184
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
GPT-5 Nano 10.0 10.0 100.0% 0 65.96s 578 17,984
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 2.25s 285 0
GPT-5 Nano 3.7 1.7 50.0% 2 21.42s 453 10,560
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 7.7 10.0 66.7% 0 3.22s 27 0
GPT-5 Nano 5.2 4.4 55.6% 2 204.02s 237 64,448
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 2.09s 117 0
GPT-5 Nano 4.1 10.0 0.0% 0 17.51s 202 4,608
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 6.5 10.0 50.0% 0 2.84s 78 0
GPT-5 Nano 8.5 6.8 83.3% 1 11.90s 382 4,096
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 5.5 10.0 33.3% 0 2.95s 108 0
GPT-5 Nano 5.3 7.2 44.4% 1 19.81s 869 13,440
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
GPT-5 Nano 10.0 10.0 100.0% 0 33.30s 558 6,976

Quick Compare

Switch Comparison Pair

DeepSeek V3.2nonevsGPT-5 NanomediumGemma 4 31BnonevsGPT-5 MinimediumGPT-5 NanomediumvsMiMo-V2-OmninoneGemma 4 31BnonevsNemotron 3 SupermediumFree AvailableGPT-5 NanomediumvsQwen3.5-FlashnoneGemma 4 31BnonevsGrok 4.1 FastmediumGemma 4 31BnonevsHunter AlphamediumGPT-5 NanomediumvsGLM 5V TurbononeSeed-2.0-LitenonevsGPT-5 NanomediumGemini 2.5 FlashnonevsGPT-5 NanomediumGPT-5 NanomediumvsQwen3.5-35B-A3BnoneGemma 4 31BnonevsGPT-5.4 Minimedium