Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Google: Gemma 4 31B vs xAI: Grok Build 0.1

Last updated at: 2026-05-21

Metric Gemma 4 31B Gemma 4 31B none Release: 2026-04-02 Free Available Grok Build 0.1 Grok Build 0.1 medium Release: 2026-05-21
Score 6.9 7.8
Rank #72 #41
Reliability 10.0 10.0
Consistency 10.0 8.9
Tests Correct
Attempt pass rate 52.6% 71.9%
Flaky tests 0 3
Total Runs 57 57
Cost per result 0.025 4.064
Total Cost $0.003 $0.488
Input Price $0.120 / 1M $1.000 / 1M
Output Price $0.370 / 1M $2.000 / 1M
Output Tokens 1,371 1,947
Reasoning Tokens 0 223,372
Response Time (avg) 3.86s 22.28s
Response Time (max) 26.13s 88.28s
Response Time (total) 65.57s 423.30s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 6.5 10.0 50.0% 0 1.85s 45 0
Grok Build 0.1 10.0 10.0 100.0% 0 5.46s 195 9,825
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 26.13s 699 0
Grok Build 0.1 7.3 3.7 66.7% 1 30.98s 354 17,734
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Grok Build 0.1 10.0 10.0 100.0% 0 30.81s 231 18,779
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 2.25s 285 0
Grok Build 0.1 10.0 10.0 100.0% 0 7.76s 180 10,343
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 7.7 10.0 66.7% 0 3.22s 27 0
Grok Build 0.1 5.3 10.0 33.3% 0 77.75s 501 111,807
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 2.09s 117 0
Grok Build 0.1 3.8 2.5 33.3% 1 10.14s 78 5,386
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 6.5 10.0 50.0% 0 2.84s 78 0
Grok Build 0.1 9.8 10.0 100.0% 0 9.62s 57 12,436
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 6.5 10.0 33.3% 0 2.95s 108 0
Grok Build 0.1 6.2 7.5 55.6% 1 8.67s 161 15,476
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Grok Build 0.1 10.0 10.0 100.0% 0 9.40s 180 5,319
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 1.25s 12 0
Grok Build 0.1 3.0 10.0 0.0% 0 26.07s 10 16,267

Quick Compare

Switch Comparison Pair

DeepSeek V4 ProhighvsGemma 4 31BnoneFree AvailableGemma 4 31BnoneFree AvailablevsGrok 4.20mediumGemma 4 31BnoneFree AvailablevsGPT-5 MinimediumGemma 4 31BnoneFree AvailablevsKimi K2.5mediumGemini 3.1 Flash Lite PreviewnonevsGrok Build 0.1mediumGemma 4 31BnoneFree AvailablevsQwen3.6 27BmediumGemini 3.1 Flash Lite PreviewlowvsGrok Build 0.1mediumGemini 3 Flash PreviewnonevsGrok Build 0.1mediumGPT-5.2 ChatnonevsGrok Build 0.1mediumGemini 3.1 Flash LitelowvsGrok Build 0.1mediumGPT-5.3 ChatnonevsGrok Build 0.1mediumDeepSeek V4 FlashhighFree AvailablevsGrok Build 0.1medium