Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Google: Gemma 4 31B vs Z.ai: GLM 5

Last updated at: 2026-05-19

Metric Gemma 4 31B Gemma 4 31B none Release: 2026-04-02 Free Available GLM 5 GLM 5 none Release: 2026-02-12
Score 6.9 6.5
Rank #71 #85
Reliability 10.0 10.0
Consistency 10.0 9.7
Tests Correct
Attempt pass rate 52.6% 49.1%
Flaky tests 0 1
Total Runs 57 57
Cost per result 0.025 0.219
Total Cost $0.003 $0.020
Input Price $0.120 / 1M $0.600 / 1M
Output Price $0.370 / 1M $1.920 / 1M
Output Tokens 1,371 1,972
Reasoning Tokens 0 0
Response Time (avg) 3.86s 4.18s
Response Time (max) 26.13s 11.07s
Response Time (total) 65.57s 50.12s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 6.5 10.0 50.0% 0 1.85s 45 0
GLM 5 4.8 10.0 25.0% 0 2.37s 275 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 26.13s 699 0
GLM 5 5.6 3.5 33.3% 1 8.84s 408 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
GLM 5 3.0 10.0 0.0% 0 4.98s 406 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 2.25s 285 0
GLM 5 10.0 10.0 100.0% 0 5.78s 203 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 7.7 10.0 66.7% 0 3.22s 27 0
GLM 5 3.0 10.0 0.0% 0 2.24s 19 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 2.09s 117 0
GLM 5 10.0 10.0 100.0% 0 3.27s 103 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 6.5 10.0 50.0% 0 2.84s 78 0
GLM 5 10.0 10.0 100.0% 0 1.48s 61 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 6.5 10.0 33.3% 0 2.95s 108 0
GLM 5 7.7 10.0 66.7% 0 2.05s 264 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
GLM 5 10.0 10.0 100.0% 0 11.07s 220 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 1.25s 12 0
GLM 5 3.0 10.0 0.0% 0 3.62s 13 0

Quick Compare

Switch Comparison Pair

Grok 4.1 FastmediumvsGLM 5noneDeepSeek V4 ProhighvsGemma 4 31BnoneFree AvailableGemma 4 31BnoneFree AvailablevsGrok 4.20mediumGemma 4 31BnoneFree AvailablevsGPT-5 MinimediumGemma 4 31BnoneFree AvailablevsKimi K2.5mediumGemma 4 31BnoneFree AvailablevsQwen3.6 27BmediumMercury 2mediumvsGLM 5noneGPT-5 NanomediumvsGLM 5noneGemma 4 31BnoneFree AvailablevsMiMo-V2-OmnimediumGemma 4 31BnoneFree AvailablevsGPT-5.4 MinimediumDeepSeek V3.2mediumvsGemma 4 31BnoneFree AvailableQwen3.6 27BmediumvsGLM 5none