Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Google: Gemma 4 31B vs Z.ai: GLM 5

Last updated at: 2026-04-02

Metric Gemma 4 31B Gemma 4 31B none Release: 2026-04-02 GLM 5 GLM 5 medium Release: 2026-02-12
Score 6.7 8.3
Rank #47 #14
Consistency 10.0 8.1
Tests Correct
Attempt pass rate 52.9% 84.3%
Flaky tests 0 4
Total Runs 51 51
Cost per result 0.023 0.896
Total Cost $0.002 $0.108
Input Price $0.140 / 1M $0.720 / 1M
Output Price $0.400 / 1M $2.300 / 1M
Output Tokens 660 19,833
Reasoning Tokens 0 38,523
Response Time (avg) 2.55s 17.15s
Response Time (max) 4.68s 28.96s
Response Time (total) 38.20s 154.32s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 6.5 10.0 50.0% 0 1.85s 45 0
GLM 5 10.0 10.0 100.0% 0 23.66s 480 7,056
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
GLM 5 10.0 10.0 100.0% 0 28.96s 662 3,242
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 2.25s 285 0
GLM 5 7.1 5.6 83.3% 1 8.90s 567 3,734
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 7.7 10.0 66.7% 0 3.22s 27 0
GLM 5 3.5 4.4 33.3% 2 0ms 13,176 14,137
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 2.09s 117 0
GLM 5 6.1 3.1 66.7% 1 14.69s 2,020 2,248
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 6.5 10.0 50.0% 0 2.84s 78 0
GLM 5 10.0 10.0 100.0% 0 7.25s 1,001 2,129
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 5.5 10.0 33.3% 0 2.95s 108 0
GLM 5 10.0 10.0 100.0% 0 15.64s 1,694 4,983
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
GLM 5 10.0 10.0 100.0% 0 15.93s 233 994

Quick Compare

Switch Comparison Pair

Gemma 4 31BnonevsGPT-5 MinimediumGemma 4 31BnonevsNemotron 3 SupermediumFree AvailableGemma 4 31BnonevsGrok 4.1 FastmediumGemma 4 31BnonevsHunter AlphamediumGemini 3.1 Flash Lite PreviewlowvsGLM 5mediumGemini 3 Flash PreviewnonevsGLM 5mediumGemma 4 31BnonevsGPT-5.4 MinimediumGemma 4 31BnonevsGrok 4.20mediumGemma 4 31BnonevsMercury 2mediumGemini 3 Flash PreviewlowvsGLM 5mediumGemini 3.1 Flash Lite PreviewnonevsGLM 5mediumGPT-5.2 ChatnonevsGLM 5medium