Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Google: Gemma 4 31B vs Z.ai: GLM 5

Last updated at: 2026-04-02

Metric Gemma 4 31B Gemma 4 31B medium Release: 2026-04-02 GLM 5 GLM 5 medium Release: 2026-02-12
Score 8.6 8.3
Rank #5 #14
Consistency 9.6 8.1
Tests Correct
Attempt pass rate 80.4% 84.3%
Flaky tests 1 4
Total Runs 51 51
Cost per result 0.109 0.896
Total Cost $0.015 $0.108
Input Price $0.140 / 1M $0.720 / 1M
Output Price $0.400 / 1M $2.300 / 1M
Output Tokens 9,568 19,833
Reasoning Tokens 22,501 38,523
Response Time (avg) 21.81s 17.15s
Response Time (max) 68.92s 28.96s
Response Time (total) 327.16s 154.32s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 12.89s 962 2,046
GLM 5 10.0 10.0 100.0% 0 23.66s 480 7,056
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
GLM 5 10.0 10.0 100.0% 0 28.96s 662 3,242
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 21.11s 1,822 2,951
GLM 5 7.1 5.6 83.3% 1 8.90s 567 3,734
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 7.7 10.0 66.7% 0 38.48s 4,349 8,985
GLM 5 3.5 4.4 33.3% 2 0ms 13,176 14,137
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 9.57s 105 888
GLM 5 6.1 3.1 66.7% 1 14.69s 2,020 2,248
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 10.0 10.0 100.0% 0 12.76s 533 2,035
GLM 5 10.0 10.0 100.0% 0 7.25s 1,001 2,129
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 8.8 7.9 88.9% 1 27.63s 1,797 5,596
GLM 5 10.0 10.0 100.0% 0 15.64s 1,694 4,983
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
GLM 5 10.0 10.0 100.0% 0 15.93s 233 994

Quick Compare

Switch Comparison Pair

Gemini 3.1 Flash Lite PreviewlowvsGLM 5mediumGemini 3 Flash PreviewnonevsGLM 5mediumGemini 3 Flash PreviewlowvsGLM 5mediumGemini 3.1 Flash Lite PreviewnonevsGLM 5mediumGPT-5.2 ChatnonevsGLM 5mediumGPT-5.3 ChatnonevsGLM 5mediumGemma 4 31BmediumvsGPT-5.2 ChatnoneGemma 4 31BmediumvsGPT-5.3 ChatnoneClaude Sonnet 4.6nonevsGLM 5mediumClaude Sonnet 4.6nonevsGemma 4 31BmediumQwen3.5 Plus 2026-02-15nonevsGLM 5mediumGemma 4 31BnonevsGLM 5medium