Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Google: Gemma 4 26B A4B vs Z.ai: GLM 5

Last updated at: 2026-05-19

Metric Gemma 4 26B A4B Gemma 4 26B A4B medium Release: 2026-04-03 Free Available GLM 5 GLM 5 none Release: 2026-02-12
Score 7.7 6.5
Rank #43 #85
Reliability 10.0 10.0
Consistency 8.7 9.7
Tests Correct
Attempt pass rate 73.7% 49.1%
Flaky tests 3 1
Total Runs 57 57
Cost per result 0.260 0.219
Total Cost $0.034 $0.020
Input Price $0.060 / 1M $0.600 / 1M
Output Price $0.330 / 1M $1.920 / 1M
Output Tokens 16,725 1,972
Reasoning Tokens 61,536 0
Response Time (avg) 33.69s 4.18s
Response Time (max) 180.87s 11.07s
Response Time (total) 606.35s 50.12s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 6.20s 1,142 3,045
GLM 5 4.8 10.0 25.0% 0 2.37s 275 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.8 10.0 0.0% 0 147.47s 3,516 4,676
GLM 5 5.6 3.5 33.3% 1 8.84s 408 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 9.6 10.0 100.0% 0 73.55s 5,415 13,112
GLM 5 3.0 10.0 0.0% 0 4.98s 406 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 16.51s 1,567 2,827
GLM 5 10.0 10.0 100.0% 0 5.78s 203 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.9 4.4 22.2% 2 23.62s 2,469 7,105
GLM 5 3.0 10.0 0.0% 0 2.24s 19 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 29.76s 25 5,075
GLM 5 10.0 10.0 100.0% 0 3.27s 103 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 17.54s 887 4,470
GLM 5 10.0 10.0 100.0% 0 1.48s 61 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 7.7 7.3 77.8% 1 8.52s 457 3,065
GLM 5 7.7 10.0 66.7% 0 2.05s 264 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 9.01s 450 1,256
GLM 5 10.0 10.0 100.0% 0 11.07s 220 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.0 10.0 0.0% 0 180.87s 797 16,905
GLM 5 3.0 10.0 0.0% 0 3.62s 13 0

Quick Compare

Switch Comparison Pair

Grok 4.1 FastmediumvsGLM 5noneGemma 4 26B A4BmediumFree AvailablevsGPT-5.2 ChatnoneGemma 4 26B A4BmediumFree AvailablevsGPT-5.3 ChatnoneMercury 2mediumvsGLM 5noneDeepSeek V4 FlashhighFree AvailablevsGemma 4 26B A4BmediumFree AvailableGPT-5 NanomediumvsGLM 5noneQwen3.6 27BmediumvsGLM 5noneKimi K2.5mediumvsGLM 5noneGemini 3.1 Flash LiteminimalvsGLM 5noneNemotron 3 SupermediumFree AvailablevsGLM 5noneGPT-5 MinimediumvsGLM 5noneGrok 4.20mediumvsGLM 5none