Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Google: Gemma 4 26B A4B vs Z.ai: GLM 5

Last updated at: 2026-04-04

Metric Gemma 4 26B A4B Gemma 4 26B A4B none Release: 2026-04-03 GLM 5 GLM 5 none Release: 2026-02-12
Score 6.3 6.7
Rank #53 #49
Consistency 9.1 10.0
Tests Correct
Attempt pass rate 47.1% 52.9%
Flaky tests 2 0
Total Runs 51 51
Cost per result 0.068 0.201
Total Cost $0.005 $0.019
Input Price $0.130 / 1M $0.720 / 1M
Output Price $0.400 / 1M $2.300 / 1M
Output Tokens 1,335 1,551
Reasoning Tokens 0 0
Response Time (avg) 6.56s 3.77s
Response Time (max) 57.10s 11.07s
Response Time (total) 111.54s 37.66s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 8.3 10.0 75.0% 0 1.28s 230 0
GLM 5 4.8 10.0 25.0% 0 2.37s 275 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.0 10.0 0.0% 0 30.53s 309 0
GLM 5 3.0 10.0 0.0% 0 4.98s 406 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 1.70s 285 0
GLM 5 10.0 10.0 100.0% 0 5.78s 203 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.6 7.2 22.2% 1 2.49s 27 0
GLM 5 3.0 10.0 0.0% 0 2.24s 19 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 4.0 10.0 0.0% 0 3.54s 85 0
GLM 5 10.0 10.0 100.0% 0 3.27s 103 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 4.4 6.9 16.7% 1 1.08s 75 0
GLM 5 10.0 10.0 100.0% 0 1.48s 61 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 5.7 10.0 33.3% 0 739ms 114 0
GLM 5 7.7 10.0 66.7% 0 2.05s 264 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 57.10s 210 0
GLM 5 10.0 10.0 100.0% 0 11.07s 220 0

Quick Compare

Switch Comparison Pair

Gemma 4 26B A4BnonevsGPT-5 NanomediumGemma 4 26B A4BnonevsGrok 4.20 Multi Agent BetamediumGemma 4 26B A4BnonevsMercury 2mediumGPT-5 MinimediumvsGLM 5noneNemotron 3 SupermediumFree AvailablevsGLM 5noneGrok 4.1 FastmediumvsGLM 5noneHunter AlphamediumvsGLM 5noneGemma 4 26B A4Bnonevsgpt-oss-120bmediumFree AvailableGemma 4 26B A4BnonevsMiniMax M2.5mediumFree AvailableGPT-5.4 MinimediumvsGLM 5noneGrok 4.20mediumvsGLM 5noneMercury 2mediumvsGLM 5none