Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Google: Gemma 4 26B A4B vs Z.ai: GLM 5

Last updated at: 2026-04-04

Metric Gemma 4 26B A4B Gemma 4 26B A4B medium Release: 2026-04-03 GLM 5 GLM 5 none Release: 2026-02-12
Score 8.3 6.7
Rank #13 #49
Consistency 8.9 10.0
Tests Correct
Attempt pass rate 80.4% 52.9%
Flaky tests 2 0
Total Runs 51 51
Cost per result 0.189 0.201
Total Cost $0.025 $0.019
Input Price $0.130 / 1M $0.720 / 1M
Output Price $0.400 / 1M $2.300 / 1M
Output Tokens 12,412 1,551
Reasoning Tokens 39,955 0
Response Time (avg) 17.38s 3.77s
Response Time (max) 73.55s 11.07s
Response Time (total) 278.01s 37.66s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 6.20s 1,142 3,045
GLM 5 4.8 10.0 25.0% 0 2.37s 275 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 9.6 10.0 100.0% 0 73.55s 5,415 13,112
GLM 5 3.0 10.0 0.0% 0 4.98s 406 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 16.51s 1,567 2,827
GLM 5 10.0 10.0 100.0% 0 5.78s 203 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.9 4.4 22.2% 2 23.62s 2,469 7,105
GLM 5 3.0 10.0 0.0% 0 2.24s 19 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 29.76s 25 5,075
GLM 5 10.0 10.0 100.0% 0 3.27s 103 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 17.54s 887 4,470
GLM 5 10.0 10.0 100.0% 0 1.48s 61 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 7.9 9.6 66.7% 0 8.52s 457 3,065
GLM 5 7.7 10.0 66.7% 0 2.05s 264 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 9.01s 450 1,256
GLM 5 10.0 10.0 100.0% 0 11.07s 220 0

Quick Compare

Switch Comparison Pair