Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Google: Gemma 4 26B A4B vs Z.ai: GLM 5

Last updated at: 2026-04-11

Metric Gemma 4 26B A4B Gemma 4 26B A4B medium Release: 2026-04-03 Free Available GLM 5 GLM 5 medium Release: 2026-02-12
Score 8.0 8.4
Rank #22 #11
Consistency 9.0 8.2
Tests Correct
Attempt pass rate 75.9% 85.2%
Flaky tests 2 4
Total Runs 54 54
Cost per result 0.214 1.188
Total Cost $0.028 $0.155
Input Price $0.120 / 1M $0.720 / 1M
Output Price $0.400 / 1M $2.300 / 1M
Output Tokens 15,928 20,163
Reasoning Tokens 44,631 58,337
Response Time (avg) 25.03s 23.34s
Response Time (max) 147.47s 79.09s
Response Time (total) 425.48s 233.40s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 6.20s 1,142 3,045
GLM 5 10.0 10.0 100.0% 0 23.66s 480 7,056
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.8 10.0 0.0% 0 147.47s 3,516 4,676
GLM 5 10.0 10.0 100.0% 0 79.09s 330 19,814
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 9.6 10.0 100.0% 0 73.55s 5,415 13,112
GLM 5 10.0 10.0 100.0% 0 28.96s 662 3,242
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 16.51s 1,567 2,827
GLM 5 7.1 5.6 83.3% 1 8.90s 567 3,734
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.9 4.4 22.2% 2 23.62s 2,469 7,105
GLM 5 3.5 4.4 33.3% 2 0ms 13,176 14,137
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 29.76s 25 5,075
GLM 5 6.1 3.1 66.7% 1 14.69s 2,020 2,248
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 17.54s 887 4,470
GLM 5 10.0 10.0 100.0% 0 7.25s 1,001 2,129
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 7.9 9.6 66.7% 0 8.52s 457 3,065
GLM 5 10.0 10.0 100.0% 0 15.64s 1,694 4,983
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 9.01s 450 1,256
GLM 5 10.0 10.0 100.0% 0 15.93s 233 994

Quick Compare

Switch Comparison Pair

Gemma 4 26B A4BmediumFree AvailablevsGPT-5.2 ChatnoneGemini 3 Flash PreviewnonevsGLM 5mediumGemini 3.1 Flash Lite PreviewlowvsGLM 5mediumGemma 4 26B A4BmediumFree AvailablevsGPT-5.3 ChatnoneGemini 3 Flash PreviewlowvsGLM 5mediumGPT-5.2 ChatnonevsGLM 5mediumGemini 3.1 Flash Lite PreviewnonevsGLM 5mediumClaude Sonnet 4.6nonevsGemma 4 26B A4BmediumFree AvailableGPT-5.3 ChatnonevsGLM 5mediumClaude Sonnet 4.6nonevsGLM 5mediumGemma 4 26B A4BmediumFree AvailablevsQwen3.5 Plus 2026-02-15noneGemma 4 26B A4BmediumFree AvailablevsGLM 5none