Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Google: Gemma 4 26B A4B vs Z.ai: GLM 5.2

Summary

Gemma 4 26B A4B vs GLM 5.2 benchmark comparison: The average score is effectively tied at 7.2 vs 7.1. Gemma 4 26B A4B has the lower benchmark cost at $0.045 vs $0.076. GLM 5.2 is faster at 6.34s vs 63.41s, with pass rates of 69.8% vs 60.3%.

Recommended model: GLM 5.2 - It has the best score here (7.1), while responding about 10.0x faster than Gemma 4 26B A4B.

Last updated at: 2026-06-17

Metric Gemma 4 26B A4B Gemma 4 26B A4B medium Release: 2026-04-03 Free Available GLM 5.2 GLM 5.2 none Release: 2026-06-17
Score 7.2 7.1
Rank #59 #61
Reliability 10.0 9.9
Consistency 9.2 9.6
Tests Correct
Attempt pass rate 69.8% 60.3%
Flaky tests 2 1
Total Runs 63 63
Cost per result 0.361 0.628
Total Cost $0.045 $0.076
Input Price $0.060 / 1M $1.400 / 1M
Output Price $0.330 / 1M $4.400 / 1M
Total Input Tokens 40,252 38,671
Output Tokens 28,000 4,817
Reasoning Tokens 100,490 0
Response Time (avg) 63.41s 6.34s
Response Time (max) 369.32s 20.69s
Response Time (total) 1268.28s 133.19s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#59 Gemma 4 26B A4B

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

#61 GLM 5.2

none
Invalid SVG
Cost
$0.033
Time
87.7s
Tokens
7,455 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 6.20s 816 1,142 3,045
GLM 5.2 8.3 10.0 75.0% 0 3.70s 567 313 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.9 10.0 0.0% 0 272.54s 5,062 14,838 44,567
GLM 5.2 3.7 9.5 0.0% 0 7.55s 7,263 1,958 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 9.6 10.0 100.0% 0 73.55s 17,092 5,415 13,112
GLM 5.2 10.0 10.0 100.0% 0 20.69s 14,296 1,489 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 16.51s 8,334 1,567 2,827
GLM 5.2 10.0 10.0 100.0% 0 7.17s 7,113 204 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 2.9 4.4 22.2% 2 23.62s 516 2,469 7,105
GLM 5.2 5.3 10.0 33.3% 0 6.50s 696 27 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 29.76s 567 25 5,075
GLM 5.2 6.1 3.1 66.7% 1 4.42s 480 82 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 17.54s 777 887 4,470
GLM 5.2 9.8 10.0 100.0% 0 3.84s 642 66 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 5.79s 801 410 2,128
GLM 5.2 7.7 10.0 66.7% 0 3.31s 618 265 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 9.01s 6,096 450 1,256
GLM 5.2 10.0 10.0 100.0% 0 15.76s 6,807 400 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.0 10.0 0.0% 0 180.87s 191 797 16,905
GLM 5.2 3.0 10.0 0.0% 0 3.41s 189 13 0

Quick Compare

Switch Comparison Pair

Gemma 4 26B A4BmediumFree AvailablevsQwen3.7 PlusnoneDeepSeek V4 PrononevsGemma 4 26B A4BmediumFree AvailableMiMo-V2-FlashmediumvsGLM 5.2noneStep 3.7 FlashhighvsGLM 5.2noneClaude Opus 4.8nonevsGemma 4 26B A4BmediumFree AvailableGemma 4 26B A4BmediumFree AvailablevsStep 3.7 FlashhighKimi K2.7 CodemediumvsGLM 5.2noneClaude Sonnet 4.6nonevsGemma 4 26B A4BmediumFree AvailableGrok 4.20mediumvsGLM 5.2noneGemini 3 Flash PreviewlowvsGLM 5.2noneMiMo-V2.5-PromediumvsGLM 5.2noneSeed-2.0-MinimediumvsGLM 5.2none