Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Google: Gemma 4 26B A4B vs Z.ai: GLM 4.7 Flash

Last updated at: 2026-05-19

Metric Gemma 4 26B A4B Gemma 4 26B A4B none Release: 2026-04-03 Free Available GLM 4.7 Flash GLM 4.7 Flash none Release: 2026-01-19
Score 6.3 5.8
Rank #89 #104
Reliability 10.0 10.0
Consistency 9.1 8.7
Tests Correct
Attempt pass rate 49.1% 40.4%
Flaky tests 2 3
Total Runs 57 57
Cost per result 0.063 0.049
Total Cost $0.005 $0.003
Input Price $0.060 / 1M $0.060 / 1M
Output Price $0.330 / 1M $0.400 / 1M
Output Tokens 1,796 2,498
Reasoning Tokens 0 0
Response Time (avg) 6.28s 3.13s
Response Time (max) 57.10s 7.05s
Response Time (total) 119.39s 37.60s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 8.3 10.0 75.0% 0 1.28s 230 0
GLM 4.7 Flash 5.2 7.9 41.7% 1 5.51s 438 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 4.7 1.6 66.7% 1 7.07s 448 0
GLM 4.7 Flash 6.4 9.9 0.0% 0 5.57s 626 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.0 10.0 0.0% 0 30.53s 309 0
GLM 4.7 Flash 3.0 10.0 0.0% 0 3.22s 704 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 1.70s 285 0
GLM 4.7 Flash 7.3 5.8 83.3% 1 4.82s 196 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.6 7.2 22.2% 1 2.49s 27 0
GLM 4.7 Flash 7.7 10.0 66.7% 0 744ms 19 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 4.0 10.0 0.0% 0 3.54s 85 0
GLM 4.7 Flash 4.0 10.0 0.0% 0 1.59s 134 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 6.3 10.0 50.0% 0 1.08s 75 0
GLM 4.7 Flash 6.5 10.0 50.0% 0 888ms 62 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 6.2 10.0 33.3% 0 739ms 114 0
GLM 4.7 Flash 6.4 10.0 33.3% 0 1.00s 98 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 57.10s 210 0
GLM 4.7 Flash 2.8 1.6 33.3% 1 7.05s 212 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.0 10.0 0.0% 0 778ms 13 0
GLM 4.7 Flash 3.0 10.0 0.0% 0 692ms 9 0

Quick Compare

Switch Comparison Pair