Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Google: Gemma 4 26B A4B vs Z.ai: GLM 4.7 Flash

Summary

Gemma 4 26B A4B vs GLM 4.7 Flash benchmark comparison: Gemma 4 26B A4B leads on average score with 5.5 vs 4.9. Gemma 4 26B A4B has the lower benchmark cost at $0.004 vs $0.004. GLM 4.7 Flash is faster at 2.86s vs 5.91s, with pass rates of 44.4% vs 36.5%.

Recommended model: Gemma 4 26B A4B - It has the strongest score in this comparison (5.5) and the best overall balance of cost and response time across all 2 models.

Last updated at: 2026-07-02

Metric Gemma 4 26B A4B Gemma 4 26B A4B none Release: 2026-04-03 Free Available GLM 4.7 Flash GLM 4.7 Flash none Release: 2026-01-19
Score 5.5 4.9
Rank #125 #146
Reliability 10.0 10.0
Consistency 9.2 8.8
Tests Correct
Attempt pass rate 44.4% 36.5%
Flaky tests 2 3
Total Runs 63 63
Cost per result 0.068 0.056
Total Cost $0.004 $0.004
Input Price $0.060 / 1M $0.060 / 1M
Output Price $0.330 / 1M $0.400 / 1M
Total Input Tokens 40,038 38,745
Output Tokens 1,824 2,521
Reasoning Tokens 0 0
Response Time (avg) 5.91s 2.86s
Response Time (max) 57.10s 7.05s
Response Time (total) 124.05s 40.04s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#125 Gemma 4 26B A4B

none
Cost
$0.001
Time
39.5s
Tokens
790 tok

#146 GLM 4.7 Flash

none
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 8.3 10.0 75.0% 0 1.28s 852 230 0
GLM 4.7 Flash 5.2 7.9 41.7% 1 5.51s 555 438 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.7 7.2 22.2% 1 4.16s 7,736 476 0
GLM 4.7 Flash 4.3 10.0 0.0% 0 2.54s 7,256 650 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.0 10.0 0.0% 0 30.53s 13,650 309 0
GLM 4.7 Flash 3.0 10.0 0.0% 0 3.22s 14,325 704 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 1.70s 8,352 285 0
GLM 4.7 Flash 7.3 5.8 83.3% 1 4.82s 7,107 196 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.6 7.2 22.2% 1 2.49s 903 27 0
GLM 4.7 Flash 7.7 10.0 66.7% 0 744ms 687 19 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 4.0 10.0 0.0% 0 3.54s 576 85 0
GLM 4.7 Flash 4.0 10.0 0.0% 0 1.59s 477 134 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 6.3 10.0 50.0% 0 690ms 795 75 0
GLM 4.7 Flash 6.5 10.0 50.0% 0 888ms 636 62 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 6.2 10.0 33.3% 0 744ms 828 114 0
GLM 4.7 Flash 6.4 10.0 33.3% 0 1.20s 609 97 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 10.0 10.0 100.0% 0 57.10s 6,123 210 0
GLM 4.7 Flash 2.8 1.6 33.3% 1 7.05s 6,907 212 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Gemma 4 26B A4B 3.0 10.0 0.0% 0 778ms 223 13 0
GLM 4.7 Flash 3.0 10.0 0.0% 0 692ms 186 9 0

Quick Compare

Switch Comparison Pair

CobuddymediumvsGLM 4.7 FlashnoneMiniMax M2.5mediumvsGLM 4.7 FlashnoneQwen3 Coder NextmediumvsGLM 4.7 FlashnoneMistral Small 4mediumvsGLM 4.7 FlashnoneGemma 4 26B A4BnoneFree AvailablevsMiniMax M2.7mediumMiniMax M2.7mediumvsGLM 4.7 FlashnoneNorth Mini CodemediumFree AvailablevsGemma 4 26B A4BnoneFree AvailableGemma 4 26B A4BnoneFree AvailablevsMistral Small 4mediumCobuddymediumvsGemma 4 26B A4BnoneFree AvailableGemma 4 26B A4BnoneFree AvailablevsMiniMax M2.5mediumGemma 4 26B A4BnoneFree AvailablevsQwen3 Coder NextmediumGemma 4 26B A4BnoneFree AvailablevsQwen3.5-35B-A3Bmedium