Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Z.ai: GLM 4.7 Flash vs Z.ai: GLM 5.1

Last updated at: 2026-05-22

Metric GLM 4.7 Flash GLM 4.7 Flash none Release: 2026-01-19 GLM 5.1 GLM 5.1 none Release: 2026-04-07
Score 5.6 5.6
Rank #109 #113
Reliability 10.0 10.0
Consistency 8.7 8.1
Tests Correct
Attempt pass rate 38.3% 40.0%
Flaky tests 3 5
Total Runs 60 60
Cost per result 0.053 0.941
Total Cost $0.004 $0.057
Input Price $0.060 / 1M $0.980 / 1M
Output Price $0.400 / 1M $3.080 / 1M
Output Tokens 2,516 3,749
Reasoning Tokens 0 0
Response Time (avg) 2.98s 4.16s
Response Time (max) 7.05s 32.57s
Response Time (total) 38.73s 83.23s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GLM 4.7 Flash 5.2 7.9 41.7% 1 5.51s 438 0
GLM 5.1 4.0 6.3 25.0% 2 2.11s 305 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GLM 4.7 Flash 5.0 10.0 0.0% 0 3.35s 644 0
GLM 5.1 4.3 9.5 0.0% 0 6.33s 519 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GLM 4.7 Flash 3.0 10.0 0.0% 0 3.22s 704 0
GLM 5.1 2.8 2.1 33.3% 1 32.57s 2,129 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GLM 4.7 Flash 7.3 5.8 83.3% 1 4.82s 196 0
GLM 5.1 10.0 10.0 100.0% 0 1.08s 204 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GLM 4.7 Flash 7.7 10.0 66.7% 0 744ms 19 0
GLM 5.1 2.9 7.2 11.1% 1 1.99s 24 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GLM 4.7 Flash 4.0 10.0 0.0% 0 1.59s 134 0
GLM 5.1 5.0 10.0 0.0% 0 790ms 39 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GLM 4.7 Flash 6.5 10.0 50.0% 0 888ms 62 0
GLM 5.1 9.8 10.0 100.0% 0 1.58s 66 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GLM 4.7 Flash 6.4 10.0 33.3% 0 1.00s 98 0
GLM 5.1 6.1 7.8 44.4% 1 1.48s 152 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GLM 4.7 Flash 2.8 1.6 33.3% 1 7.05s 212 0
GLM 5.1 10.0 10.0 100.0% 0 10.68s 300 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GLM 4.7 Flash 3.0 10.0 0.0% 0 692ms 9 0
GLM 5.1 3.0 10.0 0.0% 0 2.34s 11 0

Quick Compare

Switch Comparison Pair

gpt-oss-120bmediumFree AvailablevsGLM 5.1nonegpt-oss-120bmediumFree AvailablevsGLM 4.7 FlashnoneCobuddymediumFree AvailablevsGLM 4.7 FlashnoneMiniMax M2.5mediumFree AvailablevsGLM 5.1noneCobuddymediumFree AvailablevsGLM 5.1noneMistral Small 4mediumvsGLM 5.1noneElephant AlphamediumvsGLM 5.1noneMiniMax M2.5mediumFree AvailablevsGLM 4.7 FlashnoneOwl AlphamediumvsGLM 4.7 FlashnoneMistral Small 4mediumvsGLM 4.7 FlashnoneElephant AlphamediumvsGLM 4.7 FlashnoneOwl AlphamediumvsGLM 5.1none