Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Z.ai: GLM 5.1 vs Z.ai: GLM 5.2

Summary

GLM 5.1 vs GLM 5.2 benchmark comparison: The average score is effectively tied at 7.1 vs 7.1. GLM 5.2 has the lower benchmark cost at $0.051 vs $0.395. GLM 5.2 is faster at 6.34s vs 33.67s, with pass rates of 68.3% vs 60.3%.

Recommended model: GLM 5.2 - It has the best score here (7.1), while costing about 7.8x less than GLM 5.1.

Last updated at: 2026-07-02

Metric GLM 5.1 GLM 5.1 medium Release: 2026-04-07 GLM 5.2 GLM 5.2 none Release: 2026-06-17
Score 7.1 7.1
Rank #66 #63
Reliability 6.7 9.9
Consistency 8.3 9.6
Tests Correct
Attempt pass rate 68.3% 60.3%
Flaky tests 4 1
Total Runs 63 63
Cost per result 2.496 0.628
Total Cost $0.395 $0.051
Input Price $0.975 / 1M $0.930 / 1M
Output Price $4.301 / 1M $3.000 / 1M
Total Input Tokens 32,995 38,671
Output Tokens 11,655 4,817
Reasoning Tokens 75,421 0
Response Time (avg) 33.67s 6.34s
Response Time (max) 172.60s 20.69s
Response Time (total) 673.41s 133.19s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#66 GLM 5.1

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

#63 GLM 5.2

none
Invalid SVG
Cost
$0.033
Time
87.7s
Tokens
7,455 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GLM 5.1 10.0 10.0 100.0% 0 8.31s 555 401 5,122
GLM 5.2 8.3 10.0 75.0% 0 3.70s 567 313 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GLM 5.1 4.6 3.7 44.5% 2 109.63s 5,702 4,871 37,826
GLM 5.2 3.7 9.5 0.0% 0 7.55s 7,263 1,958 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GLM 5.1 9.5 10.0 100.0% 0 43.11s 17,298 327 4,206
GLM 5.2 10.0 10.0 100.0% 0 20.69s 14,296 1,489 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GLM 5.1 10.0 10.0 100.0% 0 9.33s 7,107 991 4,552
GLM 5.2 10.0 10.0 100.0% 0 7.17s 7,113 204 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GLM 5.1 5.3 10.0 33.3% 0 29.77s 489 969 11,314
GLM 5.2 5.3 10.0 33.3% 0 6.50s 696 27 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GLM 5.1 10.0 10.0 100.0% 0 20.95s 477 2,875 2,875
GLM 5.2 6.1 3.1 66.7% 1 4.42s 480 82 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GLM 5.1 6.4 5.8 66.7% 1 7.47s 634 204 1,617
GLM 5.2 9.8 10.0 100.0% 0 3.84s 642 66 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GLM 5.1 8.2 7.2 88.9% 1 31.64s 609 935 5,730
GLM 5.2 7.7 10.0 66.7% 0 3.31s 618 265 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GLM 5.1 3.0 10.0 0.0% 0 0ms 0 0 0
GLM 5.2 10.0 10.0 100.0% 0 15.76s 6,807 400 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GLM 5.1 3.0 10.0 0.0% 0 29.40s 124 82 2,179
GLM 5.2 3.0 10.0 0.0% 0 3.41s 189 13 0

Quick Compare

Switch Comparison Pair

Step 3.7 FlashhighvsGLM 5.1mediumGemma 4 26B A4BmediumFree AvailablevsGLM 5.2noneStep 3.7 FlashhighvsGLM 5.2noneQwen3.7 PlusnonevsGLM 5.1mediumLaguna XS 2.1mediumFree AvailablevsGLM 5.2noneDeepSeek V4 PrononevsGLM 5.1mediumGemini 3.5 FlashnonevsGLM 5.1mediumKimi K2.7 CodemediumvsGLM 5.2noneClaude Opus 4.8nonevsGLM 5.1mediumGemini 3 Flash PreviewnonevsGLM 5.1mediumGrok 4.20mediumvsGLM 5.2noneClaude Sonnet 4.6nonevsGLM 5.1medium