Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

xAI: Grok 4.20 vs Z.ai: GLM 5.2

Summary

Grok 4.20 vs GLM 5.2 benchmark comparison: Grok 4.20 leads on average score with 7.3 vs 7.1. GLM 5.2 has the lower benchmark cost at $0.076 vs $0.609. GLM 5.2 is faster at 6.34s vs 27.68s, with pass rates of 63.5% vs 60.3%.

Recommended model: GLM 5.2 - Its score stays close to the best score here (7.1 vs 7.3), while costing about 8.1x less than Grok 4.20.

Last updated at: 2026-06-17

Metric Grok 4.20 Grok 4.20 medium Release: 2026-03-31 GLM 5.2 GLM 5.2 none Release: 2026-06-17
Score 7.3 7.1
Rank #53 #61
Reliability 10.0 9.9
Consistency 8.8 9.6
Tests Correct
Attempt pass rate 63.5% 60.3%
Flaky tests 3 1
Total Runs 63 63
Cost per result 8.309 0.628
Total Cost $0.609 $0.076
Input Price $1.250 / 1M $1.400 / 1M
Output Price $2.500 / 1M $4.400 / 1M
Total Input Tokens 44,433 38,671
Output Tokens 1,819 4,817
Reasoning Tokens 219,524 0
Response Time (avg) 27.68s 6.34s
Response Time (max) 199.66s 20.69s
Response Time (total) 581.26s 133.19s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#53 xAI: Grok 4.20

medium
Cost
$0.041
Time
110.3s
Tokens
16,336 tok

#61 GLM 5.2

none
Invalid SVG
Cost
$0.033
Time
87.7s
Tokens
7,455 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 8.2 7.9 83.3% 1 3.95s 2,010 287 8,312
GLM 5.2 8.3 10.0 75.0% 0 3.70s 567 313 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 6.3 6.6 55.6% 1 109.93s 8,307 268 103,150
GLM 5.2 3.7 9.5 0.0% 0 7.55s 7,263 1,958 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 10.0 10.0 100.0% 0 17.40s 12,909 232 9,556
GLM 5.2 10.0 10.0 100.0% 0 20.69s 14,296 1,489 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 10.0 10.0 100.0% 0 4.17s 7,761 180 5,333
GLM 5.2 10.0 10.0 100.0% 0 7.17s 7,113 204 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 5.3 10.0 33.3% 0 27.03s 1,764 375 49,339
GLM 5.2 5.3 10.0 33.3% 0 6.50s 696 27 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 3.9 2.6 33.3% 1 24.48s 825 65 6,440
GLM 5.2 6.1 3.1 66.7% 1 4.42s 480 82 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 9.8 10.0 100.0% 0 4.26s 1,362 57 6,419
GLM 5.2 9.8 10.0 100.0% 0 3.84s 642 66 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 7.7 10.0 66.7% 0 6.22s 1,689 149 7,913
GLM 5.2 7.7 10.0 66.7% 0 3.31s 618 265 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 3.0 10.0 0.0% 0 13.68s 7,275 197 6,620
GLM 5.2 10.0 10.0 100.0% 0 15.76s 6,807 400 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 3.0 10.0 0.0% 0 63.48s 531 9 16,442
GLM 5.2 3.0 10.0 0.0% 0 3.41s 189 13 0

Quick Compare

Switch Comparison Pair

Gemini 3 Flash PreviewlowvsGrok 4.20mediumGemma 4 26B A4BmediumFree AvailablevsGLM 5.2noneClaude Sonnet 4.6nonevsGrok 4.20mediumMiMo-V2-FlashmediumvsGLM 5.2noneStep 3.7 FlashhighvsGLM 5.2noneClaude Opus 4.8nonevsGrok 4.20mediumKimi K2.7 CodemediumvsGLM 5.2noneGPT-5.3 ChatnonevsGrok 4.20mediumDeepSeek V4 PrononevsGrok 4.20mediumQwen3.7 PlusnonevsGrok 4.20mediumGemini 3 Flash PreviewlowvsGLM 5.2noneStep 3.7 FlashhighvsGrok 4.20medium