Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

xAI: Grok 4.20 vs Z.ai: GLM 5.1

Summary

Grok 4.20 vs GLM 5.1 benchmark comparison: Grok 4.20 leads on average score with 7.3 vs 7.1. GLM 5.1 has the lower benchmark cost at $0.292 vs $0.609. Grok 4.20 is faster at 27.68s vs 33.67s, with pass rates of 63.5% vs 68.3%.

Recommended model: GLM 5.1 - Its score stays close to the best score here (7.1 vs 7.3), while costing about 2.1x less than Grok 4.20.

Last updated at: 2026-06-18

Metric Grok 4.20 Grok 4.20 medium Release: 2026-03-31 GLM 5.1 GLM 5.1 medium Release: 2026-04-07
Score 7.3 7.1
Rank #53 #64
Reliability 10.0 6.7
Consistency 8.8 8.3
Tests Correct
Attempt pass rate 63.5% 68.3%
Flaky tests 3 4
Total Runs 63 63
Cost per result 8.309 2.496
Total Cost $0.609 $0.292
Input Price $1.250 / 1M $0.980 / 1M
Output Price $2.500 / 1M $3.080 / 1M
Total Input Tokens 44,433 32,995
Output Tokens 1,819 11,655
Reasoning Tokens 219,524 75,421
Response Time (avg) 27.68s 33.67s
Response Time (max) 199.66s 172.60s
Response Time (total) 581.26s 673.41s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#53 xAI: Grok 4.20

medium
Cost
$0.041
Time
110.3s
Tokens
16,336 tok

#64 GLM 5.1

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 8.2 7.9 83.3% 1 3.95s 2,010 287 8,312
GLM 5.1 10.0 10.0 100.0% 0 8.31s 555 401 5,122
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 6.3 6.6 55.6% 1 109.93s 8,307 268 103,150
GLM 5.1 4.6 3.7 44.5% 2 109.63s 5,702 4,871 37,826
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 10.0 10.0 100.0% 0 17.40s 12,909 232 9,556
GLM 5.1 9.5 10.0 100.0% 0 43.11s 17,298 327 4,206
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 10.0 10.0 100.0% 0 4.17s 7,761 180 5,333
GLM 5.1 10.0 10.0 100.0% 0 9.33s 7,107 991 4,552
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 5.3 10.0 33.3% 0 27.03s 1,764 375 49,339
GLM 5.1 5.3 10.0 33.3% 0 29.77s 489 969 11,314
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 3.9 2.6 33.3% 1 24.48s 825 65 6,440
GLM 5.1 10.0 10.0 100.0% 0 20.95s 477 2,875 2,875
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 9.8 10.0 100.0% 0 4.26s 1,362 57 6,419
GLM 5.1 6.4 5.8 66.7% 1 7.47s 634 204 1,617
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 7.7 10.0 66.7% 0 6.22s 1,689 149 7,913
GLM 5.1 8.2 7.2 88.9% 1 31.64s 609 935 5,730
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 3.0 10.0 0.0% 0 13.68s 7,275 197 6,620
GLM 5.1 3.0 10.0 0.0% 0 0ms 0 0 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Grok 4.20 3.0 10.0 0.0% 0 63.48s 531 9 16,442
GLM 5.1 3.0 10.0 0.0% 0 29.40s 124 82 2,179

Quick Compare

Switch Comparison Pair

Step 3.7 FlashhighvsGLM 5.1mediumGemini 3 Flash PreviewlowvsGrok 4.20mediumClaude Sonnet 4.6nonevsGrok 4.20mediumQwen3.7 PlusnonevsGLM 5.1mediumDeepSeek V4 PrononevsGLM 5.1mediumGemini 3.5 FlashnonevsGLM 5.1mediumClaude Opus 4.8nonevsGrok 4.20mediumClaude Opus 4.8nonevsGLM 5.1mediumGPT-5.3 ChatnonevsGrok 4.20mediumDeepSeek V4 PrononevsGrok 4.20mediumGemini 3 Flash PreviewnonevsGLM 5.1mediumQwen3.7 PlusnonevsGrok 4.20medium