Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.4 vs Z.ai: GLM 5.2

Summary

GPT-5.4 vs GLM 5.2 benchmark comparison: GLM 5.2 leads on average score with 8.7 vs 8.5. GLM 5.2 has the lower benchmark cost at $0.324 vs $1.210. GPT-5.4 is faster at 22.35s vs 23.28s, with pass rates of 76.2% vs 84.1%.

Recommended model: GLM 5.2 - It has the best score here (8.7), while costing about 3.7x less than GPT-5.4.

Last updated at: 2026-06-17

Metric GPT-5.4 GPT-5.4 medium Release: 2026-03-05 GLM 5.2 GLM 5.2 medium Release: 2026-06-17
Score 8.5 8.7
Rank #17 #14
Reliability 10.0 9.5
Consistency 8.6 8.4
Tests Correct
Attempt pass rate 76.2% 84.1%
Flaky tests 4 4
Total Runs 63 63
Cost per result 8.640 2.159
Total Cost $1.210 $0.324
Input Price $2.500 / 1M $1.400 / 1M
Output Price $15.000 / 1M $4.400 / 1M
Total Input Tokens 34,108 37,199
Output Tokens 2,242 12,261
Reasoning Tokens 72,707 49,500
Response Time (avg) 22.35s 23.28s
Response Time (max) 100.41s 101.36s
Response Time (total) 469.29s 488.94s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#17 GPT-5.4

medium
Cost
$0.214
Time
199.6s
Tokens
14,349 tok

#14 GLM 5.2

medium
Cost
$0.041
Time
195.8s
Tokens
9,287 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 8.3 10.0 75.0% 0 4.11s 606 240 1,511
GLM 5.2 10.0 10.0 100.0% 0 5.89s 639 497 2,634
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 8.8 7.8 88.9% 1 44.36s 7,305 433 24,216
GLM 5.2 8.2 7.2 88.9% 1 40.96s 7,317 1,475 17,123
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 20.57s 11,019 301 3,543
GLM 5.2 10.0 10.0 100.0% 0 51.96s 12,696 458 4,531
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 5.32s 7,140 234 804
GLM 5.2 10.0 10.0 100.0% 0 13.44s 7,149 348 2,345
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 5.3 7.2 44.4% 1 74.27s 619 61 34,748
GLM 5.2 4.1 4.4 44.5% 2 45.47s 551 8,188 11,606
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 4.7 3.1 33.3% 1 4.92s 477 145 321
GLM 5.2 10.0 10.0 100.0% 0 17.39s 498 54 1,842
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 3.11s 660 93 897
GLM 5.2 9.9 10.0 100.0% 0 7.90s 678 94 1,518
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 8.2 7.2 88.9% 1 9.14s 642 441 3,815
GLM 5.2 8.2 7.2 88.9% 1 13.13s 672 536 4,822
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 13.28s 5,445 264 1,031
GLM 5.2 10.0 10.0 100.0% 0 20.41s 6,861 230 550
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 3.0 10.0 0.0% 0 13.95s 195 30 1,821
GLM 5.2 3.0 10.0 0.0% 0 34.25s 138 381 2,529

Quick Compare

Switch Comparison Pair

GPT-5.2 ChatnonevsGLM 5.2mediumDeepSeek V4 FlashhighvsGPT-5.4mediumDeepSeek V4 FlashhighvsGLM 5.2mediumGemini 3.5 FlashlowvsGLM 5.2mediumGPT-5.5lowvsGLM 5.2mediumGemini 3.5 FlashlowvsGPT-5.4mediumGPT-5.4mediumvsStep 3.7 FlashlowDeepSeek V4 ProhighvsGPT-5.4mediumStep 3.7 FlashlowvsGLM 5.2mediumDeepSeek V4 ProhighvsGLM 5.2mediumGemini 3 Flash PreviewlowvsGPT-5.4mediumGPT-5.3 ChatnonevsGLM 5.2medium