Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.4 vs Z.ai: GLM 5

Summary

GPT-5.4 vs GLM 5 benchmark comparison: The average score is effectively tied at 8.5 vs 8.6. GLM 5 has the lower benchmark cost at $0.228 vs $1.210. GPT-5.4 is faster at 22.35s vs 33.54s, with pass rates of 76.2% vs 82.5%.

Recommended model: GLM 5 - It has the best score here (8.6), while costing about 5.3x less than GPT-5.4.

Last updated at: 2026-07-02

Metric GPT-5.4 GPT-5.4 medium Release: 2026-03-05 GLM 5 GLM 5 medium Release: 2026-02-12
Score 8.5 8.6
Rank #17 #15
Reliability 10.0 10.0
Consistency 8.6 8.5
Tests Correct
Attempt pass rate 76.2% 82.5%
Flaky tests 4 4
Total Runs 63 63
Cost per result 8.640 1.668
Total Cost $1.210 $0.228
Input Price $2.500 / 1M $0.600 / 1M
Output Price $15.000 / 1M $1.920 / 1M
Total Input Tokens 34,108 35,224
Output Tokens 2,242 21,570
Reasoning Tokens 72,707 102,996
Response Time (avg) 22.35s 33.54s
Response Time (max) 100.41s 99.85s
Response Time (total) 469.29s 435.99s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#17 GPT-5.4

medium
Cost
$0.214
Time
199.6s
Tokens
14,349 tok

#15 GLM 5

medium
Cost
$0.005
Time
20.7s
Tokens
2,068 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 8.3 10.0 75.0% 0 4.11s 606 240 1,511
GLM 5 10.0 10.0 100.0% 0 23.66s 555 480 7,056
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 8.8 7.8 88.9% 1 44.36s 7,305 433 24,216
GLM 5 10.0 10.0 100.0% 0 74.30s 7,254 2,997 52,930
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 20.57s 11,019 301 3,543
GLM 5 10.0 10.0 100.0% 0 28.96s 12,804 662 3,242
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 5.32s 7,140 234 804
GLM 5 7.1 5.6 83.3% 1 8.90s 5,508 567 3,734
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 5.3 7.2 44.4% 1 74.27s 619 61 34,748
GLM 5 3.5 4.4 33.3% 2 0ms 260 13,176 14,137
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 4.7 3.1 33.3% 1 4.92s 477 145 321
GLM 5 6.1 3.1 66.7% 1 14.69s 477 2,020 2,248
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 3.11s 660 93 897
GLM 5 10.0 10.0 100.0% 0 7.25s 636 1,001 2,129
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 8.2 7.2 88.9% 1 9.14s 642 441 3,815
GLM 5 10.0 10.0 100.0% 0 11.33s 609 33 4,076
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 13.28s 5,445 264 1,031
GLM 5 10.0 10.0 100.0% 0 15.93s 6,935 233 994
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 3.0 10.0 0.0% 0 13.95s 195 30 1,821
GLM 5 3.0 10.0 0.0% 0 67.37s 186 401 12,450

Quick Compare

Switch Comparison Pair

GPT-5.2 ChatnonevsGLM 5mediumDeepSeek V4 FlashhighvsGPT-5.4mediumDeepSeek V4 FlashhighvsGLM 5mediumGemini 3.5 FlashlowvsGLM 5mediumGemini 3.5 FlashlowvsGPT-5.4mediumGPT-5.5lowvsGLM 5mediumClaude Opus 4.8lowvsGPT-5.4mediumClaude Opus 4.8lowvsGLM 5mediumGPT-5.4mediumvsStep 3.7 FlashlowStep 3.7 FlashlowvsGLM 5mediumDeepSeek V4 ProhighvsGPT-5.4mediumDeepSeek V4 ProhighvsGLM 5medium