Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.4 vs Z.ai: GLM 5

Summary

GPT-5.4 vs GLM 5 benchmark comparison: GLM 5 leads on average score with 6.0 vs 5.8. GLM 5 has the lower benchmark cost at $0.027 vs $0.122. GPT-5.4 is faster at 1.42s vs 4.03s, with pass rates of 36.5% vs 44.4%.

Recommended model: GLM 5 - It has the best score here (6.0), while costing about 4.7x less than GPT-5.4.

Last updated at: 2026-06-18

Metric GPT-5.4 GPT-5.4 none Release: 2026-03-05 GLM 5 GLM 5 none Release: 2026-02-12
Score 5.8 6.0
Rank #112 #101
Reliability 10.0 10.0
Consistency 9.2 9.7
Tests Correct
Attempt pass rate 36.5% 44.4%
Flaky tests 2 1
Total Runs 63 63
Cost per result 1.740 0.263
Total Cost $0.122 $0.027
Input Price $2.500 / 1M $0.600 / 1M
Output Price $15.000 / 1M $1.920 / 1M
Total Input Tokens 34,212 37,135
Output Tokens 2,417 1,989
Reasoning Tokens 0 0
Response Time (avg) 1.42s 4.03s
Response Time (max) 2.95s 11.07s
Response Time (total) 29.87s 56.37s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#112 GPT-5.4

none
Cost
$0.026
Time
18.1s
Tokens
1,792 tok

#101 GLM 5

none
Cost
$0.007
Time
32.1s
Tokens
2,023 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 3.2 8.0 8.3% 1 1.21s 606 406 0
GLM 5 4.8 10.0 25.0% 0 2.37s 510 275 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 5.5 10.0 33.3% 0 1.62s 7,305 516 0
GLM 5 4.0 7.8 11.1% 1 5.12s 7,256 428 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 3.0 10.0 0.0% 0 2.89s 11,019 291 0
GLM 5 3.0 10.0 0.0% 0 4.98s 12,812 406 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 1.04s 7,140 222 0
GLM 5 10.0 10.0 100.0% 0 5.78s 7,107 203 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 5.3 7.2 44.4% 1 1.07s 723 50 0
GLM 5 3.0 10.0 0.0% 0 2.24s 643 19 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 4.4 9.9 0.0% 0 1.78s 477 184 0
GLM 5 10.0 10.0 100.0% 0 3.27s 477 103 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 6.5 10.0 50.0% 0 1.07s 660 81 0
GLM 5 10.0 10.0 100.0% 0 1.48s 636 61 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 5.6 9.8 33.3% 0 1.44s 642 381 0
GLM 5 7.7 10.0 66.7% 0 1.91s 609 261 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 2.75s 5,445 246 0
GLM 5 10.0 10.0 100.0% 0 11.07s 6,899 220 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 3.0 10.0 0.0% 0 990ms 195 40 0
GLM 5 3.0 10.0 0.0% 0 3.62s 186 13 0

Quick Compare

Switch Comparison Pair

North Mini CodemediumFree AvailablevsGPT-5.4noneNorth Mini CodemediumFree AvailablevsGLM 5noneGemini 3.1 Flash LiteminimalvsGLM 5noneQwen3.5-35B-A3BmediumvsGLM 5noneGemma 4 31BmediumFree AvailablevsGLM 5noneGemini 3.1 Flash LiteminimalvsGPT-5.4noneNemotron 3 SupermediumFree AvailablevsGLM 5noneGemini 3.1 Flash LitelowvsGLM 5noneGPT-5.4nonevsQwen3.5-35B-A3BmediumGemini 3.1 Flash Lite PreviewlowvsGLM 5noneGemma 4 31BmediumFree AvailablevsGPT-5.4noneNemotron 3 SupermediumFree AvailablevsGPT-5.4none