Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

OpenAI: GPT-5.4 vs Z.ai: GLM 5 Turbo

Last updated at: 2026-05-01

Metric GPT-5.4 GPT-5.4 medium Release: 2026-03-05 GLM 5 Turbo GLM 5 Turbo medium Release: 2026-03-15
Score 8.2 8.1
Rank #23 #25
Reliability N/A N/A
Consistency 8.7 8.0
Tests Correct
Attempt pass rate 79.6% 77.8%
Flaky tests 3 5
Total Runs 54 54
Cost per result 6.399 1.511
Total Cost $0.832 $0.182
Input Price $2.500 / 1M $1.200 / 1M
Output Price $15.000 / 1M $4.000 / 1M
Output Tokens 2,169 12,197
Reasoning Tokens 48,732 38,933
Response Time (avg) 18.63s 17.67s
Response Time (max) 100.41s 194.23s
Response Time (total) 335.26s 317.98s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 8.3 10.0 75.0% 0 4.11s 240 1,511
GLM 5 Turbo 10.0 10.0 100.0% 0 4.82s 362 3,137
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 13.03s 389 2,045
GLM 5 Turbo 10.0 10.0 100.0% 0 12.26s 332 3,301
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 20.57s 301 3,543
GLM 5 Turbo 10.0 10.0 100.0% 0 13.88s 390 2,037
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 5.32s 234 804
GLM 5 Turbo 10.0 10.0 100.0% 0 6.19s 577 3,632
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 5.3 7.2 44.4% 1 74.27s 61 34,748
GLM 5 Turbo 2.9 4.4 22.2% 2 71.07s 9,665 19,279
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 4.7 3.1 33.3% 1 4.92s 145 321
GLM 5 Turbo 6.1 3.1 66.7% 1 10.05s 60 2,216
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 3.11s 93 897
GLM 5 Turbo 10.0 10.0 100.0% 0 5.38s 255 2,183
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 8.2 7.2 88.9% 1 9.13s 442 3,832
GLM 5 Turbo 7.3 5.8 55.6% 2 5.44s 315 2,702
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 13.28s 264 1,031
GLM 5 Turbo 10.0 10.0 100.0% 0 9.84s 241 446

Quick Compare

Switch Comparison Pair

HY3 PreviewlowFree AvailablevsGLM 5 TurbomediumGemini 3 Flash PreviewnonevsGLM 5 TurbomediumGemini 3.1 Flash Lite PreviewlowvsGLM 5 TurbomediumGPT-5.4mediumvsHY3 PreviewlowFree AvailableGemini 3 Flash PreviewnonevsGPT-5.4mediumGemini 3.1 Flash Lite PreviewlowvsGPT-5.4mediumGPT-5.2 ChatnonevsGLM 5 TurbomediumGemini 3.1 Flash Lite PreviewnonevsGLM 5 TurbomediumGPT-5.3 ChatnonevsGLM 5 TurbomediumDeepSeek V4 FlashhighvsGLM 5 TurbomediumGemini 3.1 Flash Lite PreviewnonevsGPT-5.4mediumDeepSeek V4 FlashhighvsGPT-5.4medium