Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

OpenAI: GPT-5.4 vs Z.ai: GLM 5 Turbo

Last updated at: 2026-03-17

Metric GPT-5.4 GPT-5.4 medium Release: 2026-03-05 GLM 5 Turbo GLM 5 Turbo medium Release: 2026-03-15
Rank #15 #16
Score 8.1 8.0
Consistency 8.6 7.9
Cost per result 6.613 1.509
Total Cost $0.794 $0.166
Tests Correct
Attempt pass rate 78.4% 76.5%
Flaky tests 3 5
Total Runs 51 51
Output Tokens 1,780 11,865
Reasoning Tokens 46,687 35,632
Response Time (avg) 18.95s 17.98s
Response Time (max) 100.41s 194.23s
Response Time (total) 322.23s 305.72s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 8.3 10.0 75.0% 0 4.11s 240 1,511
GLM 5 Turbo 10.0 10.0 100.0% 0 4.82s 362 3,137
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 20.57s 301 3,543
GLM 5 Turbo 10.0 10.0 100.0% 0 13.88s 390 2,037
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 5.32s 234 804
GLM 5 Turbo 10.0 10.0 100.0% 0 6.19s 577 3,632
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 5.3 7.2 44.4% 1 74.27s 61 34,748
GLM 5 Turbo 2.9 4.4 22.2% 2 71.07s 9,665 19,279
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 4.7 3.1 33.3% 1 4.92s 145 321
GLM 5 Turbo 6.1 3.1 66.7% 1 10.05s 60 2,216
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 3.11s 93 897
GLM 5 Turbo 10.0 10.0 100.0% 0 5.38s 255 2,183
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 8.2 7.2 88.9% 1 9.13s 442 3,832
GLM 5 Turbo 7.3 5.8 55.6% 2 5.44s 315 2,702
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 13.28s 264 1,031
GLM 5 Turbo 10.0 10.0 100.0% 0 9.84s 241 446

Quick Compare

Switch Comparison Pair

Gemini 3.1 Flash Lite PreviewlowvsGLM 5 TurbomediumGemini 3 Flash PreviewnonevsGLM 5 TurbomediumGemini 3.1 Flash Lite PreviewlowvsGPT-5.4mediumGemini 3 Flash PreviewnonevsGPT-5.4mediumGemini 3.1 Flash Lite PreviewnonevsGLM 5 TurbomediumGPT-5.2 ChatnonevsGLM 5 TurbomediumGemini 3.1 Flash Lite PreviewnonevsGPT-5.4mediumGPT-5.3 ChatnonevsGLM 5 TurbomediumGemini 3 Flash PreviewlowvsGPT-5.4mediumGemini 3 Flash PreviewlowvsGLM 5 TurbomediumClaude Sonnet 4.6nonevsGLM 5 TurbomediumClaude Sonnet 4.6nonevsGPT-5.4medium