Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

OpenAI: GPT-5.4 vs Z.ai: GLM 5.1

Last updated at: 2026-04-07

Metric GPT-5.4 GPT-5.4 none Release: 2026-03-05 GLM 5.1 GLM 5.1 none Release: 2026-04-07
Score 5.6 5.6
Rank #68 #67
Consistency 9.0 8.2
Tests Correct
Attempt pass rate 39.2% 39.2%
Flaky tests 2 4
Total Runs 51 51
Cost per result 1.573 1.000
Total Cost $0.095 $0.050
Input Price $2.500 / 1M $1.000 / 1M
Output Price $15.000 / 1M $3.200 / 1M
Output Tokens 1,837 3,219
Reasoning Tokens 0 0
Response Time (avg) 1.43s 4.01s
Response Time (max) 2.89s 32.57s
Response Time (total) 24.27s 68.23s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 3.2 8.0 8.3% 1 1.21s 406 0
GLM 5.1 4.0 6.3 25.0% 2 2.11s 305 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 3.0 10.0 0.0% 0 2.89s 291 0
GLM 5.1 2.8 2.1 33.3% 1 32.57s 2,129 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 1.04s 222 0
GLM 5.1 10.0 10.0 100.0% 0 1.08s 204 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 5.3 7.2 44.4% 1 1.07s 50 0
GLM 5.1 2.9 7.2 11.1% 1 1.99s 24 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 4.4 9.9 0.0% 0 1.78s 184 0
GLM 5.1 5.0 10.0 0.0% 0 790ms 39 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 6.5 10.0 50.0% 0 1.07s 81 0
GLM 5.1 8.3 10.0 50.0% 0 1.58s 66 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 5.6 9.8 33.3% 0 1.52s 357 0
GLM 5.1 5.7 10.0 33.3% 0 1.48s 152 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 10.0 10.0 100.0% 0 2.75s 246 0
GLM 5.1 10.0 10.0 100.0% 0 10.68s 300 0

Quick Compare

Switch Comparison Pair

Mistral Small 4mediumvsGPT-5.4noneMistral Small 4mediumvsGLM 5.1noneMiniMax M2.5mediumFree AvailablevsGLM 5.1noneMiniMax M2.5mediumFree AvailablevsGPT-5.4nonegpt-oss-120bmediumFree AvailablevsGLM 5.1noneGrok 4.20 Multi Agent BetamediumvsGLM 5.1noneGPT-5.4nonevsGrok 4.20 Multi Agent BetamediumGPT-5 NanomediumvsGLM 5.1noneMiniMax M2.7mediumvsGPT-5.4noneMiniMax M2.7mediumvsGLM 5.1noneMercury 2mediumvsGLM 5.1noneMercury 2mediumvsGPT-5.4none