Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

OpenAI: GPT-5.3 Chat vs Z.ai: GLM 5.1

Last updated at: 2026-04-07

Metric GPT-5.3 Chat GPT-5.3 Chat none Release: 2026-03-03 GLM 5.1 GLM 5.1 medium Release: 2026-04-07
Score 7.6 8.0
Rank #34 #23
Consistency 8.6 9.0
Tests Correct
Attempt pass rate 66.7% 76.5%
Flaky tests 3 2
Total Runs 51 51
Cost per result 3.177 1.270
Total Cost $0.318 $0.153
Input Price $1.750 / 1M $1.000 / 1M
Output Price $14.000 / 1M $3.200 / 1M
Output Tokens 19,348 6,666
Reasoning Tokens 0 35,313
Response Time (avg) 5.68s 18.23s
Response Time (max) 18.33s 43.11s
Response Time (total) 96.58s 291.73s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.3 Chat 6.7 8.1 58.3% 1 3.86s 3,167 0
GLM 5.1 10.0 10.0 100.0% 0 8.31s 401 5,122
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.3 Chat 10.0 10.0 100.0% 0 11.96s 2,614 0
GLM 5.1 9.5 10.0 100.0% 0 43.11s 327 4,206
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.3 Chat 10.0 10.0 100.0% 0 2.21s 942 0
GLM 5.1 10.0 10.0 100.0% 0 9.33s 991 4,552
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.3 Chat 3.5 4.4 33.3% 2 13.01s 8,264 0
GLM 5.1 5.3 10.0 33.3% 0 29.77s 969 11,314
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.3 Chat 4.6 10.0 0.0% 0 1.99s 319 0
GLM 5.1 10.0 10.0 100.0% 0 20.95s 2,875 2,875
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.3 Chat 8.3 10.0 50.0% 0 3.29s 1,455 0
GLM 5.1 6.4 5.8 66.7% 1 7.47s 204 1,617
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.3 Chat 10.0 10.0 100.0% 0 2.93s 1,726 0
GLM 5.1 8.2 7.2 88.9% 1 23.85s 899 5,627
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.3 Chat 10.0 10.0 100.0% 0 8.36s 861 0
GLM 5.1 3.0 10.0 0.0% 0 0ms 0 0

Quick Compare

Switch Comparison Pair

Gemini 3 Flash PreviewnonevsGLM 5.1mediumGemini 3.1 Flash Lite PreviewlowvsGLM 5.1mediumGPT-5.3 ChatnonevsMiMo-V2-FlashmediumClaude Opus 4.6mediumvsGPT-5.3 ChatnoneGPT-5.3 ChatnonevsGLM 5V TurbomediumGemini 3.1 Flash Lite PreviewnonevsGLM 5.1mediumGPT-5.2 ChatnonevsGLM 5.1mediumSeed-2.0-MinimediumvsGPT-5.3 ChatnoneGPT-5.3 ChatnonevsQwen3.5-35B-A3BmediumGPT-5.3 ChatnonevsStep 3.5 FlashmediumFree AvailableGPT-5.3 ChatnonevsGrok 4.20 BetamediumGPT-5.3 ChatnonevsMiMo-V2-Omnimedium