AI BENCHY Compare

OpenAI: GPT-5.3 Chat vs Z.ai: GLM 5.1

Last updated at: 2026-05-22

Metric	GPT-5.3 Chat GPT-5.3 Chat none Release: 2026-03-03	GLM 5.1 GLM 5.1 medium Release: 2026-04-07

Metric	GPT-5.3 Chat GPT-5.3 Chat none Release: 2026-03-03	GLM 5.1 GLM 5.1 medium Release: 2026-04-07
Score	7.4	7.4
Rank	#52	#51
Reliability	10.0	3.3
Consistency	8.4	8.3
Tests Correct
Attempt pass rate	68.3%	71.7%
Flaky tests	4	4
Total Runs	60	60
Cost per result	3.342	2.379
Total Cost	$0.401	$0.286
Input Price	$1.750 / 1M	$0.980 / 1M
Output Price	$14.000 / 1M	$3.080 / 1M
Output Tokens	24,689	11,475
Reasoning Tokens	0	71,876
Response Time (avg)	6.10s	32.22s
Response Time (max)	18.33s	172.60s
Response Time (total)	121.99s	612.25s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.3 Chat	6.7	8.1	58.3%	1		3.86s	3,167	0
GLM 5.1	10.0	10.0	100.0%	0		8.31s	401	5,122

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.3 Chat	6.9	6.2	66.7%	1		10.52s	4,772	0
GLM 5.1	4.7	1.6	66.7%	2		145.56s	4,727	34,384

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.3 Chat	10.0	10.0	100.0%	0		11.96s	2,614	0
GLM 5.1	9.5	10.0	100.0%	0		43.11s	327	4,206

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.3 Chat	10.0	10.0	100.0%	0		2.21s	942	0
GLM 5.1	10.0	10.0	100.0%	0		9.33s	991	4,552

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.3 Chat	3.5	4.4	33.3%	2		13.01s	8,264	0
GLM 5.1	5.3	10.0	33.3%	0		29.77s	969	11,314

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.3 Chat	4.6	10.0	0.0%	0		1.99s	319	0
GLM 5.1	10.0	10.0	100.0%	0		20.95s	2,875	2,875

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.3 Chat	9.8	10.0	100.0%	0		3.29s	1,455	0
GLM 5.1	6.4	5.8	66.7%	1		7.47s	204	1,617

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.3 Chat	10.0	10.0	100.0%	0		2.93s	1,726	0
GLM 5.1	8.2	7.2	88.9%	1		23.85s	899	5,627

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.3 Chat	10.0	10.0	100.0%	0		8.36s	861	0
GLM 5.1	3.0	10.0	0.0%	0		0ms	0	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Output Tokens	Reasoning Tokens
GPT-5.3 Chat	3.0	10.0	0.0%	0		4.38s	569	0
GLM 5.1	3.0	10.0	0.0%	0		29.40s	82	2,179

Quick Compare

Switch Comparison Pair

GPT-5.3 ChatnonevsMiMo-V2.5medium Gemini 3.1 Flash LitelowvsGLM 5.1medium Kimi K2.6mediumvsGPT-5.3 Chatnone DeepSeek V4 FlashhighFree AvailablevsGPT-5.3 Chatnone Gemini 3.1 Flash LitelowvsGPT-5.3 Chatnone DeepSeek V4 FlashhighFree AvailablevsGLM 5.1medium GPT-5.3 ChatnonevsQwen3.5-Flashmedium GPT-5.3 ChatnonevsStep 3.5 Flashmedium Gemini 3.1 Flash Lite PreviewnonevsGLM 5.1medium GPT-5.3 ChatnonevsQwen3.6 Flashmedium GPT-5.3 ChatnonevsGLM 5V Turbomedium Gemma 4 26B A4BmediumFree AvailablevsGPT-5.3 Chatnone