AI BENCHY Compare

OpenAI: GPT-5.2 Chat vs Z.ai: GLM 5

Last updated at: 2026-06-02

Metric	GPT-5.2 Chat GPT-5.2 Chat none Release: 2025-12-11	GLM 5 GLM 5 medium Release: 2026-02-12

Metric	GPT-5.2 Chat GPT-5.2 Chat none Release: 2025-12-11	GLM 5 GLM 5 medium Release: 2026-02-12
Score	7.9	8.2
Rank	#32	#19
Reliability	10.0	10.0
Consistency	8.9	8.4
Tests Correct
Attempt pass rate	73.3%	81.7%
Flaky tests	3	4
Total Runs	60	60
Cost per result	2.703	1.676
Total Cost	$0.352	$0.228
Input Price	$1.750 / 1M	$0.600 / 1M
Output Price	$14.000 / 1M	$2.080 / 1M
Total Input Tokens	31,593	32,626
Output Tokens	21,144	21,558
Reasoning Tokens	0	95,772
Response Time (avg)	6.82s	32.67s
Response Time (max)	38.52s	99.85s
Response Time (total)	136.34s	392.01s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	8.7	7.9	91.7%	1		3.40s	606	1,807	0
GLM 5	10.0	10.0	100.0%	0		23.66s	555	480	7,056

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	8.2	6.7	83.3%	1		8.05s	4,686	4,131	0
GLM 5	10.0	10.0	100.0%	0		89.47s	4,656	2,985	45,706

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	10.0	10.0	100.0%	0		9.12s	11,019	1,243	0
GLM 5	10.0	10.0	100.0%	0		28.96s	12,804	662	3,242

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	10.0	10.0	100.0%	0		3.05s	7,140	980	0
GLM 5	7.1	5.6	83.3%	1		8.90s	5,508	567	3,734

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	5.3	10.0	33.3%	0		17.78s	723	7,810	0
GLM 5	3.5	4.4	33.3%	2		0ms	260	13,176	14,137

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	4.4	3.0	33.3%	1		3.20s	477	335	0
GLM 5	6.1	3.1	66.7%	1		14.69s	477	2,020	2,248

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	9.8	10.0	100.0%	0		5.51s	660	1,441	0
GLM 5	10.0	10.0	100.0%	0		7.25s	636	1,001	2,129

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	7.7	10.0	66.7%	0		4.10s	642	1,603	0
GLM 5	10.0	10.0	100.0%	0		11.33s	609	33	4,076

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	10.0	10.0	100.0%	0		4.68s	5,445	555	0
GLM 5	10.0	10.0	100.0%	0		15.93s	6,935	233	994

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.2 Chat	3.0	10.0	0.0%	0		6.89s	195	1,239	0
GLM 5	3.0	10.0	0.0%	0		67.37s	186	401	12,450

Quick Compare

Switch Comparison Pair

Gemma 4 26B A4BmediumFree AvailablevsGPT-5.2 Chatnone GPT-5.2 ChatnonevsStep 3.7 Flashmedium GPT-5.2 ChatnonevsGLM 5 Turbomedium GPT-5.2 ChatnonevsQwen3.5-27Bmedium GPT-5.2 ChatnonevsQwen3.6 35B A3Bmedium GPT-5.2 ChatnonevsGrok 4.3medium Gemini 3.5 FlashminimalvsGPT-5.2 Chatnone GPT-5.2 ChatnonevsQwen3.6 Plusmedium Gemma 4 31BmediumFree AvailablevsGPT-5.2 Chatnone Gemini 3.1 Flash Lite PreviewmediumvsGPT-5.2 Chatnone Gemini 3.1 Flash LitemediumvsGPT-5.2 Chatnone Gemini 2.5 FlashmediumvsGPT-5.2 Chatnone