Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.2 Chat vs Z.ai: GLM 5.1

Last updated at: 2026-05-22

Metric GPT-5.2 Chat GPT-5.2 Chat none Release: 2025-12-11 GLM 5.1 GLM 5.1 medium Release: 2026-04-07
Score 7.6 7.4
Rank #43 #51
Reliability 10.0 3.3
Consistency 8.5 8.3
Tests Correct
Attempt pass rate 71.7% 71.7%
Flaky tests 4 4
Total Runs 60 60
Cost per result 2.955 2.379
Total Cost $0.355 $0.286
Input Price $1.750 / 1M $0.980 / 1M
Output Price $14.000 / 1M $3.080 / 1M
Output Tokens 21,371 11,475
Reasoning Tokens 0 71,876
Response Time (avg) 6.86s 32.22s
Response Time (max) 38.52s 172.60s
Response Time (total) 137.19s 612.25s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 8.7 7.9 91.7% 1 3.40s 1,807 0
GLM 5.1 10.0 10.0 100.0% 0 8.31s 401 5,122
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 8.2 6.7 83.3% 1 8.05s 4,131 0
GLM 5.1 4.7 1.6 66.7% 2 145.56s 4,727 34,384
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 10.0 10.0 100.0% 0 9.12s 1,243 0
GLM 5.1 9.5 10.0 100.0% 0 43.11s 327 4,206
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 10.0 10.0 100.0% 0 3.05s 980 0
GLM 5.1 10.0 10.0 100.0% 0 9.33s 991 4,552
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 5.3 10.0 33.3% 0 17.78s 7,810 0
GLM 5.1 5.3 10.0 33.3% 0 29.77s 969 11,314
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 4.4 3.0 33.3% 1 3.20s 335 0
GLM 5.1 10.0 10.0 100.0% 0 20.95s 2,875 2,875
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 7.3 5.9 83.3% 1 5.46s 1,528 0
GLM 5.1 6.4 5.8 66.7% 1 7.47s 204 1,617
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 7.7 10.0 66.7% 0 4.42s 1,743 0
GLM 5.1 8.2 7.2 88.9% 1 23.85s 899 5,627
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 10.0 10.0 100.0% 0 4.68s 555 0
GLM 5.1 3.0 10.0 0.0% 0 0ms 0 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.2 Chat 3.0 10.0 0.0% 0 6.89s 1,239 0
GLM 5.1 3.0 10.0 0.0% 0 29.40s 82 2,179

Quick Compare

Switch Comparison Pair

GPT-5.2 ChatnonevsQwen3.5 Plus 2026-04-20mediumGemini 3.1 Flash LitelowvsGLM 5.1mediumGemini 3.1 Flash Lite PreviewlowvsGPT-5.2 ChatnoneGPT-5.3 ChatnonevsGLM 5.1mediumGPT-5.2 ChatnonevsMiMo-V2.5-PromediumGPT-5.2 ChatnonevsMiMo-V2-PromediumDeepSeek V4 FlashhighFree AvailablevsGLM 5.1mediumGemini 3.1 Flash Lite PreviewnonevsGLM 5.1mediumGPT-5.2 ChatnonevsGrok Build 0.1mediumClaude Sonnet 4.6mediumvsGPT-5.2 ChatnoneGPT-5.2 ChatnonevsQwen3.5-122B-A10BmediumGemini 2.5 FlashmediumvsGPT-5.2 Chatnone