Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.6 Sol vs Z.ai: GLM 5.2

Summary

GPT-5.6 Sol (high) vs GLM 5.2 (medium) benchmark comparison: GPT-5.6 Sol (high) leads on average score with 9.4 vs 8.7. GLM 5.2 (medium) has the lower benchmark cost at $0.129 vs $0.821. GPT-5.6 Sol (high) is faster at 10.56s vs 23.28s, with pass rates of 88.9% vs 84.1%.

Recommended model: GPT-5.6 Sol (high) - It has the best score here (9.4), while responding about 2.2x faster than GLM 5.2 (medium).

Last updated at: 2026-07-09

Metric GPT-5.6 Sol GPT-5.6 Sol high Release: 2026-07-09 GLM 5.2 GLM 5.2 medium Release: 2026-06-17
Score 9.4 8.7
Rank #6 #17
Reliability 10.0 9.5
Consistency 8.8 8.4
Tests Correct
Attempt pass rate 88.9% 84.1%
Flaky tests 3 4
Total Runs 63 63
Cost per result 4.824 2.159
Total Cost $0.821 $0.129
Input Price $5.000 / 1M $0.540 / 1M
Output Price $30.000 / 1M $1.760 / 1M
Total Input Tokens 34,114 37,199
Output Tokens 1,872 12,261
Reasoning Tokens 19,777 49,500
Response Time (avg) 10.56s 23.28s
Response Time (max) 54.79s 101.36s
Response Time (total) 221.69s 488.94s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#6 GPT-5.6 Sol

high
Cost
$0.151
Time
201.9s
Tokens
5,100 tok

#17 GLM 5.2

medium
Cost
$0.041
Time
195.8s
Tokens
9,287 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 8.7 7.9 91.7% 1 3.39s 606 171 644
GLM 5.2 10.0 10.0 100.0% 0 5.89s 639 497 2,634
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 10.0 10.0 100.0% 0 12.52s 7,302 404 5,656
GLM 5.2 8.2 7.2 88.9% 1 40.96s 7,317 1,475 17,123
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 10.0 10.0 100.0% 0 13.68s 11,019 315 1,599
GLM 5.2 10.0 10.0 100.0% 0 51.96s 12,696 458 4,531
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 10.0 10.0 100.0% 0 1.16s 7,140 222 0
GLM 5.2 10.0 10.0 100.0% 0 13.44s 7,149 348 2,345
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 5.3 7.2 44.4% 1 39.45s 619 62 9,556
GLM 5.2 4.1 4.4 44.5% 2 45.47s 551 8,188 11,606
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 10.0 10.0 100.0% 0 4.40s 477 97 238
GLM 5.2 10.0 10.0 100.0% 0 17.39s 498 54 1,842
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 10.0 10.0 100.0% 0 2.73s 660 96 331
GLM 5.2 9.9 10.0 100.0% 0 7.90s 678 94 1,518
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 10.0 10.0 100.0% 0 4.10s 642 211 675
GLM 5.2 8.2 7.2 88.9% 1 13.13s 672 536 4,822
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 10.0 10.0 100.0% 0 7.08s 5,454 264 393
GLM 5.2 10.0 10.0 100.0% 0 20.41s 6,861 230 550
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 4.7 1.6 66.7% 1 6.97s 195 30 685
GLM 5.2 3.0 10.0 0.0% 0 34.25s 138 381 2,529

Quick Compare

Switch Comparison Pair

GPT-5.6 SolhighvsQwen3.7 MaxmediumGemini 3.5 FlashlowvsGPT-5.6 SolhighClaude Fable 5mediumvsGPT-5.6 SolhighGemini 3.1 Pro PreviewmediumvsGPT-5.6 SolhighGPT-5.2 ChatnonevsGLM 5.2mediumGemini 3.5 FlashmediumvsGPT-5.6 SolhighGemini 3 Flash PreviewmediumvsGPT-5.6 SolhighDeepSeek V4 FlashhighvsGLM 5.2mediumGPT-5.6 SolhighvsQwen3.6 Max PreviewmediumGPT-5.6 TerrahighvsGLM 5.2mediumClaude Opus 4.8mediumvsGPT-5.6 SolhighGemini 3.5 FlashlowvsGLM 5.2medium