Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Anthropic: Claude Sonnet 4.6 vs Z.ai: GLM 5.2

Summary

Claude Sonnet 4.6 (medium) vs GLM 5.2 (high) benchmark comparison: GLM 5.2 (high) leads on average score with 8.0 vs 7.8. GLM 5.2 (high) has the lower benchmark cost at $0.554 vs $1.418. Claude Sonnet 4.6 (medium) is faster at 17.06s vs 37.09s, with pass rates of 65.1% vs 77.8%.

Recommended model: GLM 5.2 (high) - It has the best score here (8.0), while costing about 2.6x less than Claude Sonnet 4.6 (medium).

Last updated at: 2026-07-10

Metric Claude Sonnet 4.6 Claude Sonnet 4.6 medium Release: 2026-02-17 GLM 5.2 GLM 5.2 high Release: 2026-06-17
Score 7.8 8.0
Rank #39 #32
Reliability 10.0 9.3
Consistency 9.1 7.6
Tests Correct
Attempt pass rate 65.1% 77.8%
Flaky tests 2 6
Total Runs 63 63
Cost per result 10.904 4.255
Total Cost $1.418 $0.554
Input Price $3.000 / 1M $0.770 / 1M
Output Price $15.000 / 1M $2.420 / 1M
Total Input Tokens 49,112 34,993
Output Tokens 54,703 51,575
Reasoning Tokens 29,970 166,065
Response Time (avg) 17.06s 37.09s
Response Time (max) 46.35s 180.69s
Response Time (total) 221.83s 778.91s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#39 Claude Sonnet 4.6

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

#32 GLM 5.2

high
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Sonnet 4.6 6.5 10.0 50.0% 0 2.98s 789 1,046 1,093
GLM 5.2 10.0 10.0 100.0% 0 5.80s 639 406 2,660
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Sonnet 4.6 5.7 6.6 44.4% 1 33.29s 6,995 16,089 3,686
GLM 5.2 6.4 4.4 77.8% 2 73.03s 5,124 2,302 22,546
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Sonnet 4.6 10.0 10.0 100.0% 0 46.35s 18,351 5,871 3,962
GLM 5.2 10.0 10.0 100.0% 0 43.51s 12,696 711 4,267
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Sonnet 4.6 10.0 10.0 100.0% 0 13.90s 8,676 649 742
GLM 5.2 10.0 10.0 100.0% 0 5.81s 7,143 435 1,414
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Sonnet 4.6 2.9 7.2 11.1% 1 0ms 471 25,790 16,919
GLM 5.2 3.5 4.4 33.3% 2 73.97s 551 46,693 90,566
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Sonnet 4.6 10.0 10.0 100.0% 0 4.94s 564 256 433
GLM 5.2 10.0 10.0 100.0% 0 12.90s 498 63 1,743
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Sonnet 4.6 10.0 10.0 100.0% 0 2.61s 792 318 552
GLM 5.2 10.0 10.0 100.0% 0 4.26s 678 151 1,210
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Sonnet 4.6 10.0 10.0 100.0% 0 5.31s 816 592 646
GLM 5.2 6.0 4.6 66.7% 2 33.71s 665 568 22,392
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Sonnet 4.6 10.0 10.0 100.0% 0 7.48s 11,454 655 351
GLM 5.2 10.0 10.0 100.0% 0 9.25s 6,861 246 503
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Sonnet 4.6 3.0 10.0 0.0% 0 30.09s 204 3,437 1,586
GLM 5.2 3.0 10.0 0.0% 0 127.82s 138 0 18,764

Quick Compare

Switch Comparison Pair

Claude Sonnet 4.6mediumvsGrok 4.5lowGPT-5.4 MinimediumvsGLM 5.2highQwen3.5 Plus 2026-02-15mediumvsGLM 5.2highNemotron 3 Ultra 550b A55bmediumFree AvailablevsGLM 5.2highClaude Sonnet 4.6mediumvsGPT-5.6 TerralowClaude Sonnet 4.6mediumvsStep 3.7 FlashlowClaude Sonnet 4.6mediumvsGPT-5.6 LunahighQwen3.7 PlusmediumvsGLM 5.2highQwen3.5-27BmediumvsGLM 5.2highClaude Sonnet 5mediumvsGLM 5.2highQwen3.6 PlusmediumvsGLM 5.2highGemini 2.5 FlashmediumvsGLM 5.2high