- Rank
- #104
- Total Output Tokens
- 67,522
- Response Time (avg)
- 16.72s
- Total Cost
- $3.490
Claude Opus 4.8 (medium) vs GLM 5.2 (medium)
The average score is effectively tied at 8.3 vs 8.2. GLM 5.2 (medium) has the lower benchmark cost at $1.007 vs $3.490. Claude Opus 4.8 (medium) is faster at 16.72s vs 26.88s, with pass rates of 82.6% vs 81.2%.
Compared models
- Rank
- #110
- Total Output Tokens
- 81,020
- Response Time (avg)
- 26.88s
- Total Cost
- $1.007
Recommended model
GLM 5.2 (medium)
It has the best score here (8.2), while costing about 3.5x less than Claude Opus 4.8 (medium).
Detailed comparison
| Metric | Claude Opus 4.8 Claude Opus 4.8 medium | GLM 5.2 GLM 5.2 medium |
|---|---|---|
| Score | 8.3 | 8.2 |
| Rank | #104 | #110 |
| Reliability | 10.0 | 9.6 |
| Consistency | 9.0 | 8.1 |
| Attempts | 69/69 | 66/69 |
| Tests Correct | ||
| Attempt pass rate | 82.6% | 81.2% |
| Flaky tests | 3 | 4 |
| Total Runs | 69 | 66 |
| Cost per result | 20.527 | 2.890 |
| Total Cost | $3.490 | $1.007 |
| Input Price | $5.000 / 1M | $0.153 / 1M |
| Output Price | $25.000 / 1M | $12.000 / 1M |
| Cache Read Price | $0.500 / 1M | $0.150 / 1M |
| Cache Write Price | $6.250 / 1M | N/A |
| Total Input Tokens | 360,294 | 227,164 |
| Output Tokens | 43,441 | 20,029 |
| Reasoning Tokens | 24,401 | 60,991 |
| Response Time (avg) | 16.72s | 26.88s |
| Response Time (max) | 99.37s | 102.40s |
| Response Time (total) | 384.66s | 591.34s |
| Parameters | ~5T total (~500B active) | 744B total (40B active) |
| Availability | Closed | Open source |
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Model generation showcase
Solar System Animation
Prompt: Create a single-file HTML/CSS animation of the Solar System against a dark background, using no JavaScript or external images. The output must feature a stationary Sun and all 8 primary planets (Mercury through Neptune) orbiting it continuously in the correct order using infinite CSS loops. Also include the Moon orbiting Earth and add labels to the planets. The design must be scalable and optimized for a 1:1 aspect ratio by default.
#104 Claude Opus 4.8
medium- Cost
- $0.137
- Time
- 59.7s
- Tokens
- 5,711 tok
#110 GLM 5.2
medium- Cost
- $0.047
- Time
- 135.5s
- Tokens
- 10,705 tok
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 4.8 | 6.1 | 3.1 | 66.7% | 1 | 99.37s | 221,846 | 2,676 | 13,239 | |
| GLM 5.2 | 10.0 | 10.0 | 100.0% | 0 | 102.40s | 189,965 | 7,768 | 11,491 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 4.8 | 10.0 | 10.0 | 100.0% | 0 | 3.95s | 834 | 1,179 | 478 | |
| GLM 5.2 | 10.0 | 10.0 | 100.0% | 0 | 5.89s | 639 | 497 | 2,634 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 4.8 | 10.0 | 10.0 | 100.0% | 0 | 15.33s | 10,590 | 9,945 | 1,381 | |
| GLM 5.2 | 8.2 | 7.2 | 88.9% | 1 | 40.96s | 7,317 | 1,475 | 17,123 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 4.8 | 9.9 | 10.0 | 100.0% | 0 | 54.29s | 101,005 | 19,531 | 4,762 | |
| GLM 5.2 | 5.0 | 5.0 | 50.0% | 0 | 51.96s | 12,696 | 458 | 4,531 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 4.8 | 7.1 | 5.6 | 83.3% | 1 | 12.29s | 10,503 | 481 | 312 | |
| GLM 5.2 | 10.0 | 10.0 | 100.0% | 0 | 13.44s | 7,149 | 348 | 2,345 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 4.8 | 3.6 | 7.2 | 22.2% | 1 | 18.11s | 972 | 7,476 | 2,987 | |
| GLM 5.2 | 4.1 | 4.4 | 44.5% | 2 | 45.47s | 551 | 8,188 | 11,606 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 4.8 | 10.0 | 10.0 | 100.0% | 0 | 2.46s | 708 | 237 | 0 | |
| GLM 5.2 | 10.0 | 10.0 | 100.0% | 0 | 17.39s | 498 | 54 | 1,842 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 4.8 | 10.0 | 10.0 | 100.0% | 0 | 3.32s | 909 | 373 | 320 | |
| GLM 5.2 | 9.9 | 10.0 | 100.0% | 0 | 7.90s | 678 | 94 | 1,518 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 4.8 | 10.0 | 10.0 | 100.0% | 0 | 3.95s | 894 | 791 | 483 | |
| GLM 5.2 | 8.2 | 7.2 | 88.9% | 1 | 13.13s | 672 | 536 | 4,822 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 4.8 | 10.0 | 10.0 | 100.0% | 0 | 8.96s | 11,775 | 301 | 225 | |
| GLM 5.2 | 10.0 | 10.0 | 100.0% | 0 | 20.41s | 6,861 | 230 | 550 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 4.8 | 3.0 | 10.0 | 0.0% | 0 | 6.14s | 258 | 451 | 214 | |
| GLM 5.2 | 3.0 | 10.0 | 0.0% | 0 | 34.25s | 138 | 381 | 2,529 |
Quick Compare
Switch Comparison Pair
Grok 4.5highvsGLM 5.2mediumDeepSeek V4.1 Flash 1017maxvsGLM 5.2mediumGemini 4 ArgonlowvsGLM 5.2mediumClaude Opus 4.8mediumvsGemini 4 ArgonlowClaude Opus 4.8mediumvsDeepSeek V4.1 Flash 1017maxClaude Opus 4.8mediumvsGrok 4.5highClaude Opus 4.8mediumvsKimi K3maxClaude Opus 4.8mediumvsGemini 3.5 FlashhighClaude Opus 4.8mediumvsGPT-5.6 TerrahighKimi K3maxvsGLM 5.2mediumKimi K3.1 ProhighvsGLM 5.2mediumGemini 3.5 FlashhighvsGLM 5.2medium