AI BENCHY Compare
xAI: Grok 4.20 vs Z.ai: GLM 5
Last updated at: 2026-04-02
| Metric | Grok 4.20 Grok 4.20 medium | GLM 5 GLM 5 none |
|---|---|---|
| Score | 7.1 | 6.7 |
| Rank | #40 | #48 |
| Consistency | 8.2 | 10.0 |
| Tests Correct | ||
| Attempt pass rate | 66.7% | 52.9% |
| Flaky tests | 4 | 0 |
| Total Runs | 51 | 51 |
| Cost per result | 7.358 | 0.201 |
| Total Cost | $0.663 | $0.019 |
| Input Price | $2.000 / 1M | $0.720 / 1M |
| Output Price | $6.000 / 1M | $2.300 / 1M |
| Output Tokens | 1,494 | 1,551 |
| Reasoning Tokens | 97,078 | 0 |
| Response Time (avg) | 9.50s | 3.77s |
| Response Time (max) | 29.87s | 11.07s |
| Response Time (total) | 161.54s | 37.66s |
Score vs Total Cost
Response Time (avg)
Score vs Response Time (avg)
Total Output Tokens
Score vs Total Output Tokens
Category Breakdown
Quick Compare
Switch Comparison Pair
GPT-5 MinimediumvsGLM 5noneClaude Sonnet 4.6nonevsGrok 4.20mediumNemotron 3 SupermediumFree AvailablevsGLM 5noneGrok 4.1 FastmediumvsGLM 5noneHunter AlphamediumvsGLM 5noneQwen3.5 Plus 2026-02-15nonevsGrok 4.20mediumGPT-5.4 MinimediumvsGLM 5noneGemma 4 31BnonevsGrok 4.20mediumMercury 2mediumvsGLM 5noneGPT-5.3 ChatnonevsGrok 4.20mediumGPT-5 NanomediumvsGLM 5noneKimi K2.5mediumvsGLM 5none