Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Elephant vs Z.ai: GLM 5.1

Last updated at: 2026-04-14

Metric Elephant Elephant medium Release: 2026-04-14 GLM 5.1 GLM 5.1 none Release: 2026-04-07
Score 5.2 5.6
Rank #77 #71
Consistency 9.6 8.2
Tests Correct
Attempt pass rate 29.6% 37.0%
Flaky tests 1 4
Total Runs 54 54
Cost per result 0.000 1.046
Total Cost $0.000 $0.053
Input Price $0.000 / 1M $0.950 / 1M
Output Price $0.000 / 1M $3.150 / 1M
Output Tokens 2,596 3,720
Reasoning Tokens 0 0
Response Time (avg) 1.27s 4.33s
Response Time (max) 3.70s 32.57s
Response Time (total) 22.82s 78.02s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Elephant 6.6 10.0 50.0% 0 1.19s 815 0
GLM 5.1 4.0 6.3 25.0% 2 2.11s 305 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Elephant 5.1 3.3 33.3% 1 1.30s 365 0
GLM 5.1 5.1 9.1 0.0% 0 9.79s 501 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Elephant 3.0 10.0 0.0% 0 3.70s 562 0
GLM 5.1 2.8 2.1 33.3% 1 32.57s 2,129 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Elephant 6.5 10.0 50.0% 0 979ms 246 0
GLM 5.1 10.0 10.0 100.0% 0 1.08s 204 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Elephant 3.0 10.0 0.0% 0 925ms 24 0
GLM 5.1 2.9 7.2 11.1% 1 1.99s 24 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Elephant 4.3 10.0 0.0% 0 920ms 105 0
GLM 5.1 5.0 10.0 0.0% 0 790ms 39 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Elephant 9.8 10.0 100.0% 0 987ms 82 0
GLM 5.1 8.3 10.0 50.0% 0 1.58s 66 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Elephant 3.7 10.0 0.0% 0 867ms 166 0
GLM 5.1 5.7 10.0 33.3% 0 1.48s 152 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Elephant 3.0 10.0 0.0% 0 2.83s 231 0
GLM 5.1 10.0 10.0 100.0% 0 10.68s 300 0

Quick Compare

Switch Comparison Pair

ElephantmediumvsGrok 4.20noneMistral Small 4nonevsElephantmediumgpt-oss-120bnoneFree AvailablevsElephantmediumMistral Small 4mediumvsGLM 5.1noneTrinity Large PreviewnoneFree AvailablevsElephantmediumMiniMax M2.5mediumFree AvailablevsGLM 5.1noneGPT-5.4 MininonevsElephantmediumElephantmediumvsQwen3 Coder NextnoneNemotron 3 SupernoneFree AvailablevsElephantmediumgpt-oss-120bmediumFree AvailablevsGLM 5.1noneElephantmediumvsGLM 5 TurbononeKimi K2.5nonevsElephantmedium