Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Cobuddy vs Z.ai: GLM 5.1

Last updated at: 2026-05-06

Metric Cobuddy Cobuddy medium Release: 2026-05-06 Free Available GLM 5.1 GLM 5.1 none Release: 2026-04-07
Score 6.0 5.8
Rank #90 #95
Reliability 9.9 N/A
Consistency 6.7 7.9
Tests Correct
Attempt pass rate 57.4% 44.4%
Flaky tests 7 5
Total Runs 54 54
Cost per result 0.000 0.872
Total Cost $0.000 $0.053
Input Price $0.000 / 1M $1.050 / 1M
Output Price $0.000 / 1M $3.500 / 1M
Output Tokens 1,639 3,720
Reasoning Tokens 89,199 0
Response Time (avg) 36.47s 4.33s
Response Time (max) 309.02s 32.57s
Response Time (total) 656.47s 78.02s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 8.7 7.9 91.7% 1 10.00s 98 4,666
GLM 5.1 4.0 6.3 25.0% 2 2.11s 305 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 4.3 1.1 66.7% 1 53.59s 343 9,678
GLM 5.1 5.1 9.1 0.0% 0 9.79s 501 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 3.0 10.0 0.0% 0 47.38s 465 7,265
GLM 5.1 2.8 2.1 33.3% 1 32.57s 2,129 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 6.3 5.8 66.7% 1 17.36s 275 5,591
GLM 5.1 10.0 10.0 100.0% 0 1.08s 204 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 2.9 4.4 22.2% 2 128.15s 10 49,454
GLM 5.1 2.9 7.2 11.1% 1 1.99s 24 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 4.2 9.9 0.0% 0 23.23s 76 3,782
GLM 5.1 5.0 10.0 0.0% 0 790ms 39 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 9.8 10.0 100.0% 0 11.60s 64 2,842
GLM 5.1 9.8 10.0 100.0% 0 1.58s 66 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 3.5 4.4 33.3% 2 12.91s 175 5,627
GLM 5.1 6.1 7.8 44.4% 1 1.48s 152 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 10.0 10.0 100.0% 0 11.19s 133 294
GLM 5.1 10.0 10.0 100.0% 0 10.68s 300 0

Quick Compare

Switch Comparison Pair