Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get ๐Ÿ“Šstats, ๐Ÿ”ฅheatmaps and ๐Ÿ‘€recordings in one self-hosted dashboard.
uxwizz.com

Compared models

GLM 5 (medium) vs GLM 5.1 (medium) vs GLM 5 vs GLM 5.1 benchmark comparison: GLM 5 (medium) leads on Score with 7.7. GLM 5 (medium) leads on Reliability with 10.0. GLM 5 has the lowest Total Cost at $0.041. GLM 5 is fastest at 4.03s.

Last updated at: 2026-07-25

Rank
#49
Total Output Tokens
124,566
Response Time (avg)
33.54s
Total Cost
$0.307
Rank
#82
Total Output Tokens
152,552
Response Time (avg)
46.77s
Total Cost
$0.535
Rank
#152
Total Output Tokens
1,989
Response Time (avg)
4.03s
Total Cost
$0.041
Rank
#163
Total Output Tokens
14,393
Response Time (avg)
6.70s
Total Cost
$0.164
Recommended model GLM 5 (medium)

It has the strongest score in this comparison (7.7) and the best overall balance of cost and response time across all 4 models.

Detailed comparison

Metric GLM 5 GLM 5 medium Release: 2026-02-12 GLM 5.1 GLM 5.1 medium Release: 2026-04-07 GLM 5 GLM 5 none Release: 2026-02-12 GLM 5.1 GLM 5.1 none Release: 2026-04-07
Score 7.7 7.1 5.7 5.5
Rank #49 #82 #152 #163
Reliability 10.0 8.3 10.0 10.0
Consistency 8.1 8.4 9.3 8.2
Tests Correct
Attempt pass rate 78.8% 69.7% 42.4% 40.9%
Flaky tests 4 4 1 5
Total Runs 63 66 63 66
Cost per result 1.668 4.202 0.263 2.368
Total Cost $0.307 $0.535 $0.041 $0.164
Input Price $0.950 / 1M $0.966 / 1M $0.950 / 1M $0.966 / 1M
Output Price $2.551 / 1M $3.036 / 1M $2.551 / 1M $3.036 / 1M
Total Input Tokens 35,224 82,623 37,135 124,209
Output Tokens 21,570 16,089 1,989 14,393
Reasoning Tokens 102,996 136,463 0 0
Response Time (avg) 33.54s 46.77s 4.03s 6.70s
Response Time (max) 99.85s 308.75s 11.07s 61.20s
Response Time (total) 435.99s 982.16s 56.37s 147.38s

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#49 GLM 5

medium
Cost
$0.005
Time
20.7s
Tokens
2,068 tok

#82 GLM 5.1

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

#152 GLM 5

none
Cost
$0.007
Time
32.1s
Tokens
2,023 tok

#163 GLM 5.1

none
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GLM 5 10.0 10.0 100.0% 0 74.30s 7,254 2,997 52,930
GLM 5.1 4.6 3.7 44.5% 2 109.63s 5,702 4,871 37,826
GLM 5 4.0 7.8 11.1% 1 5.12s 7,256 428 0
GLM 5.1 3.9 9.7 0.0% 0 4.96s 7,256 525 0

Quick Compare

Switch Comparison Pair