Navigate
AI BENCHY
Advertise here

Kimi K2.5 (medium) vs GLM 5.1 (medium)

The average score is effectively tied at 7.0 vs 7.0. Kimi K2.5 (medium) has the lower benchmark cost at $0.607 vs $0.727. GLM 5.1 (medium) is faster at 58.80s vs 98.19s, with pass rates of 63.6% vs 65.2%.

Last updated at: 2026-08-15

Rank
#122
Total Output Tokens
220,942
Response Time (avg)
98.19s
Total Cost
$0.607
Rank
#117
Total Output Tokens
215,889
Response Time (avg)
58.80s
Total Cost
$0.727
Recommended model Kimi K2.5 (medium)

It has the strongest score in this comparison (7.0) and the best overall balance of cost and response time across all 2 models.

Detailed comparison

Metric Kimi K2.5 Kimi K2.5 medium Release: 2026-01-27 GLM 5.1 GLM 5.1 medium Release: 2026-04-07
Score 7.0 7.0
Rank #122 #117
Reliability 10.0 8.1
Consistency 7.0 8.4
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 63.6% 65.2%
Flaky tests 8 4
Total Runs 66 66
Cost per result 4.849 6.923
Total Cost $0.607 $0.727
Input Price $0.571 / 1M $0.966 / 1M
Output Price $2.850 / 1M $3.036 / 1M
Total Input Tokens 118,496 82,592
Output Tokens 53,522 16,089
Reasoning Tokens 167,420 199,800
Response Time (avg) 98.19s 58.80s
Response Time (max) 281.00s 308.75s
Response Time (total) 1571.05s 1234.72s
Parameters 1T total (32B active) 744B total (40B active)
Availability Weights available Open source

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#122 MoonshotAI: Kimi K2.5

medium
Cost
$0.030
Time
58.6s
Tokens
8,683 tok

#117 GLM 5.1

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Kimi K2.5 6.1 4.6 66.7% 2 217.49s 6,935 5,705 74,693
GLM 5.1 4.6 3.7 44.5% 2 109.63s 5,702 4,871 37,826

Quick Compare

Switch Comparison Pair