Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Cobuddy vs MoonshotAI: Kimi K2.5

Last updated at: 2026-05-19

Metric Cobuddy Cobuddy medium Release: 2026-05-06 Free Available Kimi K2.5 Kimi K2.5 none Release: 2026-01-27
Score 5.8 5.4
Rank #102 #119
Reliability 9.9 10.0
Consistency 6.9 8.8
Tests Correct
Attempt pass rate 54.4% 38.6%
Flaky tests 7 3
Total Runs 57 57
Cost per result 0.000 0.273
Total Cost $0.000 $0.017
Input Price $0.000 / 1M $0.400 / 1M
Output Price $0.000 / 1M $1.900 / 1M
Output Tokens 1,648 2,679
Reasoning Tokens 96,062 0
Response Time (avg) 36.50s 12.58s
Response Time (max) 309.02s 42.13s
Response Time (total) 693.45s 150.95s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 8.7 7.9 91.7% 1 10.00s 98 4,666
Kimi K2.5 3.6 8.4 8.3% 1 6.24s 373 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 4.3 1.1 66.7% 1 53.59s 343 9,678
Kimi K2.5 10.0 10.0 100.0% 0 38.78s 649 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 3.0 10.0 0.0% 0 47.38s 465 7,265
Kimi K2.5 2.8 2.1 33.3% 1 19.16s 748 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 6.3 5.8 66.7% 1 17.36s 275 5,591
Kimi K2.5 7.3 5.8 83.3% 1 42.13s 187 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 2.9 4.4 22.2% 2 128.15s 10 49,454
Kimi K2.5 5.3 10.0 33.3% 0 4.38s 29 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 4.2 9.9 0.0% 0 23.23s 76 3,782
Kimi K2.5 10.0 10.0 100.0% 0 4.00s 76 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 9.8 10.0 100.0% 0 11.60s 64 2,842
Kimi K2.5 6.5 10.0 50.0% 0 2.67s 60 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 3.5 4.4 33.3% 2 12.91s 175 5,627
Kimi K2.5 3.0 10.0 0.0% 0 4.73s 317 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 10.0 10.0 100.0% 0 11.19s 133 294
Kimi K2.5 10.0 10.0 100.0% 0 13.99s 220 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 3.0 10.0 0.0% 0 36.98s 9 6,863
Kimi K2.5 3.0 10.0 0.0% 0 3.90s 20 0

Quick Compare

Switch Comparison Pair