Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Cobuddy vs Kwaipilot: KAT-Coder-Air V2.5

Summary

The average score is effectively tied at 4.9 vs 4.9. Cobuddy (medium) has the lower benchmark cost at $0.000 vs $0.037. KAT-Coder-Air V2.5 is faster at 6.99s vs 39.90s, with pass rates of 47.6% vs 38.1%.

Recommended modelKAT-Coder-Air V2.5It has the best score here (4.9), while responding about 5.7x faster than Cobuddy (medium).

Last updated at: 2026-07-14

Metric Cobuddy Cobuddy medium Release: 2026-05-06 KAT-Coder-Air V2.5 KAT-Coder-Air V2.5 none Release: 2026-07-14
Score 4.9 4.9
Rank #167 #168
Reliability 10.0 10.0
Consistency 7.5 7.1
Tests Correct
Attempt pass rate 47.6% 38.1%
Flaky tests 6 7
Total Runs 63 63
Cost per result 0.000 0.724
Total Cost $0.000 $0.037
Input Price $0.000 / 1M $0.150 / 1M
Output Price $0.000 / 1M $0.600 / 1M
Total Input Tokens 37,449 41,328
Output Tokens 1,677 49,933
Reasoning Tokens 116,703 0
Response Time (avg) 39.90s 6.99s
Response Time (max) 309.02s 24.94s
Response Time (total) 797.98s 146.78s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#167 Cobuddy

medium
No endpoints found for baidu/cobuddy:free.
Cost
$0.000
Time
0.1s
Tokens
0 tok

#168 KAT-Coder-Air V2.5

none
Cost
$0.002
Time
14.5s
Tokens
2,619 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Cobuddy 3.7 6.7 22.2% 1 79.17s 4,726 358 30,138
KAT-Coder-Air V2.5 3.3 9.6 0.0% 0 14.31s 6,472 16,918 0

Quick Compare

Switch Comparison Pair