Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Kwaipilot: KAT-Coder-Air V2.5 vs MoonshotAI: Kimi K2.5

Summary

Kimi K2.5 leads on average score with 5.5 vs 4.9. Kimi K2.5 has the lower benchmark cost at $0.027 vs $0.037. KAT-Coder-Air V2.5 is faster at 6.99s vs 13.18s, with pass rates of 38.1% vs 34.9%.

Recommended modelKimi K2.5It has the strongest score in this comparison (5.5) and the best overall balance of cost and response time across all 2 models.

Last updated at: 2026-07-14

Metric KAT-Coder-Air V2.5 KAT-Coder-Air V2.5 none Release: 2026-07-14 Kimi K2.5 Kimi K2.5 none Release: 2026-01-27
Score 4.9 5.5
Rank #168 #143
Reliability 10.0 10.0
Consistency 7.1 8.9
Tests Correct
Attempt pass rate 38.1% 34.9%
Flaky tests 7 3
Total Runs 63 63
Cost per result 0.724 0.442
Total Cost $0.037 $0.027
Input Price $0.150 / 1M $0.375 / 1M
Output Price $0.600 / 1M $2.025 / 1M
Total Input Tokens 41,328 36,034
Output Tokens 49,933 6,657
Reasoning Tokens 0 0
Response Time (avg) 6.99s 13.18s
Response Time (max) 24.94s 42.13s
Response Time (total) 146.78s 184.47s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#168 KAT-Coder-Air V2.5

none
Cost
$0.002
Time
14.5s
Tokens
2,619 tok

#143 MoonshotAI: Kimi K2.5

none
Cost
$0.015
Time
89.1s
Tokens
5,421 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
KAT-Coder-Air V2.5 3.3 9.6 0.0% 0 14.31s 6,472 16,918 0
Kimi K2.5 5.5 10.0 33.3% 0 24.56s 7,311 4,708 0

Quick Compare

Switch Comparison Pair