Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Kwaipilot: KAT-Coder-Pro V2.5 vs MoonshotAI: Kimi K2.6

Summary

Kimi K2.6 (medium) leads on average score with 7.8 vs 7.7. KAT-Coder-Pro V2.5 (high) has the lower benchmark cost at $0.246 vs $0.888. KAT-Coder-Pro V2.5 (high) is faster at 12.30s vs 71.67s, with pass rates of 63.5% vs 65.1%.

Recommended modelKAT-Coder-Pro V2.5 (high)Its score stays close to the best score here (7.7 vs 7.8), while costing about 3.6x less than Kimi K2.6 (medium).

Last updated at: 2026-07-14

Metric KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 high Release: 2026-07-14 Kimi K2.6 Kimi K2.6 medium Release: 2026-04-20 Free Available
Score 7.7 7.8
Rank #53 #45
Reliability 10.0 10.0
Consistency 8.1 8.6
Tests Correct
Attempt pass rate 63.5% 65.1%
Flaky tests 5 3
Total Runs 63 63
Cost per result 2.228 8.358
Total Cost $0.246 $0.888
Input Price $0.740 / 1M $0.660 / 1M
Output Price $2.960 / 1M $3.410 / 1M
Total Input Tokens 42,750 29,450
Output Tokens 2,509 102,923
Reasoning Tokens 69,594 254,094
Response Time (avg) 12.30s 71.67s
Response Time (max) 95.65s 406.78s
Response Time (total) 258.34s 1433.36s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#53 KAT-Coder-Pro V2.5

high
Cost
$0.009
Time
26.4s
Tokens
3,117 tok

#45 MoonshotAI: Kimi K2.6

medium
Cost
$0.013
Time
103.4s
Tokens
3,620 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
KAT-Coder-Pro V2.5 6.4 7.9 44.4% 1 22.00s 7,893 422 20,461
Kimi K2.6 5.7 8.6 33.3% 0 214.42s 2,925 9,970 77,189

Quick Compare

Switch Comparison Pair