Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Kwaipilot: KAT-Coder-Air V2.5 vs Kwaipilot: KAT-Coder-Air V2.5

Summary

KAT-Coder-Air V2.5 (high) leads on average score with 6.2 vs 6.0. KAT-Coder-Air V2.5 (low) has the lower benchmark cost at $0.030 vs $0.064. KAT-Coder-Air V2.5 (low) is faster at 6.47s vs 11.02s, with pass rates of 46.0% vs 46.0%.

Recommended modelKAT-Coder-Air V2.5 (low)Its score stays close to the best score here (6.0 vs 6.2), while costing about 2.1x less than KAT-Coder-Air V2.5 (high).

Last updated at: 2026-07-14

Metric KAT-Coder-Air V2.5 KAT-Coder-Air V2.5 high Release: 2026-07-14 KAT-Coder-Air V2.5 KAT-Coder-Air V2.5 low Release: 2026-07-14
Score 6.2 6.0
Rank #110 #124
Reliability 9.7 9.7
Consistency 7.6 7.6
Tests Correct
Attempt pass rate 46.0% 46.0%
Flaky tests 6 6
Total Runs 63 63
Cost per result 0.910 0.427
Total Cost $0.064 $0.030
Input Price $0.150 / 1M $0.150 / 1M
Output Price $0.600 / 1M $0.600 / 1M
Total Input Tokens 41,748 42,464
Output Tokens 3,894 4,227
Reasoning Tokens 91,773 34,864
Response Time (avg) 11.02s 6.47s
Response Time (max) 104.98s 25.49s
Response Time (total) 231.37s 135.80s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#110 KAT-Coder-Air V2.5

high
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

#124 KAT-Coder-Air V2.5

low
Cost
$0.004
Time
29.9s
Tokens
6,008 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
KAT-Coder-Air V2.5 4.3 7.3 11.1% 1 39.07s 6,948 1,166 55,883
KAT-Coder-Air V2.5 3.5 7.3 11.1% 1 11.06s 7,893 2,001 13,623

Quick Compare

Switch Comparison Pair