AI BENCHY
Advertise here
#60

KAT-Coder-Pro V2.5

Kwaipilot Release: 2026-07-14 Tested on: 2026-07-14 11:05 kwaipilot/kat-coder-pro-v2.5::medium
(high) (medium) (low) (none)

Summary

KAT-Coder-Pro V2.5 scores 7.5 on AI BENCHY and ranks #60. It has 10.0 reliability, a 65.1% pass rate, $0.275 total cost, and 12.95s average response time.

What makes KAT-Coder-Pro V2.5 unique: It stands out most in Coding, where it ranks #2, while Data parsing and extraction is its weakest area at #14.

Score

7.5

Consistency

7.7

Reliability

10.0

Total Cost (Current Price)

$0.275

Total Output Tokens

82,125

Total Input Tokens

42,750

Input Price

$0.740 / 1M

Output Price

$2.960 / 1M

Tests Correct

Wrong Tests: 10

Attempt pass rate: 65.1%

Flaky tests

6

Flaky tests had mixed outcomes across runs (at least one pass and one fail).

Response Time (avg)

12.95s

Response Time (max): 81.45s

Response Time (total): 271.92s

Wrong answer: 9 Did not follow instructions: 1

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#60 KAT-Coder-Pro V2.5

medium
Cost
$0.009
Time
25.6s
Tokens
2,939 tok

Price History

Historical pricing data for this model from OpenRouter.

Date Input Price Output Price
2026-07-14 11:25 $0.740 / 1M $2.960 / 1M

Charts

Choose the first model, then click a second model to open a side-by-side page.

Total Output Tokens

Score vs Total Output Tokens

Quick Compare

KAT-Coder-Pro V2.5mediumvsKimi K2.5mediumKAT-Coder-Pro V2.5mediumvsGPT-5.6 LunamediumKAT-Coder-Pro V2.5mediumvsGPT-5.3 ChatnoneKAT-Coder-Pro V2.5mediumvsGrok Build 0.1mediumKAT-Coder-Pro V2.5mediumvsGPT-5.4 NanomediumKAT-Coder-Pro V2.5mediumvsGemini 3.5 FlashhighKAT-Coder-Pro V2.5mediumvsGemini 3 Flash PreviewmediumKAT-Coder-Pro V2.5mediumvsNemotron 3 Ultra 550b A55bmediumFree AvailableKAT-Coder-Pro V2.5mediumvsGPT-5.5low

Category Breakdown

Category Score Consistency Tests Correct
Anti-AI Tricks 8.2 7.9
Coding 7.8 10.0
Combined 10.0 10.0
Data parsing and extraction 7.3 5.9
Domain specific 2.9 7.2
General Intelligence 4.7 3.1
Instructions following 9.9 10.0
Puzzle Solving 5.9 4.5
Tool Calling 10.0 10.0
Trivia 3.0 10.0

Compared models