Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Claude Sonnet 5 vs KAT-Coder-Pro V2.5 (default)

KAT-Coder-Pro V2.5 (default) leads on average score with 6.1 vs 5.9. KAT-Coder-Pro V2.5 (default) has the lower benchmark cost at $0.742 vs $1.095. Claude Sonnet 5 is faster at 8.60s vs 24.96s, with pass rates of 40.6% vs 68.1%.

Last updated at: 2026-11-18

Compared models

Rank
#355
Total Output Tokens
30,777
Response Time (avg)
8.60s
Total Cost
$1.095
Rank
#342
Total Output Tokens
139,572
Response Time (avg)
24.96s
Total Cost
$0.742
Recommended model KAT-Coder-Pro V2.5 (default)

It has the strongest score in this comparison (6.1) and the best overall balance of cost and response time across 2 models.

Detailed comparison

Metric Claude Sonnet 5 Claude Sonnet 5 none Release: 2026-06-30 KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 default Release: 2026-07-14
Score 5.9 6.1
Rank #355 #342
Reliability 10.0 10.0
Consistency 8.4 7.1
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 40.6% 68.1%
Flaky tests 5 8
Total Runs 69 69
Cost per result 15.642 4.419
Total Cost $1.095 $0.742
Input Price $2.000 / 1M $0.740 / 1M
Output Price $10.000 / 1M $2.960 / 1M
Cache Read Price $0.200 / 1M $0.150 / 1M
Cache Write Price $2.500 / 1M N/A
Total Input Tokens 393,560 98,508
Output Tokens 30,466 8,088
Reasoning Tokens 311 131,484
Response Time (avg) 8.60s 24.96s
Response Time (max) 64.73s 335.41s
Response Time (total) 197.73s 574.12s
Parameters ~1T total (~100B active) ~700B total (~72B active)
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#355 Claude Sonnet 5

none
Cost
$0.061
Time
53.7s
Tokens
6,172 tok

#342 KAT-Coder-Pro V2.5

default
Cost
$0.010
Time
29.0s
Tokens
3,439 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Sonnet 5 4.6 7.9 22.2% 1 3.67s 10,590 1,864 0
KAT-Coder-Pro V2.5 6.1 4.7 66.7% 2 22.52s 7,893 451 21,989

Switch Comparison Pair