Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

KAT-Coder-Pro V2.5 (medium) vs Grok 4.20 (medium)

The average score is effectively tied at 6.2 vs 6.3. KAT-Coder-Pro V2.5 (medium) has the lower benchmark cost at $0.669 vs $1.246. KAT-Coder-Pro V2.5 (medium) is faster at 23.94s vs 36.73s, with pass rates of 62.3% vs 58.0%.

Last updated at: 2026-11-13

Compared models

Rank
#309
Total Output Tokens
139,375
Response Time (avg)
23.94s
Total Cost
$0.669
Rank
#307
Total Output Tokens
302,087
Response Time (avg)
36.73s
Total Cost
$1.246
Recommended model KAT-Coder-Pro V2.5 (medium)

It has the best score here (6.2), while costing about 1.9x less than Grok 4.20 (medium).

Detailed comparison

Metric KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 medium Release: 2026-07-14 Grok 4.20 Grok 4.20 medium Release: 2026-03-31
Score 6.2 6.3
Rank #309 #307
Reliability 10.0 10.0
Consistency 7.2 8.2
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 62.3% 58.0%
Flaky tests 8 5
Total Runs 69 69
Cost per result 4.342 14.374
Total Cost $0.669 $1.246
Input Price $0.740 / 1M $1.250 / 1M
Output Price $2.960 / 1M $2.500 / 1M
Cache Read Price $0.150 / 1M $0.200 / 1M
Cache Write Price N/A N/A
Total Input Tokens 87,916 392,127
Output Tokens 7,213 7,754
Reasoning Tokens 132,162 294,333
Response Time (avg) 23.94s 36.73s
Response Time (max) 257.00s 199.66s
Response Time (total) 550.52s 844.68s
Parameters ~700B total (~72B active) ~1T total (~100B active)
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#309 KAT-Coder-Pro V2.5

medium
Cost
$0.009
Time
25.6s
Tokens
2,939 tok

#307 SpaceXAI: Grok 4.20

medium
Cost
$0.041
Time
110.3s
Tokens
16,336 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
KAT-Coder-Pro V2.5 7.8 10.0 66.7% 0 33.10s 7,893 416 33,658
Grok 4.20 6.3 6.6 55.6% 1 109.93s 8,307 268 103,150

Switch Comparison Pair