Navigate
Advertise here

KAT-Coder-Pro V2.5 (default) vs Hy4 flash

KAT-Coder-Pro V2.5 (default) leads on average score with 6.1 vs 5.9. Hy4 flash has the lower benchmark cost at $0.012 vs $0.742. Hy4 flash is faster at 6.08s vs 24.96s, with pass rates of 68.1% vs 42.0%.

Last updated at: 2026-11-17

Compared models

Rank
#338
Total Output Tokens
139,572
Response Time (avg)
24.96s
Total Cost
$0.742
Rank
#346
Total Output Tokens
12,090
Response Time (avg)
6.08s
Total Cost
$0.012
Recommended model Hy4 flash

Its score stays close to the best score here (5.9 vs 6.1), while costing about 64.5x less than KAT-Coder-Pro V2.5 (default).

Detailed comparison

Metric KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 default Release: 2026-07-14 Hy4 flash Hy4 flash none Release: 2026-11-17
Score 6.1 5.9
Rank #338 #346
Reliability 10.0 10.0
Consistency 7.1 9.7
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 68.1% 42.0%
Flaky tests 8 1
Total Runs 69 69
Cost per result 4.419 0.128
Total Cost $0.742 $0.012
Input Price $0.740 / 1M $0.035 / 1M
Output Price $2.960 / 1M $0.141 / 1M
Cache Read Price $0.150 / 1M $0.002 / 1M
Cache Write Price N/A N/A
Total Input Tokens 98,508 279,897
Output Tokens 8,088 12,090
Reasoning Tokens 131,484 0
Response Time (avg) 24.96s 6.08s
Response Time (max) 335.41s 83.86s
Response Time (total) 574.12s 139.94s
Parameters ~700B total (~72B active) ~190B total (~12B active)
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#338 KAT-Coder-Pro V2.5

default
Cost
$0.010
Time
29.0s
Tokens
3,439 tok

#346 Hy4 flash

none
Cost
$0.001
Time
10.3s
Tokens
2,212 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
KAT-Coder-Pro V2.5 6.1 4.7 66.7% 2 22.52s 7,893 451 21,989
Hy4 flash 5.5 10.0 33.3% 0 2.30s 7,554 500 0

Switch Comparison Pair