Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

KAT-Coder-Pro V2.5 (low) vs Step 3.7 Flash (high)

The average score is effectively tied at 6.5 vs 6.6. KAT-Coder-Pro V2.5 (low) has the lower benchmark cost at $0.568 vs $1.478. KAT-Coder-Pro V2.5 (low) is faster at 19.40s vs 72.72s, with pass rates of 65.2% vs 58.0%.

Last updated at: 2026-11-13

Compared models

Rank
#266
Total Output Tokens
113,193
Response Time (avg)
19.40s
Total Cost
$0.568
Rank
#264
Total Output Tokens
1,100,052
Response Time (avg)
72.72s
Total Cost
$1.478
Recommended model KAT-Coder-Pro V2.5 (low)

It has the best score here (6.5), while costing about 2.6x less than Step 3.7 Flash (high).

Detailed comparison

Metric KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 low Release: 2026-07-14 Step 3.7 Flash Step 3.7 Flash high Release: 2026-05-29
Score 6.5 6.6
Rank #266 #264
Reliability 10.0 10.0
Consistency 7.1 8.5
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 65.2% 58.0%
Flaky tests 8 4
Total Runs 69 69
Cost per result 3.636 12.267
Total Cost $0.568 $1.478
Input Price $0.740 / 1M $0.200 / 1M
Output Price $2.960 / 1M $1.150 / 1M
Cache Read Price $0.150 / 1M $0.040 / 1M
Cache Write Price N/A N/A
Total Input Tokens 87,682 421,200
Output Tokens 7,166 1,100,052
Reasoning Tokens 106,027 0
Response Time (avg) 19.40s 72.72s
Response Time (max) 209.15s 364.99s
Response Time (total) 446.11s 1672.53s
Parameters ~700B total (~72B active) 198B total (11B active)
Availability Closed Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#266 KAT-Coder-Pro V2.5

low
Cost
$0.016
Time
47.6s
Tokens
5,182 tok

#264 Step 3.7 Flash

high
Cost
$0.007
Time
63.6s
Tokens
6,030 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
KAT-Coder-Pro V2.5 7.8 10.0 66.7% 0 24.87s 7,893 402 24,945
Step 3.7 Flash 4.0 6.0 22.2% 1 206.21s 6,057 327,340 0

Switch Comparison Pair