Navigate
Advertise here

KAT-Coder-Pro V2.5 (low) vs Qwen3.6 35B A3B (medium)

The average score is effectively tied at 6.5 vs 6.5. KAT-Coder-Pro V2.5 (low) has the lower benchmark cost at $0.568 vs $0.834. KAT-Coder-Pro V2.5 (low) is faster at 19.40s vs 59.92s, with pass rates of 65.2% vs 58.0%.

Last updated at: 2026-11-13

Compared models

Rank
#266
Total Output Tokens
113,193
Response Time (avg)
19.40s
Total Cost
$0.568
Rank
#269
Total Output Tokens
769,570
Response Time (avg)
59.92s
Total Cost
$0.834
Recommended model KAT-Coder-Pro V2.5 (low)

It has the best score here (6.5), while responding about 3.1x faster than Qwen3.6 35B A3B (medium).

Detailed comparison

Metric KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 low Release: 2026-07-14 Qwen3.6 35B A3B Qwen3.6 35B A3B medium Release: 2026-04-20
Score 6.5 6.5
Rank #266 #269
Reliability 10.0 10.0
Consistency 7.1 9.0
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 65.2% 58.0%
Flaky tests 8 3
Total Runs 69 69
Cost per result 3.636 6.732
Total Cost $0.568 $0.834
Input Price $0.740 / 1M $0.150 / 1M
Output Price $2.960 / 1M $1.000 / 1M
Cache Read Price $0.150 / 1M $0.050 / 1M
Cache Write Price N/A N/A
Total Input Tokens 87,682 282,192
Output Tokens 7,166 75,306
Reasoning Tokens 106,027 700,868
Response Time (avg) 19.40s 59.92s
Response Time (max) 209.15s 817.57s
Response Time (total) 446.11s 1258.32s
Parameters ~700B total (~72B active) 35B total (3B active)
Availability Closed Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#266 KAT-Coder-Pro V2.5

low
Cost
$0.016
Time
47.6s
Tokens
5,182 tok

#269 Qwen3.6 35B A3B

medium
Reached the allocated time limit (300 seconds) without receiving showcase output.
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
KAT-Coder-Pro V2.5 7.8 10.0 66.7% 0 24.87s 7,893 402 24,945
Qwen3.6 35B A3B 7.7 10.0 66.7% 0 50.55s 5,051 7,929 37,223

Switch Comparison Pair