Navigate
Advertise here

KAT-Coder-Pro V2.5 (low) vs Qwen3.7 Flash (medium)

Qwen3.7 Flash (medium) leads on average score with 6.6 vs 6.5. Qwen3.7 Flash (medium) has the lower benchmark cost at $0.076 vs $0.568. KAT-Coder-Pro V2.5 (low) is faster at 19.40s vs 51.80s, with pass rates of 65.2% vs 62.3%.

Last updated at: 2026-11-16

Compared models

Rank
#271
Total Output Tokens
113,193
Response Time (avg)
19.40s
Total Cost
$0.568
Rank
#266
Total Output Tokens
514,925
Response Time (avg)
51.80s
Total Cost
$0.076
Recommended model Qwen3.7 Flash (medium)

It has the best score here (6.6), while costing about 7.5x less than KAT-Coder-Pro V2.5 (low).

Detailed comparison

Metric KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 low Release: 2026-07-14 Qwen3.7 Flash Qwen3.7 Flash medium Release: 2026-07-28
Score 6.5 6.6
Rank #271 #266
Reliability 10.0 10.0
Consistency 7.1 7.3
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 65.2% 62.3%
Flaky tests 8 8
Total Runs 69 69
Cost per result 3.636 0.760
Total Cost $0.568 $0.076
Input Price $0.740 / 1M $0.030 / 1M
Output Price $2.960 / 1M $0.130 / 1M
Cache Read Price $0.150 / 1M $0.006 / 1M
Cache Write Price N/A $0.039 / 1M
Total Input Tokens 87,682 300,394
Output Tokens 7,166 14,081
Reasoning Tokens 106,027 500,844
Response Time (avg) 19.40s 51.80s
Response Time (max) 209.15s 593.64s
Response Time (total) 446.11s 1191.42s
Parameters ~700B total (~72B active) ~35B total (~3B active)
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#271 KAT-Coder-Pro V2.5

low
Cost
$0.016
Time
47.6s
Tokens
5,182 tok

#266 Qwen3.7 Flash

medium
Reached the allocated time limit (600 seconds) without receiving showcase output.
Cost
$0.000
Time
600.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
KAT-Coder-Pro V2.5 7.8 10.0 66.7% 0 24.87s 7,893 402 24,945
Qwen3.7 Flash 6.2 6.9 55.6% 1 46.78s 7,893 563 61,902

Switch Comparison Pair