Navigate
Advertise here

Mercury 2.5 (high) vs KAT-Coder-Pro V2.5 (low)

KAT-Coder-Pro V2.5 (low) leads on average score with 6.5 vs 6.5. Mercury 2.5 (high) has the lower benchmark cost at $0.044 vs $0.568. Mercury 2.5 (high) is faster at 7.62s vs 19.40s, with pass rates of 59.4% vs 65.2%.

Last updated at: 2026-11-16

Compared models

Rank
#276
Total Output Tokens
193,676
Response Time (avg)
7.62s
Total Cost
$0.044
Rank
#271
Total Output Tokens
113,193
Response Time (avg)
19.40s
Total Cost
$0.568
Recommended model Mercury 2.5 (high)

Its score stays close to the best score here (6.5 vs 6.5), while costing about 13.1x less than KAT-Coder-Pro V2.5 (low).

Detailed comparison

Metric Mercury 2.5 Mercury 2.5 high Release: 2026-09-08 KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 low Release: 2026-07-14
Score 6.5 6.5
Rank #276 #271
Reliability 9.8 10.0
Consistency 8.7 7.1
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 59.4% 65.2%
Flaky tests 4 8
Total Runs 69 69
Cost per result 0.362 3.636
Total Cost $0.044 $0.568
Input Price $0.040 / 1M $0.740 / 1M
Output Price $0.150 / 1M $2.960 / 1M
Cache Read Price $0.004 / 1M $0.150 / 1M
Cache Write Price N/A N/A
Total Input Tokens 358,562 87,682
Output Tokens 4,266 7,166
Reasoning Tokens 189,410 106,027
Response Time (avg) 7.62s 19.40s
Response Time (max) 80.30s 209.15s
Response Time (total) 175.36s 446.11s
Parameters ~100B ~700B total (~72B active)
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#276 Mercury 2.5

high
Cost
$0.001
Time
3.5s
Tokens
2,447 tok

#271 KAT-Coder-Pro V2.5

low
Cost
$0.016
Time
47.6s
Tokens
5,182 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2.5 6.4 7.8 44.4% 1 6.58s 7,757 415 44,012
KAT-Coder-Pro V2.5 7.8 10.0 66.7% 0 24.87s 7,893 402 24,945

Switch Comparison Pair