Navigate
Advertise here

Mercury 2.5 Preview (high) vs KAT-Coder-Pro V2.5 (low)

KAT-Coder-Pro V2.5 (low) leads on average score with 6.5 vs 6.5. Mercury 2.5 Preview (high) has the lower benchmark cost at $0.040 vs $0.568. Mercury 2.5 Preview (high) is faster at 7.61s vs 19.40s, with pass rates of 65.2% vs 65.2%.

Last updated at: 2026-11-16

Compared models

Rank
#275
Total Output Tokens
180,597
Response Time (avg)
7.61s
Total Cost
$0.040
Rank
#271
Total Output Tokens
113,193
Response Time (avg)
19.40s
Total Cost
$0.568
Recommended model Mercury 2.5 Preview (high)

Its score stays close to the best score here (6.5 vs 6.5), while costing about 14.5x less than KAT-Coder-Pro V2.5 (low).

Detailed comparison

Metric Mercury 2.5 Preview Mercury 2.5 Preview high Release: 2026-09-02 KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 low Release: 2026-07-14
Score 6.5 6.5
Rank #275 #271
Reliability 9.9 10.0
Consistency 8.0 7.1
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 65.2% 65.2%
Flaky tests 6 8
Total Runs 69 69
Cost per result 0.319 3.636
Total Cost $0.040 $0.568
Input Price $0.040 / 1M $0.740 / 1M
Output Price $0.150 / 1M $2.960 / 1M
Cache Read Price N/A $0.150 / 1M
Cache Write Price N/A N/A
Total Input Tokens 298,512 87,682
Output Tokens 3,178 7,166
Reasoning Tokens 177,419 106,027
Response Time (avg) 7.61s 19.40s
Response Time (max) 86.84s 209.15s
Response Time (total) 175.08s 446.11s
Parameters ~100B ~700B total (~72B active)
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#275 Mercury 2.5 Preview

high
Cost
$0.001
Time
4.5s
Tokens
3,851 tok

#271 KAT-Coder-Pro V2.5

low
Cost
$0.016
Time
47.6s
Tokens
5,182 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2.5 Preview 6.7 7.8 55.6% 1 6.13s 7,751 485 42,569
KAT-Coder-Pro V2.5 7.8 10.0 66.7% 0 24.87s 7,893 402 24,945

Switch Comparison Pair