Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Mercury 2.5 (low) vs KAT Coder AIR V2.5 (high)

KAT Coder AIR V2.5 (high) leads on average score with 5.2 vs 5.1. Mercury 2.5 (low) has the lower benchmark cost at $0.020 vs $0.077. Mercury 2.5 (low) is faster at 3.34s vs 15.23s, with pass rates of 37.7% vs 40.6%.

Last updated at: 2026-11-13

Compared models

Rank
#391
Total Output Tokens
40,302
Response Time (avg)
3.34s
Total Cost
$0.020
Rank
#386
Total Output Tokens
114,654
Response Time (avg)
15.23s
Total Cost
$0.077
Recommended model Mercury 2.5 (low)

Its score stays close to the best score here (5.1 vs 5.2), while costing about 4.0x less than KAT Coder AIR V2.5 (high).

Detailed comparison

Metric Mercury 2.5 Mercury 2.5 low Release: 2026-09-08 KAT Coder AIR V2.5 KAT Coder AIR V2.5 high Release: 2026-07-14
Score 5.1 5.2
Rank #391 #386
Reliability 9.8 9.8
Consistency 8.2 8.2
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 37.7% 40.6%
Flaky tests 5 5
Total Runs 69 69
Cost per result 0.319 1.091
Total Cost $0.020 $0.077
Input Price $0.040 / 1M $0.150 / 1M
Output Price $0.150 / 1M $0.600 / 1M
Cache Read Price $0.004 / 1M N/A
Cache Write Price N/A N/A
Total Input Tokens 326,083 50,423
Output Tokens 7,224 4,144
Reasoning Tokens 33,078 110,510
Response Time (avg) 3.34s 15.23s
Response Time (max) 47.06s 118.35s
Response Time (total) 76.80s 350.26s
Parameters ~100B ~35B total (~3B active)
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#391 Mercury 2.5

low
Cost
$0.001
Time
2.4s
Tokens
1,236 tok

#386 KAT Coder AIR V2.5

high
Reached the allocated time limit (300 seconds) without receiving showcase output.
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2.5 5.5 10.0 33.3% 0 972ms 7,909 521 2,269
KAT Coder AIR V2.5 4.3 7.3 11.1% 1 39.07s 6,948 1,166 55,883

Switch Comparison Pair