Navigate
Advertise here

KAT-Coder-Pro V2.5 (high) vs Inkling 2 Mini (low)

The average score is effectively tied at 6.5 vs 6.4. Inkling 2 Mini (low) has the lower benchmark cost at $0.176 vs $0.506. KAT-Coder-Pro V2.5 (high) is faster at 21.21s vs 27.95s, with pass rates of 60.9% vs 62.3%.

Last updated at: 2026-11-22

Compared models

Rank
#299
Total Output Tokens
144,359
Response Time (avg)
21.21s
Total Cost
$0.506
Rank
#305
Total Output Tokens
339,066
Response Time (avg)
27.95s
Total Cost
$0.176
Recommended model Inkling 2 Mini (low)

It has the best score here (6.4), while costing about 2.9x less than KAT-Coder-Pro V2.5 (high).

Detailed comparison

Metric KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 high Release: 2026-07-14 Inkling 2 Mini Inkling 2 Mini low Release: 2026-11-20
Score 6.5 6.4
Rank #299 #305
Reliability 10.0 10.0
Consistency 7.9 9.2
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 60.9% 62.3%
Flaky tests 6 2
Total Runs 69 69
Cost per result 4.599 1.352
Total Cost $0.506 $0.176
Input Price $0.740 / 1M $0.100 / 1M
Output Price $2.960 / 1M $0.400 / 1M
Cache Read Price $0.150 / 1M $0.020 / 1M
Cache Write Price N/A N/A
Total Input Tokens 106,085 401,060
Output Tokens 9,071 17,041
Reasoning Tokens 135,288 322,025
Response Time (avg) 21.21s 27.95s
Response Time (max) 199.97s 152.77s
Response Time (total) 487.83s 642.86s
Parameters ~700B total (~72B active) 26.4B total (3.4B active)
Availability Closed Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#299 KAT-Coder-Pro V2.5

high
Cost
$0.009
Time
26.4s
Tokens
3,117 tok

#305 Thinking Machines: Inkling 2 Mini

low
Cost
$0.001
Time
12.1s
Tokens
2,152 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
KAT-Coder-Pro V2.5 6.4 7.9 44.4% 1 22.00s 7,893 422 20,461
Inkling 2 Mini 5.9 7.2 55.6% 1 92.85s 8,814 570 226,398

Switch Comparison Pair