Navigate
Advertise here

KAT-Coder-Pro V2.5 (medium) vs Inkling 2 Mini (medium)

The average score is effectively tied at 6.2 vs 6.2. Inkling 2 Mini (medium) has the lower benchmark cost at $0.385 vs $0.669. KAT-Coder-Pro V2.5 (medium) is faster at 23.94s vs 54.86s, with pass rates of 62.3% vs 62.3%.

Last updated at: 2026-11-22

Compared models

Rank
#335
Total Output Tokens
139,375
Response Time (avg)
23.94s
Total Cost
$0.669
Rank
#333
Total Output Tokens
847,969
Response Time (avg)
54.86s
Total Cost
$0.385
Recommended model Inkling 2 Mini (medium)

It has the best score here (6.2), while costing about 1.7x less than KAT-Coder-Pro V2.5 (medium).

Detailed comparison

Metric KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 medium Release: 2026-07-14 Inkling 2 Mini Inkling 2 Mini medium Release: 2026-11-20
Score 6.2 6.2
Rank #335 #333
Reliability 10.0 10.0
Consistency 7.2 8.3
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 62.3% 62.3%
Flaky tests 8 5
Total Runs 69 69
Cost per result 4.342 3.206
Total Cost $0.669 $0.385
Input Price $0.740 / 1M $0.100 / 1M
Output Price $2.960 / 1M $0.400 / 1M
Cache Read Price $0.150 / 1M $0.020 / 1M
Cache Write Price N/A N/A
Total Input Tokens 87,916 455,218
Output Tokens 7,213 18,927
Reasoning Tokens 132,162 829,042
Response Time (avg) 23.94s 54.86s
Response Time (max) 257.00s 272.86s
Response Time (total) 550.52s 1261.74s
Parameters ~700B total (~72B active) 26.4B total (3.4B active)
Availability Closed Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#335 KAT-Coder-Pro V2.5

medium
Cost
$0.009
Time
25.6s
Tokens
2,939 tok

#333 Thinking Machines: Inkling 2 Mini

medium
Cost
$0.002
Time
25.4s
Tokens
3,575 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
KAT-Coder-Pro V2.5 7.8 10.0 66.7% 0 33.10s 7,893 416 33,658
Inkling 2 Mini 5.8 4.4 66.7% 2 130.51s 8,814 562 264,091

Switch Comparison Pair