Navigate
Advertise here

Granite 4.2 8B (medium) vs KAT-Coder-Pro V2.5 (default)

The average score is effectively tied at 6.1 vs 6.1. Granite 4.2 8B (medium) has the lower benchmark cost at $0.029 vs $0.742. KAT-Coder-Pro V2.5 (default) is faster at 24.96s vs 50.47s, with pass rates of 37.7% vs 68.1%.

Last updated at: 2026-11-16

Compared models

Rank
#326
Total Output Tokens
50,045
Response Time (avg)
50.47s
Total Cost
$0.029
Rank
#327
Total Output Tokens
139,572
Response Time (avg)
24.96s
Total Cost
$0.742
Recommended model Granite 4.2 8B (medium)

It has the best score here (6.1), while costing about 26.2x less than KAT-Coder-Pro V2.5 (default).

Detailed comparison

Metric Granite 4.2 8B Granite 4.2 8B medium Release: 2026-09-02 KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 default Release: 2026-07-14
Score 6.1 6.1
Rank #326 #327
Reliability 8.9 10.0
Consistency 9.7 7.1
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 37.7% 68.1%
Flaky tests 1 8
Total Runs 69 69
Cost per result 0.354 4.419
Total Cost $0.029 $0.742
Input Price $0.060 / 1M $0.740 / 1M
Output Price $0.250 / 1M $2.960 / 1M
Cache Read Price $0.015 / 1M $0.150 / 1M
Cache Write Price N/A N/A
Total Input Tokens 259,708 98,508
Output Tokens 16,567 8,088
Reasoning Tokens 33,580 131,484
Response Time (avg) 50.47s 24.96s
Response Time (max) 557.96s 335.41s
Response Time (total) 1160.91s 574.12s
Parameters 8B ~700B total (~72B active)
Availability Open source Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#326 IBM: Granite 4.2 8B

medium
Provider returned error
Cost
$0.000
Time
0.2s
Tokens
0 tok

#327 KAT-Coder-Pro V2.5

default
Cost
$0.010
Time
29.0s
Tokens
3,439 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Granite 4.2 8B 5.5 10.0 33.3% 0 12.09s 8,439 2,445 3,900
KAT-Coder-Pro V2.5 6.1 4.7 66.7% 2 22.52s 7,893 451 21,989

Switch Comparison Pair