- Rank
- #294
- Total Output Tokens
- 66,576
- Response Time (avg)
- 8.32s
- Total Cost
- $0.048
KAT Coder AIR V2.5 (medium) vs Inkling Small (low)
Inkling Small (low) leads on average score with 5.2 vs 5.1. KAT Coder AIR V2.5 (medium) has the lower benchmark cost at $0.048 vs $0.059. Inkling Small (low) is faster at 1.99s vs 8.32s, with pass rates of 43.5% vs 47.8%.
Compared models
- Rank
- #285
- Total Output Tokens
- 14,686
- Response Time (avg)
- 1.99s
- Total Cost
- $0.059
Recommended model
Inkling Small (low)
It has the best score here (5.2), while responding about 4.2x faster than KAT Coder AIR V2.5 (medium).
Detailed comparison
| Metric | KAT Coder AIR V2.5 KAT Coder AIR V2.5 medium | Inkling Small Inkling Small low Free Available |
|---|---|---|
| Score | 5.1 | 5.2 |
| Rank | #294 | #285 |
| Reliability | 9.6 | 10.0 |
| Consistency | 8.9 | 8.7 |
| Attempts | 69/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 43.5% | 47.8% |
| Flaky tests | 3 | 4 |
| Total Runs | 69 | 69 |
| Cost per result | 0.596 | 0.649 |
| Total Cost | $0.048 | $0.059 |
| Input Price | $0.000 / 1M | $0.450 / 1M |
| Output Price | $0.000 / 1M | $1.200 / 1M |
| Total Input Tokens | 51,369 | 81,447 |
| Output Tokens | 8,008 | 2,715 |
| Reasoning Tokens | 58,568 | 11,971 |
| Response Time (avg) | 8.32s | 1.99s |
| Response Time (max) | 48.19s | 5.82s |
| Response Time (total) | 191.40s | 45.67s |
| Parameters | ~35B total (~3B active) | 276B total (12B active) |
| Availability | Closed | Closed |
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#294 KAT Coder AIR V2.5
medium- Cost
- $0.003
- Time
- 23.7s
- Tokens
- 4,924 tok
#285 Thinking Machines: Inkling Small
low- Cost
- $0.001
- Time
- 5.9s
- Tokens
- 759 tok
Top Models by Score
Score vs Total Cost
Response Time (avg)
Score vs Response Time (avg)
Total Output Tokens
Score vs Total Output Tokens
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 3.0 | 10.0 | 0.0% | 0 | 1.05s | 0 | 0 | 0 | |
| Inkling Small | 3.0 | 10.0 | 0.0% | 0 | 24ms | 0 | 0 | 0 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 8.7 | 8.0 | 91.7% | 1 | 3.79s | 672 | 549 | 4,194 | |
| Inkling Small | 9.2 | 8.4 | 91.7% | 1 | 1.81s | 702 | 240 | 1,831 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 3.6 | 7.0 | 22.2% | 1 | 23.37s | 7,893 | 5,199 | 29,973 | |
| Inkling Small | 4.6 | 5.0 | 33.3% | 2 | 3.70s | 7,374 | 375 | 4,332 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 6.5 | 10.0 | 50.0% | 0 | 19.56s | 23,854 | 435 | 6,811 | |
| Inkling Small | 3.0 | 10.0 | 0.0% | 0 | 4.08s | 55,293 | 893 | 1,420 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 6.5 | 10.0 | 50.0% | 0 | 3.65s | 7,776 | 268 | 1,881 | |
| Inkling Small | 10.0 | 10.0 | 100.0% | 0 | 1.25s | 7,068 | 216 | 372 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 3.0 | 10.0 | 0.0% | 0 | 6.58s | 668 | 673 | 4,670 | |
| Inkling Small | 5.3 | 10.0 | 33.3% | 0 | 852ms | 804 | 68 | 602 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 5.0 | 10.0 | 0.0% | 0 | 9.81s | 516 | 189 | 557 | |
| Inkling Small | 5.3 | 10.0 | 0.0% | 0 | 1.42s | 501 | 141 | 389 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 10.0 | 10.0 | 100.0% | 0 | 1.50s | 699 | 93 | 730 | |
| Inkling Small | 9.9 | 10.0 | 100.0% | 0 | 1.89s | 708 | 93 | 902 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 3.6 | 7.2 | 22.2% | 1 | 1.87s | 696 | 265 | 1,184 | |
| Inkling Small | 5.3 | 7.2 | 44.4% | 1 | 1.56s | 714 | 315 | 1,225 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 10.0 | 10.0 | 100.0% | 0 | 4.77s | 8,391 | 317 | 906 | |
| Inkling Small | 3.0 | 10.0 | 0.0% | 0 | 2.21s | 8,064 | 339 | 84 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 3.0 | 10.0 | 0.0% | 0 | 15.74s | 204 | 20 | 7,662 | |
| Inkling Small | 3.0 | 10.0 | 0.0% | 0 | 2.00s | 219 | 35 | 814 |
Quick Compare
Switch Comparison Pair
Mercury 2.5lowvsKAT Coder AIR V2.5mediumKAT Coder AIR V2.5mediumvsMiMo-V2.5-PrononeLing 3.0 FlashnonevsInkling SmalllowFree AvailableKAT Coder AIR V2.5mediumvsMistral Small 4noneNemotron 3.5 LightninghighFree AvailablevsInkling SmalllowFree AvailableKAT Coder AIR V2.5highvsInkling SmalllowFree AvailableQwen3.6 35B A3BnonevsInkling SmalllowFree AvailableLaguna XS 2.1noneFree AvailablevsInkling SmalllowFree AvailableKAT Coder AIR V2.5mediumvsNemotron 3.5 LightninghighFree AvailableMercury 2.5 PreviewlowvsKAT Coder AIR V2.5mediumMistral Small 4mediumvsInkling SmalllowFree AvailableKimi K2.5nonevsInkling SmalllowFree Available