- Rank
- #280
- Total Output Tokens
- 61,351
- Response Time (avg)
- 58.20s
- Total Cost
- $0.036
Granite 4.2 8B (low) vs Kimi K2.5
The average score is effectively tied at 5.3 vs 5.3. Granite 4.2 8B (low) has the lower benchmark cost at $0.036 vs $0.236. Kimi K2.5 is faster at 35.86s vs 58.20s, with pass rates of 33.3% vs 29.0%.
Compared models
- Rank
- #281
- Total Output Tokens
- 49,389
- Response Time (avg)
- 35.86s
- Total Cost
- $0.236
Recommended model
Granite 4.2 8B (low)
It has the best score here (5.3), while costing about 6.7x less than Kimi K2.5.
Detailed comparison
| Metric | Granite 4.2 8B Granite 4.2 8B low | Kimi K2.5 Kimi K2.5 none |
|---|---|---|
| Score | 5.3 | 5.3 |
| Rank | #280 | #281 |
| Reliability | 9.2 | 10.0 |
| Consistency | 9.7 | 8.6 |
| Attempts | 69/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 33.3% | 29.0% |
| Flaky tests | 1 | 4 |
| Total Runs | 69 | 69 |
| Cost per result | 0.508 | 4.976 |
| Total Cost | $0.036 | $0.236 |
| Input Price | $0.060 / 1M | $0.450 / 1M |
| Output Price | $0.250 / 1M | $2.250 / 1M |
| Total Input Tokens | 332,917 | 275,349 |
| Output Tokens | 18,989 | 49,389 |
| Reasoning Tokens | 42,362 | 0 |
| Response Time (avg) | 58.20s | 35.86s |
| Response Time (max) | 566.80s | 321.19s |
| Response Time (total) | 1338.65s | 609.61s |
| Parameters | 8B | 1T total (32B active) |
| Availability | Open source | Weights available |
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#280 IBM: Granite 4.2 8B
low
Provider returned error
- Cost
- $0.000
- Time
- 0.2s
- Tokens
- 0 tok
#281 MoonshotAI: Kimi K2.5
none- Cost
- $0.015
- Time
- 89.1s
- Tokens
- 5,421 tok
Top Models by Score
Score vs Total Cost
Response Time (avg)
Score vs Response Time (avg)
Total Output Tokens
Score vs Total Output Tokens
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Granite 4.2 8B | 6.1 | 3.1 | 66.7% | 1 | 142.68s | 258,196 | 9,784 | 23,639 | |
| Kimi K2.5 | 5.0 | 10.0 | 0.0% | 0 | 321.19s | 186,029 | 22,746 | 0 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Granite 4.2 8B | 8.3 | 10.0 | 75.0% | 0 | 11.68s | 777 | 1,463 | 898 | |
| Kimi K2.5 | 3.6 | 8.4 | 8.3% | 1 | 6.24s | 652 | 373 | 0 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Granite 4.2 8B | 5.5 | 10.0 | 33.3% | 0 | 13.01s | 8,439 | 2,469 | 2,984 | |
| Kimi K2.5 | 5.5 | 10.0 | 33.3% | 0 | 24.56s | 7,311 | 4,708 | 0 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Granite 4.2 8B | 3.0 | 10.0 | 0.0% | 0 | 298.21s | 46,805 | 4,085 | 13,637 | |
| Kimi K2.5 | 2.8 | 1.8 | 33.3% | 2 | 61.00s | 65,552 | 20,729 | 0 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Granite 4.2 8B | 6.5 | 10.0 | 50.0% | 0 | 1.39s | 7,683 | 270 | 75 | |
| Kimi K2.5 | 7.3 | 5.8 | 83.3% | 1 | 42.13s | 7,180 | 187 | 0 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Granite 4.2 8B | 5.3 | 10.0 | 33.3% | 0 | 26.16s | 876 | 154 | 290 | |
| Kimi K2.5 | 3.0 | 10.0 | 0.0% | 0 | 2.75s | 751 | 34 | 0 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Granite 4.2 8B | 4.0 | 10.0 | 0.0% | 0 | 659ms | 561 | 108 | 24 | |
| Kimi K2.5 | 10.0 | 10.0 | 100.0% | 0 | 4.00s | 483 | 76 | 0 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Granite 4.2 8B | 3.0 | 10.0 | 0.0% | 0 | 75.80s | 402 | 84 | 378 | |
| Kimi K2.5 | 6.5 | 10.0 | 50.0% | 0 | 2.67s | 677 | 60 | 0 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Granite 4.2 8B | 3.0 | 10.0 | 0.0% | 0 | 90.84s | 517 | 181 | 82 | |
| Kimi K2.5 | 3.0 | 10.0 | 0.0% | 0 | 4.04s | 667 | 236 | 0 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Granite 4.2 8B | 10.0 | 10.0 | 100.0% | 0 | 2.23s | 8,412 | 358 | 265 | |
| Kimi K2.5 | 10.0 | 10.0 | 100.0% | 0 | 13.99s | 5,835 | 220 | 0 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Granite 4.2 8B | 3.0 | 10.0 | 0.0% | 0 | 5.53s | 249 | 33 | 90 | |
| Kimi K2.5 | 3.0 | 10.0 | 0.0% | 0 | 3.90s | 212 | 20 | 0 |
Quick Compare
Switch Comparison Pair
Granite 4.2 8BlowvsGPT-5.6 LunanoneEmber-1nonevsGranite 4.2 8BlowGranite 4.2 8BlowvsStep 3.5 FlashmediumGranite 4.2 8BlowvsMiMo-V2.6-FlashnoneGranite 4.2 8BlowvsLaguna XS 2.1noneFree AvailableGranite 4.2 8BlowvsQwen3.6 35B A3BnoneKimi K2.5nonevsStep 3.5 FlashmediumNorth Mini CodemediumFree AvailablevsGranite 4.2 8BlowKimi K2.5nonevsHy4 previewlowKimi K2.5nonevsInkling SmalllowFree AvailableNorth Mini CodemediumFree AvailablevsKimi K2.5noneGranite 4.2 8BlowvsQwen3.8 27BnoneFree Available