- Rank
- #269
- Total Output Tokens
- 1,890
- Response Time (avg)
- 6.00s
- Total Cost
- $0.017
Gemini 2.5 Flash vs Granite 4.2 8B (low)
Gemini 2.5 Flash leads on average score with 5.5 vs 5.3. Gemini 2.5 Flash has the lower benchmark cost at $0.017 vs $0.036. Gemini 2.5 Flash is faster at 6.00s vs 58.20s, with pass rates of 37.7% vs 33.3%.
Compared models
- Rank
- #283
- Total Output Tokens
- 61,351
- Response Time (avg)
- 58.20s
- Total Cost
- $0.036
Recommended model
Gemini 2.5 Flash
It has the best score here (5.5), while costing about 2.1x less than Granite 4.2 8B (low).
Detailed comparison
| Metric | Gemini 2.5 Flash Gemini 2.5 Flash none | Granite 4.2 8B Granite 4.2 8B low |
|---|---|---|
| Score | 5.5 | 5.3 |
| Rank | #269 | #283 |
| Reliability | 10.0 | 9.2 |
| Consistency | 9.6 | 9.7 |
| Attempts | 69/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 37.7% | 33.3% |
| Flaky tests | 1 | 1 |
| Total Runs | 69 | 69 |
| Cost per result | 0.209 | 0.508 |
| Total Cost | $0.017 | $0.036 |
| Input Price | $0.300 / 1M | $0.060 / 1M |
| Output Price | $2.500 / 1M | $0.250 / 1M |
| Cache Read Price | $0.030 / 1M | $0.015 / 1M |
| Cache Write Price | $0.084 / 1M | N/A |
| Total Input Tokens | 39,886 | 332,917 |
| Output Tokens | 1,890 | 18,989 |
| Reasoning Tokens | 0 | 42,362 |
| Response Time (avg) | 6.00s | 58.20s |
| Response Time (max) | 118.00s | 566.80s |
| Response Time (total) | 138.04s | 1338.65s |
| Parameters | ~350B total (~20B active) | 8B |
| Availability | Closed | Open source |
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#269 Gemini 2.5 Flash
none
Invalid SVG
- Cost
- $0.164
- Time
- 215.5s
- Tokens
- 65,659 tok
#283 IBM: Granite 4.2 8B
low
Provider returned error
- Cost
- $0.000
- Time
- 0.2s
- Tokens
- 0 tok
Top Models by Score
Score vs Total Cost
Response Time (avg)
Score vs Response Time (avg)
Total Output Tokens
Score vs Total Output Tokens
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 2.5 Flash | 3.0 | 10.0 | 0.0% | 0 | 1.81s | 0 | 0 | 0 | |
| Granite 4.2 8B | 6.1 | 3.1 | 66.7% | 1 | 142.68s | 258,196 | 9,784 | 23,639 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 2.5 Flash | 3.0 | 10.0 | 0.0% | 0 | 582ms | 492 | 102 | 0 | |
| Granite 4.2 8B | 8.3 | 10.0 | 75.0% | 0 | 11.68s | 777 | 1,463 | 898 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 2.5 Flash | 5.5 | 10.0 | 33.3% | 0 | 736ms | 8,122 | 483 | 0 | |
| Granite 4.2 8B | 5.5 | 10.0 | 33.3% | 0 | 13.01s | 8,439 | 2,469 | 2,984 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 2.5 Flash | 3.0 | 10.0 | 0.0% | 0 | 61.19s | 16,470 | 486 | 0 | |
| Granite 4.2 8B | 3.0 | 10.0 | 0.0% | 0 | 298.21s | 46,805 | 4,085 | 13,637 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 2.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 652ms | 7,257 | 279 | 0 | |
| Granite 4.2 8B | 6.5 | 10.0 | 50.0% | 0 | 1.39s | 7,683 | 270 | 75 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 2.5 Flash | 3.6 | 7.2 | 22.2% | 1 | 449ms | 642 | 12 | 0 | |
| Granite 4.2 8B | 5.3 | 10.0 | 33.3% | 0 | 26.16s | 876 | 154 | 290 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 2.5 Flash | 5.0 | 10.0 | 0.0% | 0 | 615ms | 486 | 78 | 0 | |
| Granite 4.2 8B | 4.0 | 10.0 | 0.0% | 0 | 659ms | 561 | 108 | 24 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 2.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 590ms | 615 | 72 | 0 | |
| Granite 4.2 8B | 3.0 | 10.0 | 0.0% | 0 | 75.80s | 402 | 84 | 378 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 2.5 Flash | 7.7 | 10.0 | 66.7% | 0 | 604ms | 558 | 132 | 0 | |
| Granite 4.2 8B | 3.0 | 10.0 | 0.0% | 0 | 90.84s | 517 | 181 | 82 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 2.5 Flash | 10.0 | 10.0 | 100.0% | 0 | 1.91s | 5,088 | 234 | 0 | |
| Granite 4.2 8B | 10.0 | 10.0 | 100.0% | 0 | 2.23s | 8,412 | 358 | 265 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini 2.5 Flash | 3.0 | 10.0 | 0.0% | 0 | 1.15s | 156 | 12 | 0 | |
| Granite 4.2 8B | 3.0 | 10.0 | 0.0% | 0 | 5.53s | 249 | 33 | 90 |
Quick Compare
Switch Comparison Pair
Granite 4.2 8BlowvsGPT-5.6 LunanoneGranite 4.2 8BlowvsKimi K2.5noneEmber-1nonevsGranite 4.2 8BlowGranite 4.2 8BlowvsStep 3.5 FlashmediumGranite 4.2 8BlowvsMiMo-V2.6-FlashnoneGranite 4.2 8BlowvsLaguna XS 2.1noneFree AvailableGranite 4.2 8BlowvsQwen3.6 35B A3BnoneGemini 2.5 FlashnonevsNemotron 3 SupermediumFree AvailableNorth Mini CodemediumFree AvailablevsGranite 4.2 8BlowNorth Mini CodemediumFree AvailablevsGemini 2.5 FlashnoneGemini 2.5 FlashnonevsHy4 previewlowGranite 4.2 8BlowvsQwen3.8 27BnoneFree Available