- Rank
- #280
- Total Output Tokens
- 61,351
- Response Time (avg)
- 58.20s
- Total Cost
- $0.036
Granite 4.2 8B (low) vs MiMo-V2.6-Flash
The average score is effectively tied at 5.3 vs 5.4. Granite 4.2 8B (low) has the lower benchmark cost at $0.036 vs $0.060. MiMo-V2.6-Flash is faster at 6.20s vs 58.20s, with pass rates of 33.3% vs 30.4%.
Compared models
- Rank
- #275
- Total Output Tokens
- 75,728
- Response Time (avg)
- 6.20s
- Total Cost
- $0.060
Recommended model
MiMo-V2.6-Flash
It has the best score here (5.4), while responding about 9.4x faster than Granite 4.2 8B (low).
Detailed comparison
| Metric | Granite 4.2 8B Granite 4.2 8B low | MiMo-V2.6-Flash MiMo-V2.6-Flash none |
|---|---|---|
| Score | 5.3 | 5.4 |
| Rank | #280 | #275 |
| Reliability | 9.2 | 10.0 |
| Consistency | 9.7 | 9.2 |
| Attempts | 69/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 33.3% | 30.4% |
| Flaky tests | 1 | 2 |
| Total Runs | 69 | 69 |
| Cost per result | 0.508 | 1.000 |
| Total Cost | $0.036 | $0.060 |
| Input Price | $0.060 / 1M | $0.140 / 1M |
| Output Price | $0.250 / 1M | $0.280 / 1M |
| Total Input Tokens | 332,917 | 276,697 |
| Output Tokens | 18,989 | 75,728 |
| Reasoning Tokens | 42,362 | 0 |
| Response Time (avg) | 58.20s | 6.20s |
| Response Time (max) | 566.80s | 62.57s |
| Response Time (total) | 1338.65s | 142.63s |
| Parameters | 8B | 309B total (15B active) |
| Availability | Open source | Open source |
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#280 IBM: Granite 4.2 8B
low
Provider returned error
- Cost
- $0.000
- Time
- 0.2s
- Tokens
- 0 tok
#275 MiMo-V2.6-Flash
none- Cost
- $0.008
- Time
- 173.0s
- Tokens
- 28,061 tok
Top Models by Score
Score vs Total Cost
Response Time (avg)
Score vs Response Time (avg)
Total Output Tokens
Score vs Total Output Tokens
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Granite 4.2 8B | 6.1 | 3.1 | 66.7% | 1 | 142.68s | 258,196 | 9,784 | 23,639 | |
| MiMo-V2.6-Flash | 5.0 | 10.0 | 0.0% | 0 | 62.57s | 161,563 | 1,623 | 0 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Granite 4.2 8B | 8.3 | 10.0 | 75.0% | 0 | 11.68s | 777 | 1,463 | 898 | |
| MiMo-V2.6-Flash | 4.8 | 10.0 | 25.0% | 0 | 816ms | 645 | 514 | 0 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Granite 4.2 8B | 5.5 | 10.0 | 33.3% | 0 | 13.01s | 8,439 | 2,469 | 2,984 | |
| MiMo-V2.6-Flash | 3.7 | 7.6 | 11.1% | 1 | 744ms | 7,440 | 558 | 0 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Granite 4.2 8B | 3.0 | 10.0 | 0.0% | 0 | 298.21s | 46,805 | 4,085 | 13,637 | |
| MiMo-V2.6-Flash | 3.7 | 9.1 | 0.0% | 0 | 4.78s | 89,961 | 5,382 | 0 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Granite 4.2 8B | 6.5 | 10.0 | 50.0% | 0 | 1.39s | 7,683 | 270 | 75 | |
| MiMo-V2.6-Flash | 10.0 | 10.0 | 100.0% | 0 | 715ms | 7,758 | 249 | 0 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Granite 4.2 8B | 5.3 | 10.0 | 33.3% | 0 | 26.16s | 876 | 154 | 290 | |
| MiMo-V2.6-Flash | 5.3 | 10.0 | 33.3% | 0 | 722ms | 762 | 24 | 0 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Granite 4.2 8B | 4.0 | 10.0 | 0.0% | 0 | 659ms | 561 | 108 | 24 | |
| MiMo-V2.6-Flash | 5.0 | 10.0 | 0.0% | 0 | 779ms | 498 | 45 | 0 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Granite 4.2 8B | 3.0 | 10.0 | 0.0% | 0 | 75.80s | 402 | 84 | 378 | |
| MiMo-V2.6-Flash | 6.5 | 10.0 | 50.0% | 0 | 810ms | 684 | 66 | 0 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Granite 4.2 8B | 3.0 | 10.0 | 0.0% | 0 | 90.84s | 517 | 181 | 82 | |
| MiMo-V2.6-Flash | 3.7 | 7.2 | 22.2% | 1 | 739ms | 678 | 188 | 0 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Granite 4.2 8B | 10.0 | 10.0 | 100.0% | 0 | 2.23s | 8,412 | 358 | 265 | |
| MiMo-V2.6-Flash | 10.0 | 10.0 | 100.0% | 0 | 1.65s | 6,492 | 231 | 0 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Granite 4.2 8B | 3.0 | 10.0 | 0.0% | 0 | 5.53s | 249 | 33 | 90 | |
| MiMo-V2.6-Flash | 3.0 | 10.0 | 0.0% | 0 | 55.14s | 216 | 66,848 | 0 |
Quick Compare
Switch Comparison Pair
Step 3.5 FlashmediumvsMiMo-V2.6-FlashnoneGranite 4.2 8BlowvsGPT-5.6 LunanoneGranite 4.2 8BlowvsKimi K2.5noneHy4 previewlowvsMiMo-V2.6-FlashnoneNorth Mini CodemediumFree AvailablevsMiMo-V2.6-FlashnoneEmber-1nonevsGranite 4.2 8BlowGranite 4.2 8BlowvsStep 3.5 FlashmediumGranite 4.2 8BlowvsLaguna XS 2.1noneFree AvailableGranite 4.2 8BlowvsQwen3.6 35B A3BnoneNorth Mini CodemediumFree AvailablevsGranite 4.2 8BlowGranite 4.2 8BlowvsQwen3.8 27BnoneFree AvailableGranite 4.2 8BlowvsLing 3.0 Flashnone