- Rank
- #264
- Total Output Tokens
- 10,554
- Response Time (avg)
- 3.47s
- Total Cost
- $0.147
Inkling vs MiMo-V2.5
Inkling leads on average score with 5.2 vs 5.1. MiMo-V2.5 has the lower benchmark cost at $0.025 vs $0.147. Inkling is faster at 3.47s vs 4.68s, with pass rates of 28.8% vs 27.3%.
Compared models
- Rank
- #272
- Total Output Tokens
- 16,464
- Response Time (avg)
- 4.68s
- Total Cost
- $0.025
Recommended model
MiMo-V2.5
Its score stays close to the best score here (5.1 vs 5.2), while costing about 6.0x less than Inkling.
Detailed comparison
| Metric | Inkling Inkling none | MiMo-V2.5 MiMo-V2.5 none |
|---|---|---|
| Score | 5.2 | 5.1 |
| Rank | #264 | #272 |
| Reliability | 10.0 | 10.0 |
| Consistency | 9.6 | 9.2 |
| Attempts | 66/66 | 66/66 |
| Tests Correct | ||
| Attempt pass rate | 28.8% | 27.3% |
| Flaky tests | 1 | 2 |
| Total Runs | 66 | 66 |
| Cost per result | 2.448 | 0.769 |
| Total Cost | $0.147 | $0.025 |
| Input Price | $1.000 / 1M | $0.140 / 1M |
| Output Price | $4.050 / 1M | $0.280 / 1M |
| Total Input Tokens | 104,120 | 141,052 |
| Output Tokens | 10,554 | 16,464 |
| Reasoning Tokens | 0 | 0 |
| Response Time (avg) | 3.47s | 4.68s |
| Response Time (max) | 48.02s | 55.36s |
| Response Time (total) | 76.28s | 103.02s |
| Parameters | 975B total (41B active) | 310B total (15B active) |
| Availability | Open source | Open source |
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#264 Thinking Machines: Inkling
none
Provider returned error
- Cost
- $0.000
- Time
- 5.3s
- Tokens
- 0 tok
#272 MiMo-V2.5
none- Cost
- $0.007
- Time
- 267.4s
- Tokens
- 25,283 tok
Top Models by Score
Score vs Total Cost
Response Time (avg)
Score vs Response Time (avg)
Total Output Tokens
Score vs Total Output Tokens
Category Breakdown
Quick Compare
Switch Comparison Pair
Granite 4.2 8BmediumvsInklingnoneMercury 2.5lowvsMiMo-V2.5noneGranite 4.2 8BlowvsMiMo-V2.5noneMistral Small 4mediumvsMiMo-V2.5noneNemotron 3.5 LightningmediumFree AvailablevsMiMo-V2.5noneMiniMax M2.7mediumvsMiMo-V2.5noneNemotron 3.5 LightningmediumFree AvailablevsInklingnoneMistral Small 4mediumvsInklingnoneGranite 4.2 8BlowvsInklingnoneMercury 2.5 PreviewlowvsMiMo-V2.5noneMercury 2.5lowvsInklingnoneLaguna S 2.1lowFree AvailablevsMiMo-V2.5none