- Rank
- #283
- Total Output Tokens
- 23,173
- Response Time (avg)
- 4.56s
- Total Cost
- $0.019
Laguna XS 2.1 vs Inkling Small (low)
Laguna XS 2.1 leads on average score with 5.3 vs 5.2. Laguna XS 2.1 has the lower benchmark cost at $0.019 vs $0.059. Inkling Small (low) is faster at 1.99s vs 4.56s, with pass rates of 29.0% vs 47.8%.
Compared models
- Rank
- #285
- Total Output Tokens
- 14,686
- Response Time (avg)
- 1.99s
- Total Cost
- $0.059
Recommended model
Inkling Small (low)
Its score stays close to the best score here (5.2 vs 5.3), while responding about 2.3x faster than Laguna XS 2.1.
Detailed comparison
| Metric | Laguna XS 2.1 Laguna XS 2.1 none Free Available | Inkling Small Inkling Small low Free Available |
|---|---|---|
| Score | 5.3 | 5.2 |
| Rank | #283 | #285 |
| Reliability | 10.0 | 10.0 |
| Consistency | 9.1 | 8.7 |
| Attempts | 69/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 29.0% | 47.8% |
| Flaky tests | 3 | 4 |
| Total Runs | 69 | 69 |
| Cost per result | 0.380 | 0.649 |
| Total Cost | $0.019 | $0.059 |
| Input Price | $0.060 / 1M | $0.450 / 1M |
| Output Price | $0.120 / 1M | $1.200 / 1M |
| Total Input Tokens | 270,072 | 81,447 |
| Output Tokens | 23,173 | 2,715 |
| Reasoning Tokens | 0 | 11,971 |
| Response Time (avg) | 4.56s | 1.99s |
| Response Time (max) | 70.79s | 5.82s |
| Response Time (total) | 104.80s | 45.67s |
| Parameters | 33B total (3B active) | 276B total (12B active) |
| Availability | Weights available | Closed |
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#283 Laguna XS 2.1
none- Cost
- $0.001
- Time
- 27.6s
- Tokens
- 4,344 tok
#285 Thinking Machines: Inkling Small
low- Cost
- $0.001
- Time
- 5.9s
- Tokens
- 759 tok
Top Models by Score
Score vs Total Cost
Response Time (avg)
Score vs Response Time (avg)
Total Output Tokens
Score vs Total Output Tokens
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Laguna XS 2.1 | 5.0 | 10.0 | 0.0% | 0 | 70.79s | 178,465 | 9,796 | 0 | |
| Inkling Small | 3.0 | 10.0 | 0.0% | 0 | 24ms | 0 | 0 | 0 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Laguna XS 2.1 | 5.3 | 8.3 | 33.3% | 1 | 755ms | 774 | 1,015 | 0 | |
| Inkling Small | 9.2 | 8.4 | 91.7% | 1 | 1.81s | 702 | 240 | 1,831 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Laguna XS 2.1 | 4.3 | 7.8 | 22.2% | 1 | 623ms | 7,995 | 562 | 0 | |
| Inkling Small | 4.6 | 5.0 | 33.3% | 2 | 3.70s | 7,374 | 375 | 4,332 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Laguna XS 2.1 | 3.0 | 10.0 | 0.0% | 0 | 10.39s | 64,647 | 10,328 | 0 | |
| Inkling Small | 3.0 | 10.0 | 0.0% | 0 | 4.08s | 55,293 | 893 | 1,420 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Laguna XS 2.1 | 10.0 | 10.0 | 100.0% | 0 | 768ms | 7,734 | 240 | 0 | |
| Inkling Small | 10.0 | 10.0 | 100.0% | 0 | 1.25s | 7,068 | 216 | 372 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Laguna XS 2.1 | 5.3 | 10.0 | 33.3% | 0 | 303ms | 843 | 14 | 0 | |
| Inkling Small | 5.3 | 10.0 | 33.3% | 0 | 852ms | 804 | 68 | 602 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Laguna XS 2.1 | 5.0 | 10.0 | 0.0% | 0 | 529ms | 537 | 128 | 0 | |
| Inkling Small | 5.3 | 10.0 | 0.0% | 0 | 1.42s | 501 | 141 | 389 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Laguna XS 2.1 | 3.8 | 5.8 | 33.3% | 1 | 364ms | 638 | 50 | 0 | |
| Inkling Small | 9.9 | 10.0 | 100.0% | 0 | 1.89s | 708 | 93 | 902 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Laguna XS 2.1 | 3.0 | 10.0 | 0.0% | 0 | 1.01s | 771 | 730 | 0 | |
| Inkling Small | 5.3 | 7.2 | 44.4% | 1 | 1.56s | 714 | 315 | 1,225 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Laguna XS 2.1 | 10.0 | 10.0 | 100.0% | 0 | 1.36s | 7,413 | 300 | 0 | |
| Inkling Small | 3.0 | 10.0 | 0.0% | 0 | 2.21s | 8,064 | 339 | 84 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Laguna XS 2.1 | 3.0 | 10.0 | 0.0% | 0 | 254ms | 255 | 10 | 0 | |
| Inkling Small | 3.0 | 10.0 | 0.0% | 0 | 2.00s | 219 | 35 | 814 |
Quick Compare
Switch Comparison Pair
Ling 3.0 FlashnonevsInkling SmalllowFree AvailableNemotron 3.5 LightninghighFree AvailablevsInkling SmalllowFree AvailableKAT Coder AIR V2.5highvsInkling SmalllowFree AvailableQwen3.6 35B A3BnonevsInkling SmalllowFree AvailableGranite 4.2 8BlowvsLaguna XS 2.1noneFree AvailableNemotron 3.5 LightninghighFree AvailablevsLaguna XS 2.1noneFree AvailableMistral Small 4mediumvsInkling SmalllowFree AvailableKimi K2.5nonevsInkling SmalllowFree AvailableMistral Small 4nonevsInkling SmalllowFree AvailableLaguna XS 2.1noneFree AvailablevsStep 3.5 FlashmediumKAT Coder AIR V2.5highvsLaguna XS 2.1noneFree AvailableGPT-5.6 LunanonevsInkling SmalllowFree Available