- Rank
- #475
- Total Output Tokens
- 0
- Response Time (avg)
- 652ms
- Total Cost
- $0.006
Gemini Decision 1 (default) vs Ling 3.0 Tiny (medium)
Ling 3.0 Tiny (medium) leads on average score with 3.6 vs 2.9. Ling 3.0 Tiny (medium) has the lower benchmark cost at $0.000 vs $0.006. Gemini Decision 1 (default) is faster at 652ms vs 64.99s, with pass rates of 23.2% vs 23.2%.
Compared models
- Rank
- #457
- Total Output Tokens
- 911,748
- Response Time (avg)
- 64.99s
- Total Cost
- $0.000
Recommended model
Ling 3.0 Tiny (medium)
It has the strongest score in this comparison (3.6) and the best overall balance of cost and response time across 2 models.
Detailed comparison
| Metric | Gemini Decision 1 Gemini Decision 1 default | Ling 3.0 Tiny Ling 3.0 Tiny medium |
|---|---|---|
| Score | 2.9 | 3.6 |
| Rank | #475 | #457 |
| Reliability | 9.2 | 9.6 |
| Consistency | 4.9 | 8.9 |
| Attempts | 36/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 23.2% | 23.2% |
| Flaky tests | 1 | 3 |
| Total Runs | 36 | 69 |
| Cost per result | 0.101 | 0.000 |
| Total Cost | $0.006 | $0.000 |
| Input Price | $0.100 / 1M | $0.000 / 1M |
| Output Price | $0.000 / 1M | $0.000 / 1M |
| Cache Read Price | N/A | N/A |
| Cache Write Price | N/A | N/A |
| Total Input Tokens | 50,079 | 103,898 |
| Output Tokens | 0 | 148,304 |
| Reasoning Tokens | 0 | 774,972 |
| Response Time (avg) | 652ms | 64.99s |
| Response Time (max) | 1.27s | 262.20s |
| Response Time (total) | 7.83s | 1429.68s |
| Parameters | - | 7.9B total (1.3B active) |
| Availability | Closed | Open source |
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#475 Gemini Decision 1
default
No showcase result has been generated for this model yet.
- Cost
- N/A
- Time
- -
- Tokens
- 0 tok
#457 Ling 3.0 Tiny
medium
No output was saved. The original provider response or failure reason is unavailable.
- Cost
- $0.000
- Time
- 177.4s
- Tokens
- 6,873 tok
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini Decision 1 | 0.0 | 0.0 | 0.0% | 0 | 0ms | 0 | 0 | 0 | |
| Ling 3.0 Tiny | 3.0 | 10.0 | 0.0% | 0 | 24ms | 0 | 0 | 0 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini Decision 1 | 4.0 | 7.5 | 25.0% | 0 | 835ms | 7,188 | 0 | 0 | |
| Ling 3.0 Tiny | 6.5 | 10.0 | 50.0% | 0 | 23.73s | 750 | 5,103 | 94,884 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini Decision 1 | 4.5 | 6.7 | 33.3% | 0 | 558ms | 24,507 | 0 | 0 | |
| Ling 3.0 Tiny | 2.9 | 10.0 | 0.0% | 0 | 211.99s | 7,948 | 70,838 | 206,006 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini Decision 1 | 0.0 | 0.0 | 0.0% | 0 | 0ms | 0 | 0 | 0 | |
| Ling 3.0 Tiny | 3.0 | 10.0 | 0.0% | 0 | 139.78s | 76,108 | 17,871 | 126,497 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini Decision 1 | 10.0 | 10.0 | 100.0% | 0 | 709ms | 11,730 | 0 | 0 | |
| Ling 3.0 Tiny | 2.7 | 5.7 | 16.7% | 1 | 4.41s | 8,016 | 2,014 | 6,755 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini Decision 1 | 5.3 | 10.0 | 33.3% | 0 | 531ms | 2,769 | 0 | 0 | |
| Ling 3.0 Tiny | 3.0 | 10.0 | 0.0% | 0 | 81.40s | 637 | 21,709 | 187,100 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini Decision 1 | 0.0 | 0.0 | 0.0% | 0 | 0ms | 0 | 0 | 0 | |
| Ling 3.0 Tiny | 3.8 | 2.5 | 33.3% | 1 | 31.77s | 546 | 4,275 | 30,975 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini Decision 1 | 1.5 | 5.0 | 0.0% | 0 | 569ms | 3,351 | 0 | 0 | |
| Ling 3.0 Tiny | 6.8 | 10.0 | 50.0% | 0 | 3.00s | 744 | 610 | 1,436 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini Decision 1 | 1.6 | 1.0 | 11.1% | 1 | 624ms | 534 | 0 | 0 | |
| Ling 3.0 Tiny | 3.6 | 7.2 | 22.2% | 1 | 34.65s | 747 | 15,561 | 85,029 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini Decision 1 | 0.0 | 0.0 | 0.0% | 0 | 0ms | 0 | 0 | 0 | |
| Ling 3.0 Tiny | 10.0 | 10.0 | 100.0% | 0 | 4.91s | 8,226 | 380 | 708 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Gemini Decision 1 | 0.0 | 0.0 | 0.0% | 0 | 0ms | 0 | 0 | 0 | |
| Ling 3.0 Tiny | 3.0 | 10.0 | 0.0% | 0 | 100.96s | 176 | 9,943 | 35,582 |
Quick Compare
Switch Comparison Pair
Command A+lowvsGemini Decision 1defaultCommand A+nonevsGemini Decision 1defaultLing 3.0 TinymediumvsNemotron 3.5 LightningnoneFree AvailableGranite 4.1 8bdefaultvsLing 3.0 TinymediumCommand A+highvsGemini Decision 1defaultLing 3.0 TinymediumvsGrok 4.20noneGemini Decision 1defaultvsXing4.0 29b A4bnoneFree AvailableLing 3.0 TinymediumvsXing4.0 29b A4bnoneFree AvailableCommand A+mediumvsGemini Decision 1defaultGemini Decision 1defaultvsGrok 4.20noneLing 3.0 TinymediumvsLFM3-1.7BdefaultFree AvailableMercury 2.5nonevsLing 3.0 Tinymedium