- Rank
- #338
- Total Output Tokens
- 9,709
- Response Time (avg)
- 1.18s
- Total Cost
- $0.033
Mercury 2 vs Ling 3.0 Tiny (medium)
Mercury 2 leads on average score with 4.4 vs 3.6. Ling 3.0 Tiny (medium) has the lower benchmark cost at $0.000 vs $0.033. Mercury 2 is faster at 1.18s vs 64.99s, with pass rates of 23.2% vs 23.2%.
Compared models
- Rank
- #356
- Total Output Tokens
- 923,276
- Response Time (avg)
- 64.99s
- Total Cost
- $0.000
Recommended model
Mercury 2
It has the best score here (4.4), while responding about 55.1x faster than Ling 3.0 Tiny (medium).
Detailed comparison
| Metric | Mercury 2 Mercury 2 none | Ling 3.0 Tiny Ling 3.0 Tiny medium |
|---|---|---|
| Score | 4.4 | 3.6 |
| Rank | #338 | #356 |
| Reliability | 10.0 | 9.6 |
| Consistency | 9.2 | 8.9 |
| Attempts | 69/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 23.2% | 23.2% |
| Flaky tests | 2 | 3 |
| Total Runs | 69 | 69 |
| Cost per result | 0.812 | 0.000 |
| Total Cost | $0.033 | $0.000 |
| Input Price | $0.250 / 1M | $0.000 / 1M |
| Output Price | $0.750 / 1M | $0.000 / 1M |
| Total Input Tokens | 100,634 | 103,898 |
| Output Tokens | 9,709 | 148,304 |
| Reasoning Tokens | 0 | 774,972 |
| Response Time (avg) | 1.18s | 64.99s |
| Response Time (max) | 9.00s | 262.20s |
| Response Time (total) | 27.14s | 1429.68s |
| Parameters | ~100B | 7.9B total (1.3B active) |
| Availability | Closed | Open source |
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#338 Mercury 2
none- Cost
- $0.002
- Time
- 1.8s
- Tokens
- 1,514 tok
#356 Ling 3.0 Tiny
medium
No output was saved. The original provider response or failure reason is unavailable.
- Cost
- $0.000
- Time
- 177.4s
- Tokens
- 6,873 tok
Top Models by Score
Score vs Total Cost
Response Time (avg)
Score vs Response Time (avg)
Total Output Tokens
Score vs Total Output Tokens
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2 | 3.0 | 10.0 | 0.0% | 0 | 9.00s | 10,997 | 125 | 0 | |
| Ling 3.0 Tiny | 3.0 | 10.0 | 0.0% | 0 | 24ms | 0 | 0 | 0 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2 | 3.0 | 10.0 | 0.0% | 0 | 483ms | 631 | 286 | 0 | |
| Ling 3.0 Tiny | 6.5 | 10.0 | 50.0% | 0 | 23.73s | 750 | 5,103 | 94,884 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2 | 3.4 | 9.6 | 0.0% | 0 | 1.03s | 7,229 | 3,088 | 0 | |
| Ling 3.0 Tiny | 2.9 | 10.0 | 0.0% | 0 | 211.99s | 7,948 | 70,838 | 206,006 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2 | 3.0 | 10.0 | 0.0% | 0 | 2.56s | 65,412 | 5,256 | 0 | |
| Ling 3.0 Tiny | 3.0 | 10.0 | 0.0% | 0 | 139.78s | 76,108 | 17,871 | 126,497 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2 | 7.3 | 5.9 | 83.3% | 1 | 667ms | 6,362 | 180 | 0 | |
| Ling 3.0 Tiny | 2.7 | 5.7 | 16.7% | 1 | 4.41s | 8,016 | 2,014 | 6,755 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2 | 5.9 | 7.2 | 55.6% | 1 | 500ms | 1,717 | 66 | 0 | |
| Ling 3.0 Tiny | 3.0 | 10.0 | 0.0% | 0 | 81.40s | 637 | 21,709 | 187,100 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2 | 4.8 | 10.0 | 0.0% | 0 | 628ms | 495 | 159 | 0 | |
| Ling 3.0 Tiny | 3.8 | 2.5 | 33.3% | 1 | 31.77s | 546 | 4,275 | 30,975 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2 | 6.5 | 10.0 | 50.0% | 0 | 551ms | 691 | 82 | 0 | |
| Ling 3.0 Tiny | 6.8 | 10.0 | 50.0% | 0 | 3.00s | 744 | 610 | 1,436 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2 | 3.1 | 10.0 | 0.0% | 0 | 535ms | 694 | 251 | 0 | |
| Ling 3.0 Tiny | 3.6 | 7.2 | 22.2% | 1 | 34.65s | 747 | 15,561 | 85,029 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2 | 10.0 | 10.0 | 100.0% | 0 | 1.27s | 6,193 | 197 | 0 | |
| Ling 3.0 Tiny | 10.0 | 10.0 | 100.0% | 0 | 4.91s | 8,226 | 380 | 708 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2 | 3.0 | 10.0 | 0.0% | 0 | 548ms | 213 | 19 | 0 | |
| Ling 3.0 Tiny | 3.0 | 10.0 | 0.0% | 0 | 100.96s | 176 | 9,943 | 35,582 |
Quick Compare
Switch Comparison Pair
CobuddymediumFree AvailablevsMercury 2noneMercury 2nonevsMiniMax M2.5mediumMercury 2nonevsGLM 4.7 FlashmediumLing 3.0 TinymediumvsNemotron 3.5 LightningnoneFree AvailableGranite 4.1 8bnonevsLing 3.0 TinymediumMercury 2nonevsNemotron 3.5 LightninglowFree AvailableMercury 2nonevsLaguna S 2.1lowFree AvailableLing 3.0 TinymediumvsGrok 4.20noneMercury 2nonevsQwen3 Coder NextmediumGranite 4.2 8BhighvsMercury 2noneMercury 2nonevsQwen3.5-9BmediumMercury 2nonevsNemotron 3.5 LightningmediumFree Available