- Rank
- #194
- Total Output Tokens
- 180,597
- Response Time (avg)
- 7.61s
- Total Cost
- $0.039
Mercury 2.5 Preview (high) vs Qwen3.5-122B-A10B
Mercury 2.5 Preview (high) leads on average score with 6.5 vs 6.4. Mercury 2.5 Preview (high) has the lower benchmark cost at $0.039 vs $0.308. Mercury 2.5 Preview (high) is faster at 7.61s vs 14.79s, with pass rates of 65.2% vs 36.2%.
Compared models
- Rank
- #201
- Total Output Tokens
- 97,112
- Response Time (avg)
- 14.79s
- Total Cost
- $0.308
Recommended model
Mercury 2.5 Preview (high)
It has the best score here (6.5), while costing about 8.0x less than Qwen3.5-122B-A10B.
Detailed comparison
| Metric | Mercury 2.5 Preview Mercury 2.5 Preview high | Qwen3.5-122B-A10B Qwen3.5-122B-A10B none |
|---|---|---|
| Score | 6.5 | 6.4 |
| Rank | #194 | #201 |
| Reliability | 9.9 | 10.0 |
| Consistency | 8.0 | 9.3 |
| Attempts | 69/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 65.2% | 36.2% |
| Flaky tests | 6 | 2 |
| Total Runs | 69 | 69 |
| Cost per result | 0.319 | 4.452 |
| Total Cost | $0.039 | $0.308 |
| Input Price | $0.000 / 1M | $0.260 / 1M |
| Output Price | $0.000 / 1M | $2.080 / 1M |
| Total Input Tokens | 298,512 | 405,921 |
| Output Tokens | 3,178 | 97,112 |
| Reasoning Tokens | 177,419 | 0 |
| Response Time (avg) | 7.61s | 14.79s |
| Response Time (max) | 86.84s | 212.63s |
| Response Time (total) | 175.08s | 340.25s |
| Parameters | ~100B | 122B total (10B active) |
| Availability | Closed | Open source |
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#194 Mercury 2.5 Preview
high- Cost
- $0.001
- Time
- 4.5s
- Tokens
- 3,851 tok
#201 Qwen3.5-122B-A10B
none- Cost
- $0.016
- Time
- 44.5s
- Tokens
- 6,431 tok
Top Models by Score
Score vs Total Cost
Response Time (avg)
Score vs Response Time (avg)
Total Output Tokens
Score vs Total Output Tokens
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 6.1 | 3.1 | 66.7% | 1 | 86.84s | 182,753 | 616 | 16,476 | |
| Qwen3.5-122B-A10B | 10.0 | 10.0 | 100.0% | 0 | 55.86s | 164,346 | 8,653 | 0 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 10.0 | 10.0 | 100.0% | 0 | 1.09s | 785 | 181 | 7,008 | |
| Qwen3.5-122B-A10B | 4.8 | 10.0 | 25.0% | 0 | 1.59s | 696 | 312 | 0 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 6.7 | 7.8 | 55.6% | 1 | 6.13s | 7,751 | 485 | 42,569 | |
| Qwen3.5-122B-A10B | 3.7 | 7.0 | 22.2% | 1 | 2.77s | 7,913 | 693 | 0 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 3.8 | 1.6 | 50.0% | 2 | 14.36s | 95,789 | 765 | 54,789 | |
| Qwen3.5-122B-A10B | 5.2 | 6.9 | 33.3% | 1 | 129.31s | 214,006 | 86,212 | 0 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 10.0 | 10.0 | 100.0% | 0 | 2.24s | 8,292 | 560 | 8,522 | |
| Qwen3.5-122B-A10B | 10.0 | 10.0 | 100.0% | 0 | 1.01s | 7,794 | 243 | 0 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 2.9 | 4.4 | 22.2% | 2 | 5.68s | 857 | 67 | 25,958 | |
| Qwen3.5-122B-A10B | 5.3 | 10.0 | 33.3% | 0 | 523ms | 798 | 16 | 0 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 5.1 | 10.0 | 0.0% | 0 | 1.88s | 542 | 94 | 3,300 | |
| Qwen3.5-122B-A10B | 5.0 | 10.0 | 0.0% | 0 | 1.12s | 522 | 66 | 0 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 9.8 | 10.0 | 100.0% | 0 | 1.05s | 741 | 94 | 3,777 | |
| Qwen3.5-122B-A10B | 6.3 | 10.0 | 50.0% | 0 | 513ms | 711 | 69 | 0 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 10.0 | 10.0 | 100.0% | 0 | 1.21s | 774 | 292 | 6,066 | |
| Qwen3.5-122B-A10B | 3.8 | 10.0 | 0.0% | 0 | 1.00s | 714 | 575 | 0 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 3.0 | 10.0 | 0.0% | 0 | 2.25s | 0 | 0 | 0 | |
| Qwen3.5-122B-A10B | 10.0 | 10.0 | 100.0% | 0 | 2.04s | 8,211 | 264 | 0 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 3.0 | 10.0 | 0.0% | 0 | 5.41s | 228 | 24 | 8,954 | |
| Qwen3.5-122B-A10B | 3.0 | 10.0 | 0.0% | 0 | 295ms | 210 | 9 | 0 |
Quick Compare
Switch Comparison Pair
Laguna XS 2.1mediumFree AvailablevsQwen3.5-122B-A10BnoneMercury 2.5 PreviewhighvsQwen3.6 35B A3BmediumQwen3.5-122B-A10BnonevsGrok 4.3mediumMercury 2.5 PreviewhighvsGLM 5.3lowKAT-Coder-Pro V2.5highvsQwen3.5-122B-A10BnoneClaude Sonnet 5.5mediumvsMercury 2.5 PreviewhighQwen3.5-122B-A10BnonevsSolar Pro 4mediumMercury 2.5 PreviewhighvsGLM 5.1noneQwen3.5-122B-A10BnonevsGLM 5.3lowMercury 2.5 PreviewhighvsGrok 4.3mediumKimi K2.5mediumvsQwen3.5-122B-A10BnoneMercury 2.5highvsQwen3.5-122B-A10Bnone