- Rank
- #379
- Total Output Tokens
- 2,169
- Response Time (avg)
- 2.83s
- Total Cost
- $0.008
Trinity Large Preview (default) vs Mercury 2
Trinity Large Preview (default) leads on average score with 4.4 vs 4.4. Trinity Large Preview (default) has the lower benchmark cost at $0.008 vs $0.033. Mercury 2 is faster at 1.18s vs 2.83s, with pass rates of 20.3% vs 23.2%.
Compared models
- Rank
- #382
- Total Output Tokens
- 9,709
- Response Time (avg)
- 1.18s
- Total Cost
- $0.033
Recommended model
Mercury 2
Its score stays close to the best score here (4.4 vs 4.4), while responding about 2.4x faster than Trinity Large Preview (default).
Detailed comparison
| Metric | Trinity Large Preview Trinity Large Preview default Free Available | Mercury 2 Mercury 2 none |
|---|---|---|
| Score | 4.4 | 4.4 |
| Rank | #379 | #382 |
| Reliability | 10.0 | 10.0 |
| Consistency | 9.0 | 9.2 |
| Attempts | 66/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 20.3% | 23.2% |
| Flaky tests | 2 | 2 |
| Total Runs | 66 | 69 |
| Cost per result | 0.017 | 0.812 |
| Total Cost | $0.008 | $0.033 |
| Input Price | $0.243 / 1M | $0.250 / 1M |
| Output Price | $0.243 / 1M | $0.750 / 1M |
| Cache Read Price | N/A | $0.025 / 1M |
| Cache Write Price | N/A | N/A |
| Total Input Tokens | 29,828 | 100,634 |
| Output Tokens | 2,169 | 9,609 |
| Reasoning Tokens | 0 | 100 |
| Response Time (avg) | 2.83s | 1.18s |
| Response Time (max) | 14.34s | 9.00s |
| Response Time (total) | 56.65s | 27.14s |
| Parameters | 398B total (13B active) | ~100B |
| Availability | Open source | Closed |
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#379 Trinity Large Preview
default
No endpoints found for arcee-ai/trinity-large-preview:free.
- Cost
- $0.000
- Time
- 0.0s
- Tokens
- 0 tok
#382 Mercury 2
none- Cost
- $0.002
- Time
- 1.8s
- Tokens
- 1,514 tok
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Trinity Large Preview | 3.0 | 10.0 | 0.0% | 0 | 88ms | 0 | 0 | 0 | |
| Mercury 2 | 3.0 | 10.0 | 0.0% | 0 | 9.00s | 10,997 | 80 | 45 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Trinity Large Preview | 3.1 | 10.0 | 0.0% | 0 | 2.07s | 651 | 550 | 0 | |
| Mercury 2 | 3.0 | 10.0 | 0.0% | 0 | 483ms | 631 | 286 | 0 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Trinity Large Preview | 3.7 | 7.7 | 11.1% | 1 | 14.34s | 738 | 397 | 0 | |
| Mercury 2 | 3.4 | 9.6 | 0.0% | 0 | 1.03s | 7,229 | 3,088 | 0 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Trinity Large Preview | 1.5 | 5.0 | 0.0% | 0 | 8.91s | 12,053 | 294 | 0 | |
| Mercury 2 | 3.0 | 10.0 | 0.0% | 0 | 2.56s | 65,412 | 5,215 | 41 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Trinity Large Preview | 10.0 | 10.0 | 100.0% | 0 | 3.26s | 6,900 | 186 | 0 | |
| Mercury 2 | 7.3 | 5.9 | 83.3% | 1 | 667ms | 6,362 | 180 | 0 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Trinity Large Preview | 5.3 | 10.0 | 33.3% | 0 | 877ms | 738 | 25 | 0 | |
| Mercury 2 | 5.9 | 7.2 | 55.6% | 1 | 500ms | 1,717 | 52 | 14 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Trinity Large Preview | 4.5 | 10.0 | 0.0% | 0 | 873ms | 498 | 104 | 0 | |
| Mercury 2 | 4.8 | 10.0 | 0.0% | 0 | 628ms | 495 | 159 | 0 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Trinity Large Preview | 3.5 | 10.0 | 0.0% | 0 | 822ms | 678 | 63 | 0 | |
| Mercury 2 | 6.5 | 10.0 | 50.0% | 0 | 551ms | 691 | 82 | 0 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Trinity Large Preview | 3.6 | 7.7 | 11.1% | 1 | 1.97s | 669 | 265 | 0 | |
| Mercury 2 | 3.1 | 10.0 | 0.0% | 0 | 535ms | 694 | 251 | 0 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Trinity Large Preview | 10.0 | 10.0 | 100.0% | 0 | 6.67s | 6,699 | 267 | 0 | |
| Mercury 2 | 10.0 | 10.0 | 100.0% | 0 | 1.27s | 6,193 | 197 | 0 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Trinity Large Preview | 3.0 | 10.0 | 0.0% | 0 | 777ms | 204 | 18 | 0 | |
| Mercury 2 | 3.0 | 10.0 | 0.0% | 0 | 548ms | 213 | 19 | 0 |
Quick Compare
Switch Comparison Pair
CobuddymediumFree AvailablevsMercury 2noneTrinity Large PreviewdefaultFree AvailablevsGranite 4.2 8BnoneTrinity Large PreviewdefaultFree AvailablevsNemotron 3 SupernoneFree AvailableTrinity Large PreviewdefaultFree AvailablevsCobuddymediumFree AvailableMercury 2nonevsMiniMax M2.5mediumMercury 2nonevsKAT Coder AIR V2.5defaultMercury 2nonevsRing 2.6 1tdefaultMercury 2nonevsGLM 4.7 FlashmediumTrinity Large PreviewdefaultFree AvailablevsMiniMax M2.5mediumTrinity Large PreviewdefaultFree AvailablevsNemotron 3.5 LightninglowFree AvailableMercury 2nonevsLing 2.6 FlashdefaultTrinity Large PreviewdefaultFree AvailablevsLaguna S 2.1lowFree Available