- Rank
- #357
- Total Output Tokens
- 2,169
- Response Time (avg)
- 2.83s
- Total Cost
- $0.008
Trinity Large Preview (default) vs Nemotron 3.5 Lightning
Trinity Large Preview (default) leads on average score with 4.4 vs 3.8. Trinity Large Preview (default) has the lower benchmark cost at $0.008 vs $0.009. Trinity Large Preview (default) is faster at 2.83s vs 15.92s, with pass rates of 20.3% vs 15.9%.
Compared models
- Rank
- #375
- Total Output Tokens
- 4,779
- Response Time (avg)
- 15.92s
- Total Cost
- $0.009
Recommended model
Trinity Large Preview (default)
It has the best score here (4.4), while responding about 5.6x faster than Nemotron 3.5 Lightning.
Detailed comparison
| Metric | Trinity Large Preview Trinity Large Preview default Free Available | Nemotron 3.5 Lightning Nemotron 3.5 Lightning none Free Available |
|---|---|---|
| Score | 4.4 | 3.8 |
| Rank | #357 | #375 |
| Reliability | 10.0 | 9.8 |
| Consistency | 9.0 | 9.3 |
| Attempts | 66/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 20.3% | 15.9% |
| Flaky tests | 2 | 2 |
| Total Runs | 66 | 69 |
| Cost per result | 0.017 | 0.000 |
| Total Cost | $0.008 | $0.009 |
| Input Price | $0.243 / 1M | $0.060 / 1M |
| Output Price | $0.243 / 1M | $0.160 / 1M |
| Cache Read Price | N/A | $0.030 / 1M |
| Cache Write Price | N/A | N/A |
| Total Input Tokens | 29,828 | 97,418 |
| Output Tokens | 2,169 | 4,779 |
| Reasoning Tokens | 0 | 0 |
| Response Time (avg) | 2.83s | 15.92s |
| Response Time (max) | 14.34s | 339.57s |
| Response Time (total) | 56.65s | 366.20s |
| Parameters | 398B total (13B active) | 30B total (3B active) |
| Availability | Open source | Weights available |
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#357 Trinity Large Preview
default
No endpoints found for arcee-ai/trinity-large-preview:free.
- Cost
- $0.000
- Time
- 0.0s
- Tokens
- 0 tok
#375 Nemotron 3.5 Lightning
none- Cost
- $0.000
- Time
- 101.6s
- Tokens
- 6,775 tok
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Trinity Large Preview | 3.0 | 10.0 | 0.0% | 0 | 88ms | 0 | 0 | 0 | |
| Nemotron 3.5 Lightning | 3.0 | 10.0 | 0.0% | 0 | 339.57s | 23,344 | 2,048 | 0 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Trinity Large Preview | 3.1 | 10.0 | 0.0% | 0 | 2.07s | 651 | 550 | 0 | |
| Nemotron 3.5 Lightning | 4.8 | 10.0 | 25.0% | 0 | 2.12s | 696 | 665 | 0 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Trinity Large Preview | 3.7 | 7.7 | 11.1% | 1 | 14.34s | 738 | 397 | 0 | |
| Nemotron 3.5 Lightning | 3.1 | 7.2 | 11.1% | 1 | 1.55s | 7,623 | 589 | 0 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Trinity Large Preview | 1.5 | 5.0 | 0.0% | 0 | 8.91s | 12,053 | 294 | 0 | |
| Nemotron 3.5 Lightning | 3.0 | 10.0 | 0.0% | 0 | 2.02s | 46,425 | 579 | 0 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Trinity Large Preview | 10.0 | 10.0 | 100.0% | 0 | 3.26s | 6,900 | 186 | 0 | |
| Nemotron 3.5 Lightning | 6.5 | 10.0 | 50.0% | 0 | 633ms | 7,944 | 243 | 0 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Trinity Large Preview | 5.3 | 10.0 | 33.3% | 0 | 877ms | 738 | 25 | 0 | |
| Nemotron 3.5 Lightning | 3.0 | 10.0 | 0.0% | 0 | 683ms | 798 | 24 | 0 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Trinity Large Preview | 4.5 | 10.0 | 0.0% | 0 | 873ms | 498 | 104 | 0 | |
| Nemotron 3.5 Lightning | 4.4 | 9.9 | 0.0% | 0 | 586ms | 516 | 83 | 0 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Trinity Large Preview | 3.5 | 10.0 | 0.0% | 0 | 822ms | 678 | 63 | 0 | |
| Nemotron 3.5 Lightning | 6.5 | 10.0 | 50.0% | 0 | 511ms | 723 | 63 | 0 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Trinity Large Preview | 3.6 | 7.7 | 11.1% | 1 | 1.97s | 669 | 265 | 0 | |
| Nemotron 3.5 Lightning | 3.1 | 10.0 | 0.0% | 0 | 750ms | 726 | 227 | 0 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Trinity Large Preview | 10.0 | 10.0 | 100.0% | 0 | 6.67s | 6,699 | 267 | 0 | |
| Nemotron 3.5 Lightning | 2.8 | 1.6 | 33.3% | 1 | 1.70s | 8,416 | 246 | 0 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Trinity Large Preview | 3.0 | 10.0 | 0.0% | 0 | 777ms | 204 | 18 | 0 | |
| Nemotron 3.5 Lightning | 3.0 | 10.0 | 0.0% | 0 | 575ms | 207 | 12 | 0 |
Quick Compare
Switch Comparison Pair
Granite 4.1 8bdefaultvsNemotron 3.5 LightningnoneFree AvailableLing 3.0 TinydefaultvsNemotron 3.5 LightningnoneFree AvailableTrinity Large PreviewdefaultFree AvailablevsGranite 4.2 8BnoneTrinity Large PreviewdefaultFree AvailablevsNemotron 3 SupernoneFree AvailableTrinity Large PreviewdefaultFree AvailablevsCobuddymediumFree AvailableTrinity Large PreviewdefaultFree AvailablevsMercury 2noneLing 3.0 TinyhighvsNemotron 3.5 LightningnoneFree AvailableLing 3.0 TinylowvsNemotron 3.5 LightningnoneFree AvailableTrinity Large PreviewdefaultFree AvailablevsMiniMax M2.5mediumTrinity Large PreviewdefaultFree AvailablevsNemotron 3.5 LightninglowFree AvailableLing 3.0 TinymediumvsNemotron 3.5 LightningnoneFree AvailableTrinity Large PreviewdefaultFree AvailablevsLaguna S 2.1lowFree Available