- Rank
- #287
- Total Output Tokens
- 659,693
- Response Time (avg)
- 77.08s
- Total Cost
- $0.111
Nemotron 3.5 Lightning (high) vs Laguna XS 2.1
Laguna XS 2.1 leads on average score with 5.3 vs 5.2. Laguna XS 2.1 has the lower benchmark cost at $0.019 vs $0.111. Laguna XS 2.1 is faster at 4.56s vs 77.08s, with pass rates of 47.8% vs 29.0%.
Compared models
- Rank
- #283
- Total Output Tokens
- 23,173
- Response Time (avg)
- 4.56s
- Total Cost
- $0.019
Recommended model
Laguna XS 2.1
It has the best score here (5.3), while costing about 5.8x less than Nemotron 3.5 Lightning (high).
Detailed comparison
| Metric | Nemotron 3.5 Lightning Nemotron 3.5 Lightning high Free Available | Laguna XS 2.1 Laguna XS 2.1 none Free Available |
|---|---|---|
| Score | 5.2 | 5.3 |
| Rank | #287 | #283 |
| Reliability | 9.6 | 10.0 |
| Consistency | 5.7 | 9.1 |
| Attempts | 69/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 47.8% | 29.0% |
| Flaky tests | 12 | 3 |
| Total Runs | 69 | 69 |
| Cost per result | 0.000 | 0.380 |
| Total Cost | $0.111 | $0.019 |
| Input Price | $0.060 / 1M | $0.060 / 1M |
| Output Price | $0.160 / 1M | $0.120 / 1M |
| Total Input Tokens | 170,517 | 270,072 |
| Output Tokens | 149,968 | 23,173 |
| Reasoning Tokens | 509,725 | 0 |
| Response Time (avg) | 77.08s | 4.56s |
| Response Time (max) | 490.99s | 70.79s |
| Response Time (total) | 1772.78s | 104.80s |
| Parameters | 30B total (3B active) | 33B total (3B active) |
| Availability | Weights available | Weights available |
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#287 Nemotron 3.5 Lightning
high- Cost
- $0.000
- Time
- 92.8s
- Tokens
- 11,343 tok
#283 Laguna XS 2.1
none- Cost
- $0.001
- Time
- 27.6s
- Tokens
- 4,344 tok
Top Models by Score
Score vs Total Cost
Response Time (avg)
Score vs Response Time (avg)
Total Output Tokens
Score vs Total Output Tokens
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 3.5 | 8.3 | 0.0% | 0 | 490.99s | 52,501 | 1,624 | 3,472 | |
| Laguna XS 2.1 | 5.0 | 10.0 | 0.0% | 0 | 70.79s | 178,465 | 9,796 | 0 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 5.5 | 3.7 | 66.7% | 3 | 10.29s | 696 | 2,432 | 15,948 | |
| Laguna XS 2.1 | 5.3 | 8.3 | 33.3% | 1 | 755ms | 774 | 1,015 | 0 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 4.4 | 5.1 | 33.3% | 2 | 168.41s | 7,623 | 68,533 | 242,319 | |
| Laguna XS 2.1 | 4.3 | 7.8 | 22.2% | 1 | 623ms | 7,995 | 562 | 0 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 6.4 | 10.0 | 50.0% | 0 | 160.45s | 90,257 | 17,550 | 119,725 | |
| Laguna XS 2.1 | 3.0 | 10.0 | 0.0% | 0 | 10.39s | 64,647 | 10,328 | 0 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 7.3 | 5.9 | 83.3% | 1 | 13.99s | 7,944 | 3,210 | 16,835 | |
| Laguna XS 2.1 | 10.0 | 10.0 | 100.0% | 0 | 768ms | 7,734 | 240 | 0 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 2.9 | 4.4 | 22.2% | 2 | 88.61s | 798 | 45,616 | 72,496 | |
| Laguna XS 2.1 | 5.3 | 10.0 | 33.3% | 0 | 303ms | 843 | 14 | 0 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 3.7 | 9.5 | 0.0% | 0 | 7.58s | 516 | 4,331 | 4,408 | |
| Laguna XS 2.1 | 5.0 | 10.0 | 0.0% | 0 | 529ms | 537 | 128 | 0 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 8.5 | 6.8 | 83.3% | 1 | 4.98s | 723 | 502 | 3,779 | |
| Laguna XS 2.1 | 3.8 | 5.8 | 33.3% | 1 | 364ms | 638 | 50 | 0 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 3.6 | 1.8 | 44.4% | 3 | 6.09s | 726 | 1,236 | 9,851 | |
| Laguna XS 2.1 | 3.0 | 10.0 | 0.0% | 0 | 1.01s | 771 | 730 | 0 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 10.0 | 10.0 | 100.0% | 0 | 6.92s | 8,526 | 3,745 | 3,781 | |
| Laguna XS 2.1 | 10.0 | 10.0 | 100.0% | 0 | 1.36s | 7,413 | 300 | 0 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 3.0 | 10.0 | 0.0% | 0 | 77.98s | 207 | 1,189 | 17,111 | |
| Laguna XS 2.1 | 3.0 | 10.0 | 0.0% | 0 | 254ms | 255 | 10 | 0 |
Quick Compare
Switch Comparison Pair
Ling 3.0 FlashnonevsNemotron 3.5 LightninghighFree AvailableNemotron 3.5 LightninghighFree AvailablevsInkling SmalllowFree AvailableGranite 4.2 8BlowvsLaguna XS 2.1noneFree AvailableLaguna XS 2.1noneFree AvailablevsInkling SmalllowFree AvailableMistral Small 4mediumvsNemotron 3.5 LightninghighFree AvailableMistral Small 4nonevsNemotron 3.5 LightninghighFree AvailableNemotron 3.5 LightninghighFree AvailablevsQwen3.6 35B A3BnoneMercury 2.5lowvsNemotron 3.5 LightninghighFree AvailableKAT Coder AIR V2.5mediumvsNemotron 3.5 LightninghighFree AvailableNemotron 3.5 LightninghighFree AvailablevsMiMo-V2.5-PrononeLaguna XS 2.1noneFree AvailablevsStep 3.5 FlashmediumKAT Coder AIR V2.5highvsLaguna XS 2.1noneFree Available