- Rank
- #385
- Total Output Tokens
- 626,081
- Response Time (avg)
- 77.08s
- Total Cost
- $0.168
Nemotron 3.5 Lightning (high) vs Laguna XS 2.1
Laguna XS 2.1 leads on average score with 5.3 vs 5.2. Laguna XS 2.1 has the lower benchmark cost at $0.020 vs $0.168. Laguna XS 2.1 is faster at 4.56s vs 77.08s, with pass rates of 47.8% vs 29.0%.
Compared models
- Rank
- #381
- Total Output Tokens
- 23,173
- Response Time (avg)
- 4.56s
- Total Cost
- $0.020
Recommended model
Laguna XS 2.1
It has the best score here (5.3), while costing about 8.8x less than Nemotron 3.5 Lightning (high).
Detailed comparison
| Metric | Nemotron 3.5 Lightning Nemotron 3.5 Lightning high Free Available | Laguna XS 2.1 Laguna XS 2.1 none Free Available |
|---|---|---|
| Score | 5.2 | 5.3 |
| Rank | #385 | #381 |
| Reliability | 9.6 | 10.0 |
| Consistency | 5.7 | 9.1 |
| Attempts | 69/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 47.8% | 29.0% |
| Flaky tests | 12 | 3 |
| Total Runs | 69 | 69 |
| Cost per result | 0.000 | 0.380 |
| Total Cost | $0.168 | $0.020 |
| Input Price | $0.060 / 1M | $0.060 / 1M |
| Output Price | $0.160 / 1M | $0.120 / 1M |
| Cache Read Price | $0.030 / 1M | $0.030 / 1M |
| Cache Write Price | N/A | N/A |
| Total Input Tokens | 170,517 | 270,072 |
| Output Tokens | 149,968 | 23,173 |
| Reasoning Tokens | 509,725 | 0 |
| Response Time (avg) | 77.08s | 4.56s |
| Response Time (max) | 490.99s | 70.79s |
| Response Time (total) | 1772.78s | 104.80s |
| Parameters | 30B total (3B active) | 33B total (3B active) |
| Availability | Weights available | Weights available |
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#385 Nemotron 3.5 Lightning
high- Cost
- $0.000
- Time
- 92.8s
- Tokens
- 11,343 tok
#381 Laguna XS 2.1
none- Cost
- $0.001
- Time
- 27.6s
- Tokens
- 4,344 tok
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 3.5 | 8.3 | 0.0% | 0 | 490.99s | 52,501 | 1,624 | 3,472 | |
| Laguna XS 2.1 | 5.0 | 10.0 | 0.0% | 0 | 70.79s | 178,465 | 9,796 | 0 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 5.5 | 3.7 | 66.7% | 3 | 10.29s | 696 | 2,432 | 15,948 | |
| Laguna XS 2.1 | 5.3 | 8.3 | 33.3% | 1 | 755ms | 774 | 1,015 | 0 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 4.4 | 5.1 | 33.3% | 2 | 168.41s | 7,623 | 68,533 | 242,319 | |
| Laguna XS 2.1 | 4.3 | 7.8 | 22.2% | 1 | 623ms | 7,995 | 562 | 0 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 6.4 | 10.0 | 50.0% | 0 | 160.45s | 90,257 | 17,550 | 119,725 | |
| Laguna XS 2.1 | 3.0 | 10.0 | 0.0% | 0 | 10.39s | 64,647 | 10,328 | 0 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 7.3 | 5.9 | 83.3% | 1 | 13.99s | 7,944 | 3,210 | 16,835 | |
| Laguna XS 2.1 | 10.0 | 10.0 | 100.0% | 0 | 768ms | 7,734 | 240 | 0 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 2.9 | 4.4 | 22.2% | 2 | 88.61s | 798 | 45,616 | 72,496 | |
| Laguna XS 2.1 | 5.3 | 10.0 | 33.3% | 0 | 303ms | 843 | 14 | 0 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 3.7 | 9.5 | 0.0% | 0 | 7.58s | 516 | 4,331 | 4,408 | |
| Laguna XS 2.1 | 5.0 | 10.0 | 0.0% | 0 | 529ms | 537 | 128 | 0 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 8.5 | 6.8 | 83.3% | 1 | 4.98s | 723 | 502 | 3,779 | |
| Laguna XS 2.1 | 3.8 | 5.8 | 33.3% | 1 | 364ms | 638 | 50 | 0 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 3.6 | 1.8 | 44.4% | 3 | 6.09s | 726 | 1,236 | 9,851 | |
| Laguna XS 2.1 | 3.0 | 10.0 | 0.0% | 0 | 1.01s | 771 | 730 | 0 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 10.0 | 10.0 | 100.0% | 0 | 6.92s | 8,526 | 3,745 | 3,781 | |
| Laguna XS 2.1 | 10.0 | 10.0 | 100.0% | 0 | 1.36s | 7,413 | 300 | 0 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 3.0 | 10.0 | 0.0% | 0 | 77.98s | 207 | 1,189 | 17,111 | |
| Laguna XS 2.1 | 3.0 | 10.0 | 0.0% | 0 | 254ms | 255 | 10 | 0 |
Quick Compare
Switch Comparison Pair
Ling 3.0 FlashnonevsNemotron 3.5 LightninghighFree AvailableNemotron 3.5 LightninghighFree AvailablevsInkling SmalllowFree AvailableGranite 4.2 8BlowvsLaguna XS 2.1noneFree AvailableLaguna XS 2.1noneFree AvailablevsInkling SmalllowFree AvailableMistral Small 4mediumvsNemotron 3.5 LightninghighFree AvailableMistral Small 4nonevsNemotron 3.5 LightninghighFree AvailableNemotron 3.5 LightninghighFree AvailablevsQwen3.6 35B A3BnoneMercury 2.5lowvsNemotron 3.5 LightninghighFree AvailableKAT Coder AIR V2.5mediumvsNemotron 3.5 LightninghighFree AvailableNemotron 3.5 LightninghighFree AvailablevsMiMo-V2.5-PrononeLaguna XS 2.1noneFree AvailablevsStep 3.5 FlashmediumKAT Coder AIR V2.5highvsLaguna XS 2.1noneFree Available