- Rank
- #319
- Total Output Tokens
- 766,130
- Response Time (avg)
- 81.93s
- Total Cost
- $0.195
Nemotron 3.5 Lightning (medium) vs Qwen3 Coder Next (medium)
Nemotron 3.5 Lightning (medium) leads on average score with 4.7 vs 4.7. Qwen3 Coder Next (medium) has the lower benchmark cost at $0.071 vs $0.195. Qwen3 Coder Next (medium) is faster at 16.97s vs 81.93s, with pass rates of 47.8% vs 24.6%.
Compared models
- Rank
- #323
- Total Output Tokens
- 40,395
- Response Time (avg)
- 16.97s
- Total Cost
- $0.071
Recommended model
Qwen3 Coder Next (medium)
Its score stays close to the best score here (4.7 vs 4.7), while costing about 2.8x less than Nemotron 3.5 Lightning (medium).
Detailed comparison
| Metric | Nemotron 3.5 Lightning Nemotron 3.5 Lightning medium Free Available | Qwen3 Coder Next Qwen3 Coder Next medium |
|---|---|---|
| Score | 4.7 | 4.7 |
| Rank | #319 | #323 |
| Reliability | 9.8 | 10.0 |
| Consistency | 5.8 | 8.7 |
| Attempts | 69/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 47.8% | 24.6% |
| Flaky tests | 12 | 4 |
| Total Runs | 69 | 69 |
| Cost per result | 0.000 | 2.280 |
| Total Cost | $0.195 | $0.071 |
| Input Price | $0.060 / 1M | $0.120 / 1M |
| Output Price | $0.160 / 1M | $0.800 / 1M |
| Cache Read Price | $0.030 / 1M | $0.070 / 1M |
| Cache Write Price | N/A | N/A |
| Total Input Tokens | 195,780 | 311,647 |
| Output Tokens | 167,746 | 40,395 |
| Reasoning Tokens | 598,384 | 0 |
| Response Time (avg) | 81.93s | 16.97s |
| Response Time (max) | 437.11s | 151.35s |
| Response Time (total) | 1884.31s | 305.55s |
| Parameters | 30B total (3B active) | 80B total (3B active) |
| Availability | Weights available | Open source |
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#319 Nemotron 3.5 Lightning
medium- Cost
- $0.000
- Time
- 130.5s
- Tokens
- 6,750 tok
#323 Qwen3 Coder Next
medium
Reached the allocated time limit (300 seconds) without receiving showcase output.
- Cost
- $0.000
- Time
- 300.0s
- Tokens
- 0 tok
Top Models by Score
Score vs Total Cost
Response Time (avg)
Score vs Response Time (avg)
Total Output Tokens
Score vs Total Output Tokens
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 2.8 | 1.6 | 33.3% | 1 | 341.79s | 69,450 | 2,044 | 3,645 | |
| Qwen3 Coder Next | 5.0 | 10.0 | 0.0% | 0 | 151.35s | 163,444 | 21,326 | 0 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 6.9 | 7.9 | 66.7% | 1 | 12.34s | 696 | 6,904 | 20,862 | |
| Qwen3 Coder Next | 3.5 | 8.1 | 16.7% | 1 | 8.64s | 645 | 1,252 | 0 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 4.4 | 5.1 | 33.3% | 2 | 285.47s | 7,623 | 78,065 | 297,359 | |
| Qwen3 Coder Next | 3.7 | 7.2 | 22.2% | 1 | 924ms | 7,185 | 336 | 0 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 6.2 | 5.8 | 66.7% | 1 | 136.91s | 98,571 | 15,769 | 112,376 | |
| Qwen3 Coder Next | 3.0 | 10.0 | 0.0% | 0 | 14.65s | 121,413 | 16,067 | 0 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 3.7 | 1.7 | 50.0% | 2 | 23.24s | 7,944 | 4,195 | 30,097 | |
| Qwen3 Coder Next | 6.5 | 10.0 | 50.0% | 0 | 81.80s | 7,758 | 246 | 0 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 2.9 | 4.4 | 22.2% | 2 | 74.73s | 798 | 54,657 | 91,174 | |
| Qwen3 Coder Next | 3.6 | 7.2 | 22.2% | 1 | 570ms | 762 | 25 | 0 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 5.5 | 10.0 | 0.0% | 0 | 4.36s | 516 | 3,127 | 3,157 | |
| Qwen3 Coder Next | 6.3 | 3.4 | 66.7% | 1 | 1.39s | 498 | 142 | 0 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 8.5 | 6.8 | 83.3% | 1 | 3.75s | 723 | 531 | 4,404 | |
| Qwen3 Coder Next | 6.3 | 10.0 | 50.0% | 0 | 7.49s | 684 | 63 | 0 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 4.2 | 4.4 | 44.5% | 2 | 10.49s | 726 | 1,170 | 18,195 | |
| Qwen3 Coder Next | 3.0 | 10.0 | 0.0% | 0 | 1.25s | 678 | 671 | 0 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 10.0 | 10.0 | 100.0% | 0 | 4.92s | 8,526 | 154 | 2,518 | |
| Qwen3 Coder Next | 10.0 | 10.0 | 100.0% | 0 | 2.64s | 8,364 | 255 | 0 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 3.0 | 10.0 | 0.0% | 0 | 44.02s | 207 | 1,130 | 14,597 | |
| Qwen3 Coder Next | 3.0 | 10.0 | 0.0% | 0 | 399ms | 216 | 12 | 0 |
Quick Compare
Switch Comparison Pair
Mercury 2.5 PreviewnonevsNemotron 3.5 LightningmediumFree AvailableNorth Mini CodenoneFree AvailablevsNemotron 3.5 LightningmediumFree AvailableGranite 4.2 8BhighvsQwen3 Coder NextmediumLaguna S 2.1noneFree AvailablevsQwen3 Coder NextmediumDeepSeek V3.2nonevsQwen3 Coder NextmediumGPT-5.4 NanononevsQwen3 Coder NextmediumNemotron 3.5 LightningmediumFree AvailablevsLaguna S 2.1noneFree AvailableGranite 4.2 8BhighvsNemotron 3.5 LightningmediumFree AvailableNorth Mini CodenoneFree AvailablevsQwen3 Coder NextmediumLaguna S 2.1lowFree AvailablevsQwen3 Coder NextmediumMercury 2.5 PreviewnonevsQwen3 Coder NextmediumNemotron 3.5 LightninglowFree AvailablevsQwen3 Coder Nextmedium