- Rank
- #430
- Total Output Tokens
- 647,336
- Response Time (avg)
- 83.19s
- Total Cost
- $0.175
Nemotron 3.5 Lightning (low) vs Qwen3 Coder Next (medium)
Qwen3 Coder Next (medium) leads on average score with 4.7 vs 4.6. Qwen3 Coder Next (medium) has the lower benchmark cost at $0.071 vs $0.175. Qwen3 Coder Next (medium) is faster at 16.97s vs 83.19s, with pass rates of 40.6% vs 24.6%.
Compared models
- Rank
- #424
- Total Output Tokens
- 40,395
- Response Time (avg)
- 16.97s
- Total Cost
- $0.071
Recommended model
Qwen3 Coder Next (medium)
It has the best score here (4.7), while costing about 2.5x less than Nemotron 3.5 Lightning (low).
Detailed comparison
| Metric | Nemotron 3.5 Lightning Nemotron 3.5 Lightning low Free Available | Qwen3 Coder Next Qwen3 Coder Next medium |
|---|---|---|
| Score | 4.6 | 4.7 |
| Rank | #430 | #424 |
| Reliability | 9.5 | 10.0 |
| Consistency | 6.8 | 8.7 |
| Attempts | 69/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 40.6% | 24.6% |
| Flaky tests | 9 | 4 |
| Total Runs | 69 | 69 |
| Cost per result | 0.000 | 2.280 |
| Total Cost | $0.175 | $0.071 |
| Input Price | $0.060 / 1M | $0.120 / 1M |
| Output Price | $0.160 / 1M | $0.800 / 1M |
| Cache Read Price | $0.030 / 1M | $0.070 / 1M |
| Cache Write Price | N/A | N/A |
| Total Input Tokens | 207,883 | 311,647 |
| Output Tokens | 144,718 | 40,395 |
| Reasoning Tokens | 525,897 | 0 |
| Response Time (avg) | 83.19s | 16.97s |
| Response Time (max) | 597.61s | 151.35s |
| Response Time (total) | 1913.41s | 305.55s |
| Parameters | 30B total (3B active) | 80B total (3B active) |
| Availability | Weights available | Open source |
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#430 Nemotron 3.5 Lightning
low- Cost
- $0.000
- Time
- 32.2s
- Tokens
- 6,089 tok
#424 Qwen3 Coder Next
medium
Reached the allocated time limit (300 seconds) without receiving showcase output.
- Cost
- $0.000
- Time
- 300.0s
- Tokens
- 0 tok
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 3.5 | 8.3 | 0.0% | 0 | 597.61s | 69,091 | 1,746 | 3,695 | |
| Qwen3 Coder Next | 5.0 | 10.0 | 0.0% | 0 | 151.35s | 163,444 | 21,326 | 0 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 6.9 | 5.8 | 75.0% | 2 | 14.82s | 696 | 2,231 | 13,263 | |
| Qwen3 Coder Next | 3.5 | 8.1 | 16.7% | 1 | 8.64s | 645 | 1,252 | 0 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 4.0 | 7.8 | 11.1% | 1 | 224.42s | 7,522 | 72,614 | 262,558 | |
| Qwen3 Coder Next | 3.7 | 7.2 | 22.2% | 1 | 924ms | 7,185 | 336 | 0 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 6.3 | 10.0 | 50.0% | 0 | 142.36s | 111,134 | 17,771 | 117,066 | |
| Qwen3 Coder Next | 3.0 | 10.0 | 0.0% | 0 | 14.65s | 121,413 | 16,067 | 0 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 2.9 | 5.8 | 16.7% | 1 | 31.32s | 7,944 | 3,462 | 17,930 | |
| Qwen3 Coder Next | 6.5 | 10.0 | 50.0% | 0 | 81.80s | 7,758 | 246 | 0 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 3.6 | 7.2 | 22.2% | 1 | 52.66s | 798 | 40,719 | 74,528 | |
| Qwen3 Coder Next | 3.6 | 7.2 | 22.2% | 1 | 570ms | 762 | 25 | 0 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 3.7 | 9.5 | 0.0% | 0 | 4.61s | 516 | 2,794 | 2,933 | |
| Qwen3 Coder Next | 6.3 | 3.4 | 66.7% | 1 | 1.39s | 498 | 142 | 0 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 8.4 | 6.9 | 83.3% | 1 | 5.46s | 723 | 434 | 4,423 | |
| Qwen3 Coder Next | 6.3 | 10.0 | 50.0% | 0 | 7.49s | 684 | 63 | 0 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 3.6 | 1.8 | 44.4% | 3 | 6.21s | 726 | 1,402 | 11,841 | |
| Qwen3 Coder Next | 3.0 | 10.0 | 0.0% | 0 | 1.25s | 678 | 671 | 0 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 10.0 | 10.0 | 100.0% | 0 | 5.08s | 8,526 | 124 | 2,685 | |
| Qwen3 Coder Next | 10.0 | 10.0 | 100.0% | 0 | 2.64s | 8,364 | 255 | 0 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| Nemotron 3.5 Lightning | 3.0 | 10.0 | 0.0% | 0 | 38.68s | 207 | 1,421 | 14,975 | |
| Qwen3 Coder Next | 3.0 | 10.0 | 0.0% | 0 | 399ms | 216 | 12 | 0 |
Quick Compare
Switch Comparison Pair
Granite 4.2 8BhighvsQwen3 Coder NextmediumLaguna S 2.1noneFree AvailablevsQwen3 Coder NextmediumDeepSeek V3.2nonevsQwen3 Coder NextmediumGPT-5.4 NanononevsQwen3 Coder NextmediumNorth Mini CodedefaultFree AvailablevsQwen3 Coder NextmediumNemotron 3.5 LightninglowFree AvailablevsGPT-5.4 NanononeDeepSeek V3.2nonevsNemotron 3.5 LightninglowFree AvailableLing 2.6 FlashdefaultvsNemotron 3.5 LightninglowFree AvailableLaguna S 2.1lowFree AvailablevsQwen3 Coder NextmediumMercury 2.5 PreviewdefaultvsQwen3 Coder NextmediumRing 2.6 1tdefaultvsNemotron 3.5 LightninglowFree AvailableGranite 4.2 8BhighvsNemotron 3.5 LightninglowFree Available