- Rank
- #320
- Total Output Tokens
- 57,866
- Response Time (avg)
- 22.44s
- Total Cost
- $0.121
DeepSeek V3.2 vs Nemotron 3.5 Lightning (low)
The average score is effectively tied at 4.6 vs 4.6. Nemotron 3.5 Lightning (low) has the lower benchmark cost at $0.117 vs $0.121. DeepSeek V3.2 is faster at 22.44s vs 83.19s, with pass rates of 34.8% vs 40.6%.
Compared models
- Rank
- #325
- Total Output Tokens
- 670,615
- Response Time (avg)
- 83.19s
- Total Cost
- $0.117
Recommended model
DeepSeek V3.2
It has the best score here (4.6), while responding about 3.7x faster than Nemotron 3.5 Lightning (low).
Detailed comparison
| Metric | DeepSeek V3.2 DeepSeek V3.2 none | Nemotron 3.5 Lightning Nemotron 3.5 Lightning low Free Available |
|---|---|---|
| Score | 4.6 | 4.6 |
| Rank | #320 | #325 |
| Reliability | 10.0 | 9.5 |
| Consistency | 8.2 | 6.8 |
| Attempts | 69/69 | 69/69 |
| Tests Correct | ||
| Attempt pass rate | 34.8% | 40.6% |
| Flaky tests | 5 | 9 |
| Total Runs | 69 | 69 |
| Cost per result | 1.943 | 0.000 |
| Total Cost | $0.121 | $0.117 |
| Input Price | $0.280 / 1M | $0.060 / 1M |
| Output Price | $0.420 / 1M | $0.160 / 1M |
| Total Input Tokens | 342,158 | 207,883 |
| Output Tokens | 57,866 | 144,718 |
| Reasoning Tokens | 0 | 525,897 |
| Response Time (avg) | 22.44s | 83.19s |
| Response Time (max) | 122.50s | 597.61s |
| Response Time (total) | 516.03s | 1913.41s |
| Parameters | 671B total (37B active) | 30B total (3B active) |
| Availability | Open source | Weights available |
Model generation showcase
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#320 DeepSeek V3.2
none- Cost
- $0.002
- Time
- 7.0s
- Tokens
- 1,046 tok
#325 Nemotron 3.5 Lightning
low- Cost
- $0.000
- Time
- 32.2s
- Tokens
- 6,089 tok
Top Models by Score
Score vs Total Cost
Response Time (avg)
Score vs Response Time (avg)
Total Output Tokens
Score vs Total Output Tokens
Category Breakdown
| Agentic | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| DeepSeek V3.2 | 3.0 | 10.0 | 0.0% | 0 | 122.50s | 206,327 | 15,767 | 0 | |
| Nemotron 3.5 Lightning | 3.5 | 8.3 | 0.0% | 0 | 597.61s | 69,091 | 1,746 | 3,695 |
| Anti-AI Tricks | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| DeepSeek V3.2 | 3.2 | 8.0 | 8.3% | 1 | 9.35s | 494 | 1,073 | 0 | |
| Nemotron 3.5 Lightning | 6.9 | 5.8 | 75.0% | 2 | 14.82s | 696 | 2,231 | 13,263 |
| Coding | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| DeepSeek V3.2 | 3.1 | 6.9 | 11.1% | 1 | 14.54s | 7,279 | 4,528 | 0 | |
| Nemotron 3.5 Lightning | 4.0 | 7.8 | 11.1% | 1 | 224.42s | 7,522 | 72,614 | 262,558 |
| Combined | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| DeepSeek V3.2 | 4.8 | 10.0 | 0.0% | 0 | 113.53s | 109,626 | 33,819 | 0 | |
| Nemotron 3.5 Lightning | 6.3 | 10.0 | 50.0% | 0 | 142.36s | 111,134 | 17,771 | 117,066 |
| Data parsing and extraction | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| DeepSeek V3.2 | 6.3 | 5.8 | 66.7% | 1 | 9.42s | 7,890 | 1,710 | 0 | |
| Nemotron 3.5 Lightning | 2.9 | 5.8 | 16.7% | 1 | 31.32s | 7,944 | 3,462 | 17,930 |
| Domain specific | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| DeepSeek V3.2 | 3.0 | 10.0 | 0.0% | 0 | 1.48s | 675 | 23 | 0 | |
| Nemotron 3.5 Lightning | 3.6 | 7.2 | 22.2% | 1 | 52.66s | 798 | 40,719 | 74,528 |
| General Intelligence | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| DeepSeek V3.2 | 4.7 | 1.6 | 66.7% | 1 | 9.32s | 314 | 43 | 0 | |
| Nemotron 3.5 Lightning | 3.7 | 9.5 | 0.0% | 0 | 4.61s | 516 | 2,794 | 2,933 |
| Instructions following | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| DeepSeek V3.2 | 10.0 | 10.0 | 100.0% | 0 | 1.52s | 627 | 66 | 0 | |
| Nemotron 3.5 Lightning | 8.4 | 6.9 | 83.3% | 1 | 5.46s | 723 | 434 | 4,423 |
| Puzzle Solving | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| DeepSeek V3.2 | 7.6 | 7.2 | 77.8% | 1 | 6.91s | 424 | 298 | 0 | |
| Nemotron 3.5 Lightning | 3.6 | 1.8 | 44.4% | 3 | 6.21s | 726 | 1,402 | 11,841 |
| Tool Calling | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| DeepSeek V3.2 | 10.0 | 10.0 | 100.0% | 0 | 11.85s | 8,319 | 522 | 0 | |
| Nemotron 3.5 Lightning | 10.0 | 10.0 | 100.0% | 0 | 5.08s | 8,526 | 124 | 2,685 |
| Trivia | Score | Consistency | Attempt pass rate | Flaky tests | Tests Correct | Response Time (avg) | Input Tokens | Output Tokens | Reasoning Tokens |
|---|---|---|---|---|---|---|---|---|---|
| DeepSeek V3.2 | 3.0 | 10.0 | 0.0% | 0 | 17.23s | 183 | 17 | 0 | |
| Nemotron 3.5 Lightning | 3.0 | 10.0 | 0.0% | 0 | 38.68s | 207 | 1,421 | 14,975 |
Quick Compare
Switch Comparison Pair
DeepSeek V3.2nonevsQwen3 Coder NextmediumDeepSeek V3.2nonevsLaguna S 2.1lowFree AvailableNemotron 3.5 LightninglowFree AvailablevsGPT-5.4 NanononeDeepSeek V3.2nonevsGranite 4.2 8BhighLing 2.6 FlashnonevsNemotron 3.5 LightninglowFree AvailableNemotron 3.5 LightninglowFree AvailablevsQwen3 Coder NextmediumDeepSeek V3.2nonevsNemotron 3.5 LightningmediumFree AvailableRing 2.6 1tnonevsNemotron 3.5 LightninglowFree AvailableGranite 4.2 8BhighvsNemotron 3.5 LightninglowFree AvailableNemotron 3.5 LightninglowFree AvailablevsLaguna S 2.1noneFree AvailableNorth Mini CodenoneFree AvailablevsNemotron 3.5 LightninglowFree AvailableMercury 2.5 PreviewnonevsNemotron 3.5 LightninglowFree Available