- Score
- 9.4 (+4.78 points)
- Total Cost (Current Price)
- $0.183 · 4.5% costlier
- Response Time (avg)
- 6.24s · 92.5% faster
NVIDIA
Release: 2026-08-11
Tested on: 2026-10-01 03:55
nvidia/nemotron-3.5-lightning::low
30B total (3B active)MoEWeights available
Summary
Nemotron 3.5 Lightning scores 4.6 on AI BENCHY and ranks #353. It has 9.5 reliability, a 40.6% pass rate, $0.175 total cost, and 83.19s average response time.
What makes Nemotron 3.5 Lightning unique: It stands out most in Combined, where it ranks #1, while Data parsing and extraction is its weakest area at #10. It uses unusually many reasoning tokens, which can help explain its slower or more expensive runs.
Recommended alternatives
We recommend choosing one of these models instead:
- Score
- 8.3 (+3.68 points)
- Total Cost (Current Price)
- $0.000 · 100.0% cheaper
- Response Time (avg)
- 88.74s · 6.7% slower
- Score
- 8.6 (+4.00 points)
- Total Cost (Current Price)
- $0.061 · 65.3% cheaper
- Response Time (avg)
- 7.51s · 91.0% faster
Model facts
Researched on 2026-08-12
- Parameters
- 30B total (3B active)
- Architecture
- MoE
- Availability
- Weights available
- License
- NVIDIA Open Model
4.6
Consistency
6.8
9.5
Total Output Tokens
647,336
Total Input Tokens
207,883
Input Price
$0.060 / 1M
Output Price
$0.160 / 1M
Cache Read Price
$0.030 / 1M
Cache Write Price
N/A
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Flaky tests
9
Flaky tests had mixed outcomes across runs (at least one pass and one fail).
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#353 Nemotron 3.5 Lightning
low- Cost
- $0.000
- Time
- 32.2s
- Tokens
- 6,089 tok
Run history
| Tested on | Score | Reliability | Tests Correct | Total Cost | Compare |
|---|---|---|---|---|---|
| 2026-10-01 03:55 Re-test | 4.6 | 9.5 | $0.175 |