- Score
- 7.5 (+2.36 points)
- Total Cost (Current Price)
- $0.000 · 100.0% cheaper
- Response Time (avg)
- 29.38s · 61.9% faster
NVIDIA
Release: 2026-08-11
Tested on: 2026-10-01 03:53
nvidia/nemotron-3.5-lightning::high
30B total (3B active)MoEWeights available
Summary
Nemotron 3.5 Lightning scores 5.2 on AI BENCHY and ranks #371. It has 9.6 reliability, a 47.8% pass rate, $0.168 total cost, and 77.08s average response time.
What makes Nemotron 3.5 Lightning unique: It stands out most in Combined, where it ranks #3, while Domain specific is its weakest area at #14. It uses unusually many reasoning tokens, which can help explain its slower or more expensive runs.
Recommended alternatives
We recommend choosing one of these models instead:
- Score
- 8.6 (+3.40 points)
- Total Cost (Current Price)
- $0.061 · 63.8% cheaper
- Response Time (avg)
- 7.51s · 90.3% faster
- Score
- 5.2 (+0.01 points)
- Total Cost (Current Price)
- $0.004 · 98.0% cheaper
- Response Time (avg)
- 3.40s · 95.6% faster
Model facts
Researched on 2026-08-12
- Parameters
- 30B total (3B active)
- Architecture
- MoE
- Availability
- Weights available
- License
- NVIDIA Open Model
5.2
Consistency
5.7
9.6
Total Output Tokens
626,081
Total Input Tokens
170,517
Input Price
$0.060 / 1M
Output Price
$0.160 / 1M
Cache Read Price
$0.030 / 1M
Cache Write Price
N/A
Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.
Flaky tests
12
Flaky tests had mixed outcomes across runs (at least one pass and one fail).
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#371 Nemotron 3.5 Lightning
high- Cost
- $0.000
- Time
- 92.8s
- Tokens
- 11,343 tok
Run history
| Tested on | Score | Reliability | Tests Correct | Total Cost | Compare |
|---|---|---|---|---|---|
| 2026-10-01 03:53 Re-test | 5.2 | 9.6 | $0.168 |