NVIDIA
Release: 2026-08-11
Tested on: 2026-08-11 18:28
nvidia/nemotron-3.5-lightning::none
Summary
Nemotron 3.5 Lightning scores 4.0 on AI BENCHY and ranks #251. It has 10.0 reliability, a 16.7% pass rate, $0.009 total cost, and 1.22s average response time.
What makes Nemotron 3.5 Lightning unique: It stands out most in Data parsing and extraction, where it ranks #2, while Tool Calling is its weakest area at #9.
4.0
Consistency
9.2
10.0
Total Output Tokens
2,731
Total Input Tokens
74,065
Input Price
$0.100 / 1M
Output Price
$0.250 / 1M
Flaky tests
2
Flaky tests had mixed outcomes across runs (at least one pass and one fail).
Price History
Historical pricing data for this model from OpenRouter.
| Date | Input Price | Output Price |
|---|---|---|
| 2026-08-11 17:51 | $0.000 / 1M | $0.000 / 1M |
| 2026-08-11 18:26 | $0.100 / 1M | $0.250 / 1M |
Charts
Choose the first model, then click a second model to open a side-by-side page.
Score vs Total Cost
Response Time (avg)
Score vs Response Time (avg)
Total Output Tokens
Score vs Total Output Tokens
Quick Compare
Nemotron 3.5 LightningnoneFree AvailablevsGranite 4.1 8BnoneNemotron 3.5 LightningnoneFree AvailablevsLing 3.0 TinyhighFree AvailableNemotron 3.5 LightningnoneFree AvailablevsLing 3.0 TinynoneFree AvailableNemotron 3.5 LightningnoneFree AvailablevsLing 3.0 TinylowFree AvailableNemotron 3.5 LightningnoneFree AvailablevsGrok 4.20noneNemotron 3.5 LightningnoneFree AvailablevsQwen3.5-9BmediumNemotron 3.5 LightningnoneFree AvailablevsGLM 4.7 FlashmediumNemotron 3.5 LightningnoneFree AvailablevsLing 3.0 TinymediumFree AvailableNemotron 3.5 LightningnoneFree AvailablevsLaguna S 2.1noneFree AvailableNemotron 3.5 LightningnoneFree Availablevsgpt-oss-120bnoneFree Available
Category Breakdown
| Category | Score | Consistency | Tests Correct |
|---|---|---|---|
| Anti-AI Tricks | 4.8 | 10.0 | |
| Coding | 3.1 | 7.2 | |
| Combined | 3.0 | 10.0 | |
| Data parsing and extraction | 6.5 | 10.0 | |
| Domain specific | 3.0 | 10.0 | |
| General Intelligence | 4.4 | 9.9 | |
| Instructions following | 6.5 | 10.0 | |
| Puzzle Solving | 3.1 | 10.0 | |
| Tool Calling | 2.8 | 1.6 | |
| Trivia | 3.0 | 10.0 |