NVIDIA
Release: 2026-08-11
Tested on: 2026-08-11 18:29
nvidia/nemotron-3.5-lightning::low
Summary
Nemotron 3.5 Lightning scores 4.8 on AI BENCHY and ranks #225. It has 9.8 reliability, a 42.4% pass rate, $0.173 total cost, and 59.45s average response time.
What makes Nemotron 3.5 Lightning unique: It stands out most in Combined, where it ranks #1, while Data parsing and extraction is its weakest area at #12. It uses unusually many reasoning tokens, which can help explain its slower or more expensive runs.
4.8
Consistency
6.8
9.8
Total Output Tokens
653,448
Total Input Tokens
138,783
Input Price
$0.100 / 1M
Output Price
$0.250 / 1M
Flaky tests
9
Flaky tests had mixed outcomes across runs (at least one pass and one fail).
Price History
Historical pricing data for this model from OpenRouter.
| Date | Input Price | Output Price |
|---|---|---|
| 2026-08-11 17:51 | $0.000 / 1M | $0.000 / 1M |
| 2026-08-11 18:26 | $0.100 / 1M | $0.250 / 1M |
Charts
Choose the first model, then click a second model to open a side-by-side page.
Score vs Total Cost
Response Time (avg)
Score vs Response Time (avg)
Total Output Tokens
Score vs Total Output Tokens
Quick Compare
Nemotron 3.5 LightninglowFree AvailablevsRing-2.6-1TnoneNemotron 3.5 LightninglowFree AvailablevsGPT-5.4 NanononeNemotron 3.5 LightninglowFree AvailablevsLing-2.6-flashnoneNemotron 3.5 LightninglowFree AvailablevsTrinity Large ThinkinghighNemotron 3.5 LightninglowFree AvailablevsNemotron 3 SupernoneFree AvailableNemotron 3.5 LightninglowFree AvailablevsKAT-Coder-Air V2.5noneNemotron 3.5 LightninglowFree AvailablevsGLM 4.7 FlashnoneNemotron 3.5 LightninglowFree AvailablevsTrinity Large PreviewnoneNemotron 3.5 LightninglowFree AvailablevsGPT-4o-mininoneNemotron 3.5 LightninglowFree AvailablevsQwen3 Coder Nextmedium
Category Breakdown
| Category | Score | Consistency | Tests Correct |
|---|---|---|---|
| Anti-AI Tricks | 6.9 | 5.8 | |
| Coding | 4.0 | 7.8 | |
| Combined | 6.3 | 10.0 | |
| Data parsing and extraction | 2.9 | 5.8 | |
| Domain specific | 3.6 | 7.2 | |
| General Intelligence | 3.7 | 9.5 | |
| Instructions following | 8.4 | 6.9 | |
| Puzzle Solving | 3.6 | 1.8 | |
| Tool Calling | 10.0 | 10.0 | |
| Trivia | 3.0 | 10.0 |