Navigate
Advertise here

Nemotron 3.5 Lightning (low) vs GPT-5.4 Nano

The average score is effectively tied at 4.6 vs 4.6. GPT-5.4 Nano has the lower benchmark cost at $0.068 vs $0.175. GPT-5.4 Nano is faster at 4.42s vs 83.19s, with pass rates of 40.6% vs 26.1%.

Last updated at: 2026-11-16

Compared models

Rank
#430
Total Output Tokens
647,336
Response Time (avg)
83.19s
Total Cost
$0.175
Rank
#426
Total Output Tokens
14,894
Response Time (avg)
4.42s
Total Cost
$0.068
Recommended model GPT-5.4 Nano

It has the best score here (4.6), while costing about 2.6x less than Nemotron 3.5 Lightning (low).

Detailed comparison

Metric Nemotron 3.5 Lightning Nemotron 3.5 Lightning low Release: 2026-08-11 Free Available GPT-5.4 Nano GPT-5.4 Nano none Release: 2026-03-17
Score 4.6 4.6
Rank #430 #426
Reliability 9.5 10.0
Consistency 6.8 8.7
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 40.6% 26.1%
Flaky tests 9 4
Total Runs 69 69
Cost per result 0.000 1.699
Total Cost $0.175 $0.068
Input Price $0.060 / 1M $0.200 / 1M
Output Price $0.160 / 1M $1.250 / 1M
Cache Read Price $0.030 / 1M $0.020 / 1M
Cache Write Price N/A N/A
Total Input Tokens 207,883 246,687
Output Tokens 144,718 14,894
Reasoning Tokens 525,897 0
Response Time (avg) 83.19s 4.42s
Response Time (max) 597.61s 45.38s
Response Time (total) 1913.41s 101.75s
Parameters 30B total (3B active) ~120B total (~5B active)
Availability Weights available Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#430 Nemotron 3.5 Lightning

low
Cost
$0.000
Time
32.2s
Tokens
6,089 tok

#426 GPT-5.4 Nano

none
Cost
$0.008
Time
46.1s
Tokens
5,735 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3.5 Lightning 4.0 7.8 11.1% 1 224.42s 7,522 72,614 262,558
GPT-5.4 Nano 4.6 7.9 22.2% 1 2.22s 7,305 613 0

Switch Comparison Pair