Navigate
Advertise here

Nemotron 3.5 Lightning (high) vs Inkling Small (low)

The average score is effectively tied at 5.2 vs 5.2. Inkling Small (low) has the lower benchmark cost at $0.055 vs $0.168. Inkling Small (low) is faster at 1.99s vs 77.08s, with pass rates of 47.8% vs 47.8%.

Last updated at: 2026-11-13

Compared models

Rank
#385
Total Output Tokens
626,081
Response Time (avg)
77.08s
Total Cost
$0.168
Rank
#383
Total Output Tokens
14,686
Response Time (avg)
1.99s
Total Cost
$0.055
Recommended model Inkling Small (low)

It has the best score here (5.2), while costing about 3.1x less than Nemotron 3.5 Lightning (high).

Detailed comparison

Metric Nemotron 3.5 Lightning Nemotron 3.5 Lightning high Release: 2026-08-11 Free Available Inkling Small Inkling Small low Release: 2026-08-01 Free Available
Score 5.2 5.2
Rank #385 #383
Reliability 9.6 10.0
Consistency 5.7 8.7
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 47.8% 47.8%
Flaky tests 12 4
Total Runs 69 69
Cost per result 0.000 0.649
Total Cost $0.168 $0.055
Input Price $0.060 / 1M $0.450 / 1M
Output Price $0.160 / 1M $1.200 / 1M
Cache Read Price $0.030 / 1M $0.100 / 1M
Cache Write Price N/A N/A
Total Input Tokens 170,517 81,447
Output Tokens 149,968 2,715
Reasoning Tokens 509,725 11,971
Response Time (avg) 77.08s 1.99s
Response Time (max) 490.99s 5.82s
Response Time (total) 1772.78s 45.67s
Parameters 30B total (3B active) 276B total (12B active)
Availability Weights available Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#385 Nemotron 3.5 Lightning

high
Cost
$0.000
Time
92.8s
Tokens
11,343 tok

#383 Thinking Machines: Inkling Small

low
Cost
$0.001
Time
5.9s
Tokens
759 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3.5 Lightning 4.4 5.1 33.3% 2 168.41s 7,623 68,533 242,319
Inkling Small 4.6 5.0 33.3% 2 3.70s 7,374 375 4,332

Switch Comparison Pair