Navigate
Advertise here

Ember-1 vs Nemotron 3.5 Lightning (high)

Ember-1 leads on average score with 5.4 vs 5.2. Nemotron 3.5 Lightning (high) has the lower benchmark cost at $0.168 vs $0.786. Ember-1 is faster at 22.65s vs 77.08s, with pass rates of 43.5% vs 47.8%.

Last updated at: 2026-10-19

Compared models

Rank
#329
Total Output Tokens
11,832
Response Time (avg)
22.65s
Total Cost
$0.786
Rank
#339
Total Output Tokens
626,081
Response Time (avg)
77.08s
Total Cost
$0.168
Recommended model Nemotron 3.5 Lightning (high)

Its score stays close to the best score here (5.2 vs 5.4), while costing about 4.7x less than Ember-1.

Detailed comparison

Metric Ember-1 Ember-1 none Release: 2026-09-28 Nemotron 3.5 Lightning Nemotron 3.5 Lightning high Release: 2026-08-11 Free Available
Score 5.4 5.2
Rank #329 #339
Reliability 8.8 9.6
Consistency 8.6 5.7
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 43.5% 47.8%
Flaky tests 4 12
Total Runs 69 69
Cost per result 9.817 0.000
Total Cost $0.786 $0.168
Input Price $3.000 / 1M $0.060 / 1M
Output Price $15.000 / 1M $0.160 / 1M
Cache Read Price $0.300 / 1M $0.030 / 1M
Cache Write Price N/A N/A
Total Input Tokens 202,617 170,517
Output Tokens 11,832 149,968
Reasoning Tokens 0 509,725
Response Time (avg) 22.65s 77.08s
Response Time (max) 93.12s 490.99s
Response Time (total) 520.91s 1772.78s
Parameters ~2.8T total (~104B active) 30B total (3B active)
Availability Closed Weights available

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#329 Ember-1

none
Cost
$0.156
Time
224.6s
Tokens
10,555 tok

#339 Nemotron 3.5 Lightning

high
Cost
$0.000
Time
92.8s
Tokens
11,343 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Ember-1 5.5 10.0 33.3% 0 1.94s 7,485 393 0
Nemotron 3.5 Lightning 4.4 5.1 33.3% 2 168.41s 7,623 68,533 242,319

Quick Compare

Switch Comparison Pair

Ember-1nonevsStep 3.5 FlashmediumLing 3.0 FlashnonevsNemotron 3.5 LightninghighFree AvailableNemotron 3.5 LightninghighFree AvailablevsInkling SmalllowFree AvailableEmber-1nonevsHy4 previewlowNorth Mini CodemediumFree AvailablevsEmber-1noneEmber-1nonevsGranite 4.2 8BlowMistral Small 4mediumvsNemotron 3.5 LightninghighFree AvailableMistral Small 4nonevsNemotron 3.5 LightninghighFree AvailableNemotron 3.5 LightninghighFree AvailablevsQwen3.6 35B A3BnoneMercury 2.5lowvsNemotron 3.5 LightninghighFree AvailableNemotron 3.5 LightninghighFree AvailablevsLaguna XS 2.1noneFree AvailableKAT Coder AIR V2.5mediumvsNemotron 3.5 LightninghighFree Available