Navigate
Advertise here

Nemotron 3.5 Lightning vs Jev 1.14 (default)

Nemotron 3.5 Lightning leads on average score with 3.8 vs 2.3. Jev 1.14 (default) has the lower benchmark cost at $0.003 vs $0.009. Jev 1.14 (default) is faster at 377ms vs 15.92s, with pass rates of 15.9% vs 23.2%.

Last updated at: 2026-10-16

Compared models

Rank
#392
Total Output Tokens
4,779
Response Time (avg)
15.92s
Total Cost
$0.009
Rank
#419
Total Output Tokens
18,927
Response Time (avg)
377ms
Total Cost
$0.003
Recommended model Nemotron 3.5 Lightning

It has the strongest score in this comparison (3.8) and the best overall balance of cost and response time across 2 models.

Detailed comparison

Metric Nemotron 3.5 Lightning Nemotron 3.5 Lightning none Release: 2026-08-11 Free Available Jev 1.14 Jev 1.14 default Release: 2026-10-15
Score 3.8 2.3
Rank #392 #419
Reliability 9.8 10.0
Consistency 9.3 4.5
Attempts 69/69 36/69
Tests Correct
Attempt pass rate 15.9% 23.2%
Flaky tests 2 2
Total Runs 69 36
Cost per result 0.000 0.071
Total Cost $0.009 $0.003
Input Price $0.060 / 1M $0.042 / 1M
Output Price $0.160 / 1M $0.000 / 1M
Cache Read Price $0.030 / 1M N/A
Cache Write Price N/A N/A
Total Input Tokens 97,418 67,092
Output Tokens 4,779 18,927
Reasoning Tokens 0 0
Response Time (avg) 15.92s 377ms
Response Time (max) 339.57s 546ms
Response Time (total) 366.20s 4.52s
Parameters 30B total (3B active) -
Availability Weights available Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#392 Nemotron 3.5 Lightning

none
Cost
$0.000
Time
101.6s
Tokens
6,775 tok

#419 Jev 1.14

default
No showcase result has been generated for this model yet.
Cost
N/A
Time
-
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Nemotron 3.5 Lightning 3.1 7.2 11.1% 1 1.55s 7,623 589 0
Jev 1.14 2.7 3.9 22.2% 1 403ms 30,072 8,130 0

Quick Compare

Switch Comparison Pair

Granite 4.1 8bdefaultvsNemotron 3.5 LightningnoneFree AvailableLing 3.0 TinydefaultvsNemotron 3.5 LightningnoneFree AvailableLing 3.0 TinyhighvsNemotron 3.5 LightningnoneFree AvailableLing 3.0 TinylowvsNemotron 3.5 LightningnoneFree AvailableLing 3.0 TinymediumvsNemotron 3.5 LightningnoneFree AvailableNemotron 3.5 LightningnoneFree AvailablevsQwen3.5-9BmediumNemotron 3.5 LightningnoneFree AvailablevsGLM 4.7 FlashmediumCommand A+mediumvsNemotron 3.5 LightningnoneFree AvailableGemini 3 Flash PreviewhighvsJev 1.14defaultMiniMax M2.5mediumvsNemotron 3.5 LightningnoneFree AvailableCobuddymediumFree AvailablevsNemotron 3.5 LightningnoneFree AvailableTrinity Large PreviewdefaultFree AvailablevsNemotron 3.5 LightningnoneFree Available