Navigate
Advertise here

Clef Omni (default) vs Nemotron 3.5 Lightning

Nemotron 3.5 Lightning leads on average score with 3.8 vs 1.9. Nemotron 3.5 Lightning has the lower benchmark cost at $0.009 vs $0.011. Clef Omni (default) is faster at 880ms vs 15.92s, with pass rates of 8.7% vs 15.9%.

Last updated at: 2026-10-12

Compared models

Rank
#402
Total Output Tokens
0
Response Time (avg)
880ms
Total Cost
$0.011
Rank
#375
Total Output Tokens
4,779
Response Time (avg)
15.92s
Total Cost
$0.009
Recommended model Nemotron 3.5 Lightning

It has the strongest score in this comparison (3.8) and the best overall balance of cost and response time across 2 models.

Detailed comparison

Metric Clef Omni Clef Omni default Release: 2026-10-12 Nemotron 3.5 Lightning Nemotron 3.5 Lightning none Release: 2026-08-11 Free Available
Score 1.9 3.8
Rank #402 #375
Reliability 10.0 9.8
Consistency 5.2 9.3
Attempts 36/69 69/69
Tests Correct
Attempt pass rate 8.7% 15.9%
Flaky tests 0 2
Total Runs 36 69
Cost per result 0.526 0.000
Total Cost $0.011 $0.009
Input Price $0.150 / 1M $0.060 / 1M
Output Price $0.000 / 1M $0.160 / 1M
Cache Read Price N/A $0.030 / 1M
Cache Write Price N/A N/A
Total Input Tokens 70,125 97,418
Output Tokens 0 4,779
Reasoning Tokens 0 0
Response Time (avg) 880ms 15.92s
Response Time (max) 1.31s 339.57s
Response Time (total) 10.56s 366.20s
Parameters 30B total (3B active) 30B total (3B active)
Availability Open source Weights available

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#402 Clef Omni

default
No showcase result has been generated for this model yet.
Cost
N/A
Time
-
Tokens
0 tok

#375 Nemotron 3.5 Lightning

none
Cost
$0.000
Time
101.6s
Tokens
6,775 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Clef Omni 2.5 6.7 0.0% 0 614ms 33,750 0 0
Nemotron 3.5 Lightning 3.1 7.2 11.1% 1 1.55s 7,623 589 0

Quick Compare

Switch Comparison Pair

Granite 4.1 8bdefaultvsNemotron 3.5 LightningnoneFree AvailableLing 3.0 TinydefaultvsNemotron 3.5 LightningnoneFree AvailableLing 3.0 TinyhighvsNemotron 3.5 LightningnoneFree AvailableClef OmnidefaultvsGemini 3 Flash PreviewhighLing 3.0 TinylowvsNemotron 3.5 LightningnoneFree AvailableLing 3.0 TinymediumvsNemotron 3.5 LightningnoneFree AvailableNemotron 3.5 LightningnoneFree AvailablevsQwen3.5-9BmediumNemotron 3.5 LightningnoneFree AvailablevsGLM 4.7 FlashmediumCommand A+mediumvsNemotron 3.5 LightningnoneFree AvailableMiniMax M2.5mediumvsNemotron 3.5 LightningnoneFree AvailableCobuddymediumFree AvailablevsNemotron 3.5 LightningnoneFree AvailableTrinity Large PreviewdefaultFree AvailablevsNemotron 3.5 LightningnoneFree Available