Navigate
Advertise here

Clef Omni (default) vs Jev 1.14 (default)

Jev 1.14 (default) leads on average score with 2.3 vs 1.9. Jev 1.14 (default) has the lower benchmark cost at $0.003 vs $0.011. Jev 1.14 (default) is faster at 377ms vs 880ms, with pass rates of 8.7% vs 23.2%.

Last updated at: 2026-10-15

Compared models

Rank
#414
Total Output Tokens
0
Response Time (avg)
880ms
Total Cost
$0.011
Rank
#412
Total Output Tokens
18,927
Response Time (avg)
377ms
Total Cost
$0.003
Recommended model Jev 1.14 (default)

It has the best score here (2.3), while costing about 3.7x less than Clef Omni (default).

Detailed comparison

Metric Clef Omni Clef Omni default Release: 2026-10-12 Jev 1.14 Jev 1.14 default Release: 2026-10-15
Score 1.9 2.3
Rank #414 #412
Reliability 10.0 10.0
Consistency 5.2 4.5
Attempts 36/69 36/69
Tests Correct
Attempt pass rate 8.7% 23.2%
Flaky tests 0 2
Total Runs 36 36
Cost per result 0.526 0.071
Total Cost $0.011 $0.003
Input Price $0.150 / 1M $0.042 / 1M
Output Price $0.000 / 1M $0.000 / 1M
Cache Read Price N/A N/A
Cache Write Price N/A N/A
Total Input Tokens 70,125 67,092
Output Tokens 0 18,927
Reasoning Tokens 0 0
Response Time (avg) 880ms 377ms
Response Time (max) 1.31s 546ms
Response Time (total) 10.56s 4.52s
Parameters 30B total (3B active) -
Availability Open source Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Clef Omni 2.5 6.7 0.0% 0 614ms 33,750 0 0
Jev 1.14 2.7 3.9 22.2% 1 403ms 30,072 8,130 0

Quick Compare

Switch Comparison Pair

Clef OmnidefaultvsGemini 3 Flash PreviewhighGemini 3 Flash PreviewhighvsJev 1.14defaultCommand A+lowvsJev 1.14defaultCommand A+nonevsJev 1.14defaultCommand A+highvsJev 1.14defaultClef OmnidefaultvsCommand A+lowCommand A+mediumvsJev 1.14defaultJev 1.14defaultvsGrok 4.20noneClef OmnidefaultvsCommand A+noneClef OmnidefaultvsCommand A+highLing 3.0 TinymediumvsJev 1.14defaultLing 3.0 TinylowvsJev 1.14default