Navigate
Advertise here

Clef Omni (default) vs Kev 4B (default)

Kev 4B (default) leads on average score with 2.4 vs 1.9. Kev 4B (default) has the lower benchmark cost at $0.002 vs $0.011. Clef Omni (default) is faster at 880ms vs 5.63s, with pass rates of 8.7% vs 15.9%.

Last updated at: 2026-10-12

Compared models

Rank
#402
Total Output Tokens
0
Response Time (avg)
880ms
Total Cost
$0.011
Rank
#401
Total Output Tokens
28,061
Response Time (avg)
5.63s
Total Cost
$0.002
Recommended model Kev 4B (default)

It has the best score here (2.4), while costing about 5.9x less than Clef Omni (default).

Detailed comparison

Metric Clef Omni Clef Omni default Release: 2026-10-12 Kev 4B Kev 4B default Release: 2026-09-28
Score 1.9 2.4
Rank #402 #401
Reliability 10.0 10.0
Consistency 5.2 4.9
Attempts 36/69 36/69
Tests Correct
Attempt pass rate 8.7% 15.9%
Flaky tests 0 1
Total Runs 36 36
Cost per result 0.526 0.060
Total Cost $0.011 $0.002
Input Price $0.150 / 1M $0.042 / 1M
Output Price $0.000 / 1M $0.000 / 1M
Cache Read Price N/A N/A
Cache Write Price N/A N/A
Total Input Tokens 70,125 42,804
Output Tokens 0 28,061
Reasoning Tokens 0 0
Response Time (avg) 880ms 5.63s
Response Time (max) 1.31s 17.79s
Response Time (total) 10.56s 67.61s
Parameters 30B total (3B active) 4B
Availability Open source Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Clef Omni 2.5 6.7 0.0% 0 614ms 33,750 0 0
Kev 4B 4.5 6.7 33.3% 0 771ms 21,603 12,207 0

Switch Comparison Pair

Clef OmnidefaultvsGemini 3 Flash PreviewhighCommand A+lowvsKev 4BdefaultCommand A+nonevsKev 4BdefaultGemini 3 Flash PreviewhighvsKev 4BdefaultCommand A+highvsKev 4BdefaultCommand A+mediumvsKev 4BdefaultKev 4BdefaultvsGrok 4.20noneClef OmnidefaultvsCommand A+lowClef OmnidefaultvsCommand A+noneLing 3.0 TinymediumvsKev 4BdefaultClef OmnidefaultvsCommand A+highLing 3.0 TinylowvsKev 4Bdefault