Navigate
Advertise here

Joey 1 (default) vs Clef Omni (default)

The average score is effectively tied at 1.9 vs 1.9. Joey 1 (default) has the lower benchmark cost at $0.001 vs $0.011. Joey 1 (default) is faster at 646ms vs 880ms, with pass rates of 13.0% vs 8.7%.

Last updated at: 2026-11-10

Compared models

Rank
#478
Total Output Tokens
69
Response Time (avg)
646ms
Total Cost
$0.001
Rank
#476
Total Output Tokens
0
Response Time (avg)
880ms
Total Cost
$0.011
Recommended model Joey 1 (default)

It has the best score here (1.9), while costing about 19.8x less than Clef Omni (default).

Detailed comparison

Metric Joey 1 Joey 1 default Release: 2026-10-29 Clef Omni Clef Omni default Release: 2026-10-12
Score 1.9 1.9
Rank #478 #476
Reliability 10.0 10.0
Consistency 5.2 5.2
Attempts 36/69 36/69
Tests Correct
Attempt pass rate 13.0% 8.7%
Flaky tests 0 0
Total Runs 36 36
Cost per result 0.018 0.526
Total Cost $0.001 $0.011
Input Price $0.010 / 1M $0.150 / 1M
Output Price $0.000 / 1M $0.000 / 1M
Cache Read Price N/A N/A
Cache Write Price N/A N/A
Total Input Tokens 53,139 70,125
Output Tokens 69 0
Reasoning Tokens 0 0
Response Time (avg) 646ms 880ms
Response Time (max) 789ms 1.31s
Response Time (total) 7.75s 10.56s
Parameters 2B 30B total (3B active)
Availability Open source Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Joey 1 2.2 6.7 0.0% 0 650ms 25,497 12 0
Clef Omni 2.5 6.7 0.0% 0 614ms 33,750 0 0

Switch Comparison Pair

Joey 1defaultvsGemini 3 Flash PreviewhighClef OmnidefaultvsGemini 3 Flash PreviewhighClef OmnidefaultvsCommand A+lowJoey 1defaultvsCommand A+lowClef OmnidefaultvsCommand A+noneJoey 1defaultvsCommand A+noneClef OmnidefaultvsCommand A+highJoey 1defaultvsCommand A+highClef OmnidefaultvsXing4.0 29b A4bnoneFree AvailableJoey 1defaultvsXing4.0 29b A4bnoneFree AvailableClef OmnidefaultvsCommand A+mediumClef OmnidefaultvsGrok 4.20none