Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Clef Omni (default) vs d1.1 (default)

Clef Omni (default) leads on average score with 1.9 vs 1.4. d1.1 (default) has the lower benchmark cost at $0.001 vs $0.011. d1.1 (default) is faster at 845ms vs 880ms, with pass rates of 8.7% vs 10.1%.

Last updated at: 2026-11-10

Compared models

Rank
#476
Total Output Tokens
0
Response Time (avg)
880ms
Total Cost
$0.011
Rank
#485
Total Output Tokens
0
Response Time (avg)
845ms
Total Cost
$0.001
Recommended model Clef Omni (default)

It has the strongest score in this comparison (1.9) and the best overall balance of cost and response time across 2 models.

Detailed comparison

Metric Clef Omni Clef Omni default Release: 2026-10-12 d1.1 d1.1 default Release: 2026-10-27
Score 1.9 1.4
Rank #476 #485
Reliability 10.0 10.0
Consistency 5.2 3.8
Attempts 36/69 36/69
Tests Correct
Attempt pass rate 8.7% 10.1%
Flaky tests 0 4
Total Runs 36 36
Cost per result 0.526 0.069
Total Cost $0.011 $0.001
Input Price $0.150 / 1M $0.020 / 1M
Output Price $0.000 / 1M $0.000 / 1M
Cache Read Price N/A $0.020 / 1M
Cache Write Price N/A N/A
Total Input Tokens 70,125 34,410
Output Tokens 0 0
Reasoning Tokens 0 0
Response Time (avg) 880ms 845ms
Response Time (max) 1.31s 1.48s
Response Time (total) 10.56s 10.13s
Parameters 30B total (3B active) -
Availability Open source Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Clef Omni 2.5 6.7 0.0% 0 614ms 33,750 0 0
d1.1 2.3 6.6 0.0% 0 957ms 17,655 0 0

Quick Compare

Switch Comparison Pair

Clef OmnidefaultvsGemini 3 Flash PreviewhighGemini 3 Flash Previewhighvsd1.1defaultClef OmnidefaultvsCommand A+lowClef OmnidefaultvsCommand A+noneClef OmnidefaultvsCommand A+highClef OmnidefaultvsXing4.0 29b A4bnoneFree AvailableClef OmnidefaultvsCommand A+mediumClef OmnidefaultvsGrok 4.20noneCommand A+lowvsd1.1defaultCommand A+nonevsd1.1defaultClef OmnidefaultvsLing 3.0 TinymediumClef OmnidefaultvsLing 3.0 Tinylow