Navigate
Advertise here

Clef Omni (default) vs d1.2 (default)

The average score is effectively tied at 1.9 vs 1.9. d1.2 (default) has the lower benchmark cost at $0.001 vs $0.011. d1.2 (default) is faster at 755ms vs 880ms, with pass rates of 8.7% vs 13.0%.

Last updated at: 2026-11-17

Compared models

Rank
#514
Total Output Tokens
0
Response Time (avg)
880ms
Total Cost
$0.011
Rank
#518
Total Output Tokens
0
Response Time (avg)
755ms
Total Cost
$0.001
Recommended model d1.2 (default)

It has the best score here (1.9), while costing about 15.3x less than Clef Omni (default).

Detailed comparison

Metric Clef Omni Clef Omni default Release: 2026-10-12 d1.2 d1.2 default Release: 2026-11-17
Score 1.9 1.9
Rank #514 #518
Reliability 10.0 10.0
Consistency 5.2 4.6
Attempts 36/69 36/69
Tests Correct
Attempt pass rate 8.7% 13.0%
Flaky tests 0 2
Total Runs 36 36
Cost per result 0.526 0.035
Total Cost $0.011 $0.001
Input Price $0.150 / 1M $0.020 / 1M
Output Price $0.000 / 1M $0.000 / 1M
Cache Read Price N/A N/A
Cache Write Price N/A N/A
Total Input Tokens 70,125 34,410
Output Tokens 0 0
Reasoning Tokens 0 0
Response Time (avg) 880ms 755ms
Response Time (max) 1.31s 1.32s
Response Time (total) 10.56s 9.06s
Parameters 30B total (3B active) -
Availability Open source Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Clef Omni 2.5 6.7 0.0% 0 614ms 33,750 0 0
d1.2 2.3 6.7 0.0% 0 539ms 17,655 0 0

Switch Comparison Pair

Gemini 3 Flash Previewhighvsd1.2defaultClef OmnidefaultvsGemini 3 Flash PreviewhighClef OmnidefaultvsCommand A+lowCommand A+lowvsd1.2defaultClef OmnidefaultvsCommand A+noneCommand A+nonevsd1.2defaultClef OmnidefaultvsCommand A+highCommand A+highvsd1.2defaultClef OmnidefaultvsXing4.0 29b A4bnoneFree Availabled1.2defaultvsXing4.0 29b A4bnoneFree AvailableClef OmnidefaultvsCommand A+mediumClef OmnidefaultvsGrok 4.20none