Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Clef Omni (default) vs Grok 4.20

Grok 4.20 leads on average score with 3.4 vs 1.9. Clef Omni (default) has the lower benchmark cost at $0.011 vs $0.057. Clef Omni (default) is faster at 880ms vs 1.11s, with pass rates of 8.7% vs 26.1%.

Last updated at: 2026-10-12

Compared models

Rank
#402
Total Output Tokens
0
Response Time (avg)
880ms
Total Cost
$0.011
Rank
#384
Total Output Tokens
1,923
Response Time (avg)
1.11s
Total Cost
$0.057
Recommended model Grok 4.20

It has the strongest score in this comparison (3.4) and the best overall balance of cost and response time across 2 models.

Detailed comparison

Metric Clef Omni Clef Omni default Release: 2026-10-12 Grok 4.20 Grok 4.20 none Release: 2026-03-31
Score 1.9 3.4
Rank #402 #384
Reliability 10.0 N/A
Consistency 5.2 7.8
Attempts 36/69 54/69
Tests Correct
Attempt pass rate 8.7% 26.1%
Flaky tests 0 0
Total Runs 36 54
Cost per result 0.526 1.570
Total Cost $0.011 $0.057
Input Price $0.150 / 1M $1.250 / 1M
Output Price $0.000 / 1M $2.500 / 1M
Cache Read Price N/A $0.200 / 1M
Cache Write Price N/A N/A
Total Input Tokens 70,125 41,313
Output Tokens 0 1,923
Reasoning Tokens 0 0
Response Time (avg) 880ms 1.11s
Response Time (max) 1.31s 6.04s
Response Time (total) 10.56s 19.96s
Parameters 30B total (3B active) ~1T total (~100B active)
Availability Open source Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#402 Clef Omni

default
No showcase result has been generated for this model yet.
Cost
N/A
Time
-
Tokens
0 tok

#384 xAI: Grok 4.20

none
Cost
$0.004
Time
6.5s
Tokens
1,367 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Clef Omni 2.5 6.7 0.0% 0 614ms 33,750 0 0
Grok 4.20 1.1 3.1 0.0% 0 1.22s 1,074 312 0

Switch Comparison Pair

Command A+mediumvsGrok 4.20noneClef OmnidefaultvsGemini 3 Flash PreviewhighCommand A+highvsGrok 4.20noneLing 3.0 TinymediumvsGrok 4.20noneLing 3.0 TinylowvsGrok 4.20noneLing 3.0 TinyhighvsGrok 4.20noneCommand A+lowvsGrok 4.20noneGranite 4.1 8bdefaultvsGrok 4.20noneLing 3.0 TinydefaultvsGrok 4.20noneQwen3.5-9BmediumvsGrok 4.20noneJev 1.13defaultvsGrok 4.20noneDecider V1.1 27BdefaultvsGrok 4.20none