Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Mammoth 1 (default) vs Clef Omni (default)

Mammoth 1 (default) leads on average score with 2.2 vs 1.9. Mammoth 1 (default) has the lower benchmark cost at $0.000 vs $0.011. Clef Omni (default) is faster at 880ms vs 1.80s, with pass rates of 18.8% vs 8.7%.

Last updated at: 2026-10-24

Compared models

Rank
#442
Total Output Tokens
54
Response Time (avg)
1.80s
Total Cost
$0.000
Rank
#444
Total Output Tokens
0
Response Time (avg)
880ms
Total Cost
$0.011
Recommended model Mammoth 1 (default)

It has the strongest score in this comparison (2.2) and the best overall balance of cost and response time across 2 models.

Detailed comparison

Metric Mammoth 1 Mammoth 1 default Release: 2026-10-24 Free Available Clef Omni Clef Omni default Release: 2026-10-12
Score 2.2 1.9
Rank #442 #444
Reliability 8.9 10.0
Consistency 4.2 5.2
Attempts 36/69 36/69
Tests Correct
Attempt pass rate 18.8% 8.7%
Flaky tests 3 0
Total Runs 36 36
Cost per result 0.000 0.526
Total Cost $0.000 $0.011
Input Price $0.000 / 1M $0.150 / 1M
Output Price $0.000 / 1M $0.000 / 1M
Cache Read Price N/A N/A
Cache Write Price N/A N/A
Total Input Tokens 45,468 70,125
Output Tokens 54 0
Reasoning Tokens 0 0
Response Time (avg) 1.80s 880ms
Response Time (max) 8.17s 1.31s
Response Time (total) 21.63s 10.56s
Parameters 27B 30B total (3B active)
Availability Open source Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mammoth 1 4.9 6.7 33.3% 0 951ms 25,497 12 0
Clef Omni 2.5 6.7 0.0% 0 614ms 33,750 0 0

Switch Comparison Pair

Clef OmnidefaultvsGemini 3 Flash PreviewhighMammoth 1defaultFree AvailablevsGemini 3 Flash PreviewhighMammoth 1defaultFree AvailablevsCommand A+lowMammoth 1defaultFree AvailablevsCommand A+noneMammoth 1defaultFree AvailablevsCommand A+highClef OmnidefaultvsCommand A+lowClef OmnidefaultvsCommand A+noneMammoth 1defaultFree AvailablevsXing4.0 29b A4bnoneFree AvailableMammoth 1defaultFree AvailablevsCommand A+mediumMammoth 1defaultFree AvailablevsGrok 4.20noneClef OmnidefaultvsCommand A+highClef OmnidefaultvsXing4.0 29b A4bnoneFree Available