Navigate
Advertise here

Bison 1 (default) vs Clef Omni (default)

Bison 1 (default) leads on average score with 2.2 vs 1.9. Bison 1 (default) has the lower benchmark cost at $0.004 vs $0.011. Bison 1 (default) is faster at 680ms vs 880ms, with pass rates of 23.2% vs 8.7%.

Last updated at: 2026-11-22

Compared models

Rank
#526
Total Output Tokens
36
Response Time (avg)
680ms
Total Cost
$0.004
Rank
#530
Total Output Tokens
0
Response Time (avg)
880ms
Total Cost
$0.011
Recommended model Bison 1 (default)

It has the best score here (2.2), while costing about 2.8x less than Clef Omni (default).

Detailed comparison

Metric Bison 1 Bison 1 default Release: 2026-11-20 Clef Omni Clef Omni default Release: 2026-10-12
Score 2.2 1.9
Rank #526 #530
Reliability 7.5 10.0
Consistency 4.1 5.2
Attempts 36/69 36/69
Tests Correct
Attempt pass rate 23.2% 8.7%
Flaky tests 3 0
Total Runs 36 36
Cost per result 0.093 0.526
Total Cost $0.004 $0.011
Input Price $0.100 / 1M $0.150 / 1M
Output Price $0.000 / 1M $0.000 / 1M
Cache Read Price N/A N/A
Cache Write Price N/A N/A
Total Input Tokens 37,001 70,125
Output Tokens 36 0
Reasoning Tokens 0 0
Response Time (avg) 680ms 880ms
Response Time (max) 1.40s 1.31s
Response Time (total) 8.16s 10.56s
Parameters 31B 30B total (3B active)
Availability Open source Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Bison 1 2.9 3.7 22.2% 1 844ms 17,630 8 0
Clef Omni 2.5 6.7 0.0% 0 614ms 33,750 0 0

Switch Comparison Pair

Clef OmnidefaultvsGemini 3 Flash PreviewhighBison 1defaultvsGemini 3 Flash PreviewhighBison 1defaultvsCommand A+lowBison 1defaultvsCommand A+noneBison 1defaultvsCommand A+highClef OmnidefaultvsCommand A+lowClef OmnidefaultvsCommand A+noneBison 1defaultvsXing4.0 29b A4bnoneFree AvailableBison 1defaultvsCommand A+mediumBison 1defaultvsGrok 4.20noneClef OmnidefaultvsCommand A+highClef OmnidefaultvsXing4.0 29b A4bnoneFree Available