Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Bison 1 (default) vs Decisions Fast (default)

Bison 1 (default) leads on average score with 2.2 vs 2.0. Decisions Fast (default) has the lower benchmark cost at $0.000 vs $0.004. Bison 1 (default) is faster at 680ms vs 1.04s, with pass rates of 23.2% vs 18.8%.

Last updated at: 2026-11-22

Compared models

Rank
#526
Total Output Tokens
36
Response Time (avg)
680ms
Total Cost
$0.004
Rank
#528
Total Output Tokens
0
Response Time (avg)
1.04s
Total Cost
$0.000
Recommended model Bison 1 (default)

It has the best score here (2.2), while responding about 1.5x faster than Decisions Fast (default).

Detailed comparison

Metric Bison 1 Bison 1 default Release: 2026-11-20 Decisions Fast Decisions Fast default Release: 2026-11-06 Free Available
Score 2.2 2.0
Rank #526 #528
Reliability 7.5 10.0
Consistency 4.1 4.9
Attempts 36/69 36/69
Tests Correct
Attempt pass rate 23.2% 18.8%
Flaky tests 3 1
Total Runs 36 36
Cost per result 0.093 0.000
Total Cost $0.004 $0.000
Input Price $0.100 / 1M $0.000 / 1M
Output Price $0.000 / 1M $0.000 / 1M
Cache Read Price N/A N/A
Cache Write Price N/A N/A
Total Input Tokens 37,001 159,639
Output Tokens 36 0
Reasoning Tokens 0 0
Response Time (avg) 680ms 1.04s
Response Time (max) 1.40s 1.54s
Response Time (total) 8.16s 12.49s
Parameters 31B -
Availability Open source Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Bison 1 2.9 3.7 22.2% 1 844ms 17,630 8 0
Decisions Fast 2.2 6.7 0.0% 0 1.22s 44,116 0 0

Switch Comparison Pair

Gemini 3 Flash PreviewhighvsDecisions FastdefaultFree AvailableBison 1defaultvsGemini 3 Flash PreviewhighBison 1defaultvsCommand A+lowBison 1defaultvsCommand A+noneCommand A+lowvsDecisions FastdefaultFree AvailableCommand A+nonevsDecisions FastdefaultFree AvailableBison 1defaultvsCommand A+highBison 1defaultvsXing4.0 29b A4bnoneFree AvailableCommand A+highvsDecisions FastdefaultFree AvailableBison 1defaultvsCommand A+mediumBison 1defaultvsGrok 4.20noneDecisions FastdefaultFree AvailablevsXing4.0 29b A4bnoneFree Available