Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Bison 1 (default) vs Classify-1 (default)

The average score is effectively tied at 2.2 vs 2.2. Bison 1 (default) has the lower benchmark cost at $0.004 vs $0.008. Bison 1 (default) is faster at 680ms vs 4.58s, with pass rates of 23.2% vs 18.8%.

Last updated at: 2026-11-22

Compared models

Rank
#526
Total Output Tokens
36
Response Time (avg)
680ms
Total Cost
$0.004
Rank
#527
Total Output Tokens
164
Response Time (avg)
4.58s
Total Cost
$0.008
Recommended model Bison 1 (default)

It has the best score here (2.2), while costing about 2.1x less than Classify-1 (default).

Detailed comparison

Metric Bison 1 Bison 1 default Release: 2026-11-20 Classify-1 Classify-1 default Release: 2026-10-13
Score 2.2 2.2
Rank #526 #527
Reliability 7.5 9.4
Consistency 4.1 4.5
Attempts 36/69 36/69
Tests Correct
Attempt pass rate 23.2% 18.8%
Flaky tests 3 2
Total Runs 36 36
Cost per result 0.093 0.261
Total Cost $0.004 $0.008
Input Price $0.100 / 1M $0.040 / 1M
Output Price $0.000 / 1M $0.000 / 1M
Cache Read Price N/A N/A
Cache Write Price N/A N/A
Total Input Tokens 37,001 195,645
Output Tokens 36 164
Reasoning Tokens 0 0
Response Time (avg) 680ms 4.58s
Response Time (max) 1.40s 13.35s
Response Time (total) 8.16s 55.01s
Parameters 31B ~1B
Availability Open source Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Bison 1 2.9 3.7 22.2% 1 844ms 17,630 8 0
Classify-1 2.7 3.7 22.2% 1 12.73s 105,738 50 0

Switch Comparison Pair

Gemini 3 Flash PreviewhighvsClassify-1defaultBison 1defaultvsGemini 3 Flash PreviewhighBison 1defaultvsCommand A+lowCommand A+lowvsClassify-1defaultBison 1defaultvsCommand A+noneCommand A+nonevsClassify-1defaultBison 1defaultvsCommand A+highCommand A+highvsClassify-1defaultBison 1defaultvsXing4.0 29b A4bnoneFree AvailableClassify-1defaultvsXing4.0 29b A4bnoneFree AvailableBison 1defaultvsCommand A+mediumBison 1defaultvsGrok 4.20none