Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Bison 1 (default) vs Kev 4B (default)

Kev 4B (default) leads on average score with 2.4 vs 2.2. Kev 4B (default) has the lower benchmark cost at $0.002 vs $0.004. Bison 1 (default) is faster at 680ms vs 5.63s, with pass rates of 23.2% vs 15.9%.

Last updated at: 2026-11-22

Compared models

Rank
#526
Total Output Tokens
36
Response Time (avg)
680ms
Total Cost
$0.004
Rank
#523
Total Output Tokens
28,061
Response Time (avg)
5.63s
Total Cost
$0.002
Recommended model Kev 4B (default)

It has the best score here (2.4), while costing about 2.1x less than Bison 1 (default).

Detailed comparison

Metric Bison 1 Bison 1 default Release: 2026-11-20 Kev 4B Kev 4B default Release: 2026-09-28
Score 2.2 2.4
Rank #526 #523
Reliability 7.5 10.0
Consistency 4.1 4.9
Attempts 36/69 36/69
Tests Correct
Attempt pass rate 23.2% 15.9%
Flaky tests 3 1
Total Runs 36 36
Cost per result 0.093 0.060
Total Cost $0.004 $0.002
Input Price $0.100 / 1M $0.042 / 1M
Output Price $0.000 / 1M $0.000 / 1M
Cache Read Price N/A N/A
Cache Write Price N/A N/A
Total Input Tokens 37,001 42,804
Output Tokens 36 28,061
Reasoning Tokens 0 0
Response Time (avg) 680ms 5.63s
Response Time (max) 1.40s 17.79s
Response Time (total) 8.16s 67.61s
Parameters 31B 4B
Availability Open source Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Bison 1 2.9 3.7 22.2% 1 844ms 17,630 8 0
Kev 4B 4.5 6.7 33.3% 0 771ms 21,603 12,207 0

Switch Comparison Pair

Bison 1defaultvsGemini 3 Flash PreviewhighCommand A+lowvsKev 4BdefaultCommand A+nonevsKev 4BdefaultGemini 3 Flash PreviewhighvsKev 4BdefaultCommand A+highvsKev 4BdefaultBison 1defaultvsCommand A+lowBison 1defaultvsCommand A+noneKev 4BdefaultvsXing4.0 29b A4bnoneFree AvailableCommand A+mediumvsKev 4BdefaultKev 4BdefaultvsGrok 4.20noneBison 1defaultvsCommand A+highBison 1defaultvsXing4.0 29b A4bnoneFree Available