Navigate
Advertise here

Bison 1 (default) vs Drex v1.5 (default)

Drex v1.5 (default) leads on average score with 2.4 vs 2.2. Drex v1.5 (default) has the lower benchmark cost at $0.002 vs $0.004. Bison 1 (default) is faster at 680ms vs 986ms, with pass rates of 23.2% vs 17.4%.

Last updated at: 2026-11-22

Compared models

Rank
#526
Total Output Tokens
36
Response Time (avg)
680ms
Total Cost
$0.004
Rank
#521
Total Output Tokens
27,468
Response Time (avg)
986ms
Total Cost
$0.002
Recommended model Drex v1.5 (default)

It has the best score here (2.4), while costing about 2.2x less than Bison 1 (default).

Detailed comparison

Metric Bison 1 Bison 1 default Release: 2026-11-20 Drex v1.5 Drex v1.5 default Release: 2026-10-12
Score 2.2 2.4
Rank #526 #521
Reliability 7.5 10.0
Consistency 4.1 5.2
Attempts 36/69 36/69
Tests Correct
Attempt pass rate 23.2% 17.4%
Flaky tests 3 0
Total Runs 36 36
Cost per result 0.093 0.043
Total Cost $0.004 $0.002
Input Price $0.100 / 1M $0.040 / 1M
Output Price $0.000 / 1M $0.000 / 1M
Cache Read Price N/A N/A
Cache Write Price N/A N/A
Total Input Tokens 37,001 42,804
Output Tokens 36 27,468
Reasoning Tokens 0 0
Response Time (avg) 680ms 986ms
Response Time (max) 1.40s 1.38s
Response Time (total) 8.16s 11.84s
Parameters 31B 8.95B
Availability Open source Weights available

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Bison 1 2.9 3.7 22.2% 1 844ms 17,630 8 0
Drex v1.5 4.5 6.7 33.3% 0 794ms 21,603 12,192 0

Switch Comparison Pair

Bison 1defaultvsGemini 3 Flash PreviewhighCommand A+lowvsDrex v1.5defaultCommand A+nonevsDrex v1.5defaultGemini 3 Flash PreviewhighvsDrex v1.5defaultCommand A+highvsDrex v1.5defaultBison 1defaultvsCommand A+lowBison 1defaultvsCommand A+noneDrex v1.5defaultvsXing4.0 29b A4bnoneFree AvailableCommand A+mediumvsDrex v1.5defaultDrex v1.5defaultvsGrok 4.20noneBison 1defaultvsCommand A+highBison 1defaultvsXing4.0 29b A4bnoneFree Available