Navigate
Advertise here

Bison 1 (default) vs Gemini 3 Flash Preview (high)

Bison 1 (default) leads on average score with 2.2 vs 1.8. Bison 1 (default) has the lower benchmark cost at $0.004 vs $0.105. Bison 1 (default) is faster at 680ms vs 52.45s, with pass rates of 23.2% vs 4.4%.

Last updated at: 2026-11-22

Compared models

Rank
#526
Total Output Tokens
36
Response Time (avg)
680ms
Total Cost
$0.004
Rank
#536
Total Output Tokens
12,557
Response Time (avg)
52.45s
Total Cost
$0.105
Recommended model Bison 1 (default)

It has the best score here (2.2), while costing about 28.3x less than Gemini 3 Flash Preview (high).

Detailed comparison

Metric Bison 1 Bison 1 default Release: 2026-11-20 Gemini 3 Flash Preview Gemini 3 Flash Preview high Release: 2025-12-17
Score 2.2 1.8
Rank #526 #536
Reliability 7.5 10.0
Consistency 4.1 0.4
Attempts 36/69 3/69
Tests Correct
Attempt pass rate 23.2% 4.4%
Flaky tests 3 0
Total Runs 36 3
Cost per result 0.093 10.470
Total Cost $0.004 $0.105
Input Price $0.100 / 1M $0.500 / 1M
Output Price $0.000 / 1M $3.000 / 1M
Cache Read Price N/A $0.050 / 1M
Cache Write Price N/A $0.084 / 1M
Total Input Tokens 37,001 134,050
Output Tokens 36 1,029
Reasoning Tokens 0 11,528
Response Time (avg) 680ms 52.45s
Response Time (max) 1.40s 52.45s
Response Time (total) 8.16s 52.45s
Parameters 31B ~500B total (~20B active)
Availability Open source Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Bison 1 2.9 3.7 22.2% 1 844ms 17,630 8 0
Gemini 3 Flash Preview 0.0 0.0 0.0% 0 0ms 0 0 0

Switch Comparison Pair

Gemini 3 Flash PreviewhighvsD1defaultGemini 3 Flash Previewhighvsd1.2defaultJoey 1defaultvsGemini 3 Flash PreviewhighGemini 3 Flash PreviewhighvsDecider Flash V1.2defaultClef OmnidefaultvsGemini 3 Flash PreviewhighGemini 3 Flash PreviewhighvsSolar Decide FlashdefaultGemini 3 Flash PreviewhighvsPplx Decider Flash V1.3defaultFree AvailableGemini 3 Flash PreviewhighvsDecisions FastdefaultFree AvailableGemini 3 Flash PreviewhighvsClassify-1defaultMammoth 1defaultFree AvailablevsGemini 3 Flash PreviewhighGemini 3 Flash PreviewhighvsMicrosoft-Decision-1defaultGemini 3 Flash Previewhighvsd1.1default