Navigate
Advertise here

Bison 1 (default) vs Command A+

Command A+ leads on average score with 3.0 vs 2.2. Command A+ has the lower benchmark cost at $0.000 vs $0.004. Bison 1 (default) is faster at 680ms vs 77.87s, with pass rates of 23.2% vs 0.0%.

Last updated at: 2026-11-22

Compared models

Rank
#526
Total Output Tokens
36
Response Time (avg)
680ms
Total Cost
$0.004
Rank
#508
Total Output Tokens
0
Response Time (avg)
77.87s
Total Cost
$0.000
Recommended model Command A+

It has the strongest score in this comparison (3.0) and the best overall balance of cost and response time across 2 models.

Detailed comparison

Metric Bison 1 Bison 1 default Release: 2026-11-20 Command A+ Command A+ none Release: 2026-09-23
Score 2.2 3.0
Rank #526 #508
Reliability 7.5 0.0
Consistency 4.1 10.0
Attempts 36/69 69/69
Tests Correct
Attempt pass rate 23.2% 0.0%
Flaky tests 3 0
Total Runs 36 69
Cost per result 0.093 0.000
Total Cost $0.004 $0.000
Input Price $0.100 / 1M $0.300 / 1M
Output Price $0.000 / 1M $1.500 / 1M
Cache Read Price N/A $0.150 / 1M
Cache Write Price N/A N/A
Total Input Tokens 37,001 0
Output Tokens 36 0
Reasoning Tokens 0 0
Response Time (avg) 680ms 77.87s
Response Time (max) 1.40s 106.37s
Response Time (total) 8.16s 1791.03s
Parameters 31B 218B total (25B active)
Availability Open source Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#526 Bison 1

default
No showcase result has been generated for this model yet.
Cost
N/A
Time
-
Tokens
0 tok

#508 Command A+

none
Provider returned error
Cost
$0.000
Time
0.2s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Bison 1 2.9 3.7 22.2% 1 844ms 17,630 8 0
Command A+ 3.0 10.0 0.0% 0 80.82s 0 0 0

Switch Comparison Pair

Command A+nonevsd1.2-ultradefaultCommand A+nonevsGemini Decision 1defaultCommand A+nonevsHeyGen DecisiondefaultCommand A+nonevsHeyGen Decision TurbodefaultCommand A+nonevsSpan-02defaultCommand A+nonevsPplx Decider V1.3defaultFree AvailableBison 1defaultvsGemini 3 Flash PreviewhighCommand A+nonevsd1-ultradefaultCommand A+nonevsJev 1.13defaultCommand A+nonevsDecider V1.2defaultCommand A+nonevsReflexdefaultCommand A+nonevsDecider V1.1 27Bdefault