Navigate
Advertise here

Groundhog 1 (default) vs Command A+ (low)

Command A+ (low) leads on average score with 3.0 vs 2.5. Groundhog 1 (default) has the lower benchmark cost at $0.002 vs $0.073. Groundhog 1 (default) is faster at 671ms vs 92.50s, with pass rates of 21.7% vs 1.5%.

Last updated at: 2026-11-22

Compared models

Rank
#520
Total Output Tokens
69
Response Time (avg)
671ms
Total Cost
$0.002
Rank
#509
Total Output Tokens
25,521
Response Time (avg)
92.50s
Total Cost
$0.073
Recommended model Groundhog 1 (default)

Its score stays close to the best score here (2.5 vs 3.0), while costing about 37.9x less than Command A+ (low).

Detailed comparison

Metric Groundhog 1 Groundhog 1 default Release: 2026-11-20 Command A+ Command A+ low Release: 2026-09-23
Score 2.5 3.0
Rank #520 #509
Reliability 10.0 3.5
Consistency 5.2 9.6
Attempts 36/69 69/69
Tests Correct
Attempt pass rate 21.7% 1.5%
Flaky tests 0 1
Total Runs 36 69
Cost per result 0.039 0.000
Total Cost $0.002 $0.073
Input Price $0.035 / 1M $0.300 / 1M
Output Price $0.000 / 1M $1.500 / 1M
Cache Read Price N/A $0.150 / 1M
Cache Write Price N/A N/A
Total Input Tokens 54,825 114,874
Output Tokens 69 1,992
Reasoning Tokens 0 23,529
Response Time (avg) 671ms 92.50s
Response Time (max) 1.04s 128.54s
Response Time (total) 8.05s 2127.40s
Parameters 26B total (4B active) 218B total (25B active)
Availability Open source Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#520 Groundhog 1

default
No showcase result has been generated for this model yet.
Cost
N/A
Time
-
Tokens
0 tok

#509 Command A+

low
Provider returned error
Cost
$0.000
Time
0.2s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Groundhog 1 2.4 6.7 0.0% 0 829ms 26,445 12 0
Command A+ 3.0 10.0 0.0% 0 86.43s 0 0 0

Switch Comparison Pair

Command A+lowvsGemini Decision 1defaultCommand A+lowvsd1.2-ultradefaultCommand A+lowvsSpan-02defaultCommand A+lowvsHeyGen DecisiondefaultCommand A+lowvsPplx Decider V1.3defaultFree AvailableCommand A+lowvsHeyGen Decision TurbodefaultCommand A+lowvsd1-ultradefaultCommand A+lowvsXing4.0 29b A4bnoneFree AvailableCommand A+lowvsJev 1.13defaultCommand A+lowvsDecider V1.2defaultCommand A+lowvsReflexdefaultCommand A+lowvsGrok 4.20none