Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Groundhog 1 (default) vs Decider V1.1 27B (default)

The average score is effectively tied at 2.5 vs 2.6. Decider V1.1 27B (default) has the lower benchmark cost at $0.002 vs $0.002. Decider V1.1 27B (default) is faster at 320ms vs 671ms, with pass rates of 21.7% vs 17.4%.

Last updated at: 2026-11-22

Compared models

Rank
#520
Total Output Tokens
69
Response Time (avg)
671ms
Total Cost
$0.002
Rank
#519
Total Output Tokens
69
Response Time (avg)
320ms
Total Cost
$0.002
Recommended model Decider V1.1 27B (default)

It has the best score here (2.6), while responding about 2.1x faster than Groundhog 1 (default).

Detailed comparison

Metric Groundhog 1 Groundhog 1 default Release: 2026-11-20 Decider V1.1 27B Decider V1.1 27B default Release: 2026-10-07
Score 2.5 2.6
Rank #520 #519
Reliability 10.0 10.0
Consistency 5.2 5.2
Attempts 36/69 36/69
Tests Correct
Attempt pass rate 21.7% 17.4%
Flaky tests 0 0
Total Runs 36 36
Cost per result 0.039 0.037
Total Cost $0.002 $0.002
Input Price $0.035 / 1M $0.020 / 1M
Output Price $0.000 / 1M $0.000 / 1M
Cache Read Price N/A N/A
Cache Write Price N/A N/A
Total Input Tokens 54,825 73,557
Output Tokens 69 69
Reasoning Tokens 0 0
Response Time (avg) 671ms 320ms
Response Time (max) 1.04s 491ms
Response Time (total) 8.05s 3.84s
Parameters 26B total (4B active) 27B
Availability Open source Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Groundhog 1 2.4 6.7 0.0% 0 829ms 26,445 12 0
Decider V1.1 27B 4.9 6.7 33.3% 0 305ms 32,733 12 0

Switch Comparison Pair

Command A+lowvsDecider V1.1 27BdefaultGroundhog 1defaultvsCommand A+lowCommand A+nonevsDecider V1.1 27BdefaultGroundhog 1defaultvsCommand A+noneCommand A+highvsDecider V1.1 27BdefaultGroundhog 1defaultvsCommand A+highGroundhog 1defaultvsGemini 3 Flash PreviewhighGemini 3 Flash PreviewhighvsDecider V1.1 27BdefaultDecider V1.1 27BdefaultvsXing4.0 29b A4bnoneFree AvailableGroundhog 1defaultvsXing4.0 29b A4bnoneFree AvailableCommand A+mediumvsDecider V1.1 27BdefaultDecider V1.1 27BdefaultvsGrok 4.20none