Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Groundhog 1 (default) vs Mammoth 1 (default)

Groundhog 1 (default) leads on average score with 2.5 vs 2.2. Mammoth 1 (default) has the lower benchmark cost at $0.000 vs $0.002. Groundhog 1 (default) is faster at 671ms vs 1.80s, with pass rates of 21.7% vs 18.8%.

Last updated at: 2026-11-22

Compared models

Rank
#520
Total Output Tokens
69
Response Time (avg)
671ms
Total Cost
$0.002
Rank
#525
Total Output Tokens
54
Response Time (avg)
1.80s
Total Cost
$0.000
Recommended model Groundhog 1 (default)

It has the best score here (2.5), while responding about 2.7x faster than Mammoth 1 (default).

Detailed comparison

Metric Groundhog 1 Groundhog 1 default Release: 2026-11-20 Mammoth 1 Mammoth 1 default Release: 2026-10-24 Free Available
Score 2.5 2.2
Rank #520 #525
Reliability 10.0 8.9
Consistency 5.2 4.2
Attempts 36/69 36/69
Tests Correct
Attempt pass rate 21.7% 18.8%
Flaky tests 0 3
Total Runs 36 36
Cost per result 0.039 0.000
Total Cost $0.002 $0.000
Input Price $0.035 / 1M $0.000 / 1M
Output Price $0.000 / 1M $0.000 / 1M
Cache Read Price N/A N/A
Cache Write Price N/A N/A
Total Input Tokens 54,825 45,468
Output Tokens 69 54
Reasoning Tokens 0 0
Response Time (avg) 671ms 1.80s
Response Time (max) 1.04s 8.17s
Response Time (total) 8.05s 21.63s
Parameters 26B total (4B active) 27B
Availability Open source Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Groundhog 1 2.4 6.7 0.0% 0 829ms 26,445 12 0
Mammoth 1 4.9 6.7 33.3% 0 951ms 25,497 12 0

Switch Comparison Pair

Mammoth 1defaultFree AvailablevsGemini 3 Flash PreviewhighGroundhog 1defaultvsCommand A+lowGroundhog 1defaultvsCommand A+noneGroundhog 1defaultvsCommand A+highGroundhog 1defaultvsGemini 3 Flash PreviewhighGroundhog 1defaultvsXing4.0 29b A4bnoneFree AvailableMammoth 1defaultFree AvailablevsCommand A+lowMammoth 1defaultFree AvailablevsCommand A+noneGroundhog 1defaultvsCommand A+mediumGroundhog 1defaultvsGrok 4.20noneMammoth 1defaultFree AvailablevsCommand A+highGroundhog 1defaultvsLing 3.0 Tinymedium