Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Groundhog 1 (default) vs Kev 4B (default)

Groundhog 1 (default) leads on average score with 2.5 vs 2.4. Kev 4B (default) has the lower benchmark cost at $0.002 vs $0.002. Groundhog 1 (default) is faster at 671ms vs 5.63s, with pass rates of 21.7% vs 15.9%.

Last updated at: 2026-11-22

Compared models

Rank
#520
Total Output Tokens
69
Response Time (avg)
671ms
Total Cost
$0.002
Rank
#523
Total Output Tokens
28,061
Response Time (avg)
5.63s
Total Cost
$0.002
Recommended model Groundhog 1 (default)

It has the best score here (2.5), while responding about 8.4x faster than Kev 4B (default).

Detailed comparison

Metric Groundhog 1 Groundhog 1 default Release: 2026-11-20 Kev 4B Kev 4B default Release: 2026-09-28
Score 2.5 2.4
Rank #520 #523
Reliability 10.0 10.0
Consistency 5.2 4.9
Attempts 36/69 36/69
Tests Correct
Attempt pass rate 21.7% 15.9%
Flaky tests 0 1
Total Runs 36 36
Cost per result 0.039 0.060
Total Cost $0.002 $0.002
Input Price $0.035 / 1M $0.042 / 1M
Output Price $0.000 / 1M $0.000 / 1M
Cache Read Price N/A N/A
Cache Write Price N/A N/A
Total Input Tokens 54,825 42,804
Output Tokens 69 28,061
Reasoning Tokens 0 0
Response Time (avg) 671ms 5.63s
Response Time (max) 1.04s 17.79s
Response Time (total) 8.05s 67.61s
Parameters 26B total (4B active) 4B
Availability Open source Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Groundhog 1 2.4 6.7 0.0% 0 829ms 26,445 12 0
Kev 4B 4.5 6.7 33.3% 0 771ms 21,603 12,207 0

Switch Comparison Pair

Groundhog 1defaultvsCommand A+lowGroundhog 1defaultvsCommand A+noneCommand A+lowvsKev 4BdefaultCommand A+nonevsKev 4BdefaultGemini 3 Flash PreviewhighvsKev 4BdefaultGroundhog 1defaultvsCommand A+highGroundhog 1defaultvsGemini 3 Flash PreviewhighCommand A+highvsKev 4BdefaultGroundhog 1defaultvsXing4.0 29b A4bnoneFree AvailableGroundhog 1defaultvsCommand A+mediumGroundhog 1defaultvsGrok 4.20noneKev 4BdefaultvsXing4.0 29b A4bnoneFree Available