Navigate
Advertise here

Groundhog 1 (default) vs Gemini 3 Flash Preview (high)

Groundhog 1 (default) leads on average score with 2.5 vs 1.8. Groundhog 1 (default) has the lower benchmark cost at $0.002 vs $0.105. Groundhog 1 (default) is faster at 671ms vs 52.45s, with pass rates of 21.7% vs 4.4%.

Last updated at: 2026-11-22

Compared models

Rank
#520
Total Output Tokens
69
Response Time (avg)
671ms
Total Cost
$0.002
Rank
#536
Total Output Tokens
12,557
Response Time (avg)
52.45s
Total Cost
$0.105
Recommended model Groundhog 1 (default)

It has the best score here (2.5), while costing about 54.6x less than Gemini 3 Flash Preview (high).

Detailed comparison

Metric Groundhog 1 Groundhog 1 default Release: 2026-11-20 Gemini 3 Flash Preview Gemini 3 Flash Preview high Release: 2025-12-17
Score 2.5 1.8
Rank #520 #536
Reliability 10.0 10.0
Consistency 5.2 0.4
Attempts 36/69 3/69
Tests Correct
Attempt pass rate 21.7% 4.4%
Flaky tests 0 0
Total Runs 36 3
Cost per result 0.039 10.470
Total Cost $0.002 $0.105
Input Price $0.035 / 1M $0.500 / 1M
Output Price $0.000 / 1M $3.000 / 1M
Cache Read Price N/A $0.050 / 1M
Cache Write Price N/A $0.084 / 1M
Total Input Tokens 54,825 134,050
Output Tokens 69 1,029
Reasoning Tokens 0 11,528
Response Time (avg) 671ms 52.45s
Response Time (max) 1.04s 52.45s
Response Time (total) 8.05s 52.45s
Parameters 26B total (4B active) ~500B total (~20B active)
Availability Open source Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Groundhog 1 2.4 6.7 0.0% 0 829ms 26,445 12 0
Gemini 3 Flash Preview 0.0 0.0 0.0% 0 0ms 0 0 0

Switch Comparison Pair

Gemini 3 Flash PreviewhighvsD1defaultGemini 3 Flash Previewhighvsd1.2defaultJoey 1defaultvsGemini 3 Flash PreviewhighGemini 3 Flash PreviewhighvsDecider Flash V1.2defaultClef OmnidefaultvsGemini 3 Flash PreviewhighGemini 3 Flash PreviewhighvsSolar Decide FlashdefaultGemini 3 Flash PreviewhighvsPplx Decider Flash V1.3defaultFree AvailableGemini 3 Flash PreviewhighvsDecisions FastdefaultFree AvailableGemini 3 Flash PreviewhighvsClassify-1defaultBison 1defaultvsGemini 3 Flash PreviewhighMammoth 1defaultFree AvailablevsGemini 3 Flash PreviewhighGroundhog 1defaultvsCommand A+low