Navigate
Advertise here

Groundhog 1 (default) vs GPT-6 Luna Decisions (default)

Groundhog 1 (default) leads on average score with 2.5 vs 2.4. Groundhog 1 (default) has the lower benchmark cost at $0.002 vs $0.005. GPT-6 Luna Decisions (default) is faster at 495ms vs 671ms, with pass rates of 21.7% vs 13.0%.

Last updated at: 2026-11-22

Compared models

Rank
#520
Total Output Tokens
69
Response Time (avg)
671ms
Total Cost
$0.002
Rank
#522
Total Output Tokens
0
Response Time (avg)
495ms
Total Cost
$0.005
Recommended model Groundhog 1 (default)

It has the best score here (2.5), while costing about 2.5x less than GPT-6 Luna Decisions (default).

Detailed comparison

Metric Groundhog 1 Groundhog 1 default Release: 2026-11-20 GPT-6 Luna Decisions GPT-6 Luna Decisions default Release: 2026-10-07
Score 2.5 2.4
Rank #520 #522
Reliability 10.0 10.0
Consistency 5.2 5.2
Attempts 36/69 36/69
Tests Correct
Attempt pass rate 21.7% 13.0%
Flaky tests 0 0
Total Runs 36 36
Cost per result 0.039 0.159
Total Cost $0.002 $0.005
Input Price $0.035 / 1M $0.100 / 1M
Output Price $0.000 / 1M $0.000 / 1M
Cache Read Price N/A $0.000 / 1M
Cache Write Price N/A $0.000 / 1M
Total Input Tokens 54,825 47,583
Output Tokens 69 0
Reasoning Tokens 0 0
Response Time (avg) 671ms 495ms
Response Time (max) 1.04s 842ms
Response Time (total) 8.05s 5.94s
Parameters 26B total (4B active) ~400B total (~17B active)
Availability Open source Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Groundhog 1 2.4 6.7 0.0% 0 829ms 26,445 12 0
GPT-6 Luna Decisions 2.5 6.7 0.0% 0 447ms 22,197 0 0

Switch Comparison Pair

Groundhog 1defaultvsCommand A+lowGroundhog 1defaultvsCommand A+noneCommand A+lowvsGPT-6 Luna DecisionsdefaultCommand A+nonevsGPT-6 Luna DecisionsdefaultGemini 3 Flash PreviewhighvsGPT-6 Luna DecisionsdefaultGroundhog 1defaultvsCommand A+highGroundhog 1defaultvsGemini 3 Flash PreviewhighCommand A+highvsGPT-6 Luna DecisionsdefaultGroundhog 1defaultvsXing4.0 29b A4bnoneFree AvailableGroundhog 1defaultvsCommand A+mediumGroundhog 1defaultvsGrok 4.20noneGPT-6 Luna DecisionsdefaultvsXing4.0 29b A4bnoneFree Available