Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Bison 1 (default) vs GPT-6 Luna Decisions (default)

GPT-6 Luna Decisions (default) leads on average score with 2.4 vs 2.2. Bison 1 (default) has the lower benchmark cost at $0.004 vs $0.005. GPT-6 Luna Decisions (default) is faster at 495ms vs 680ms, with pass rates of 23.2% vs 13.0%.

Last updated at: 2026-11-22

Compared models

Rank
#526
Total Output Tokens
36
Response Time (avg)
680ms
Total Cost
$0.004
Rank
#522
Total Output Tokens
0
Response Time (avg)
495ms
Total Cost
$0.005
Recommended model GPT-6 Luna Decisions (default)

It has the strongest score in this comparison (2.4) and the best overall balance of cost and response time across 2 models.

Detailed comparison

Metric Bison 1 Bison 1 default Release: 2026-11-20 GPT-6 Luna Decisions GPT-6 Luna Decisions default Release: 2026-10-07
Score 2.2 2.4
Rank #526 #522
Reliability 7.5 10.0
Consistency 4.1 5.2
Attempts 36/69 36/69
Tests Correct
Attempt pass rate 23.2% 13.0%
Flaky tests 3 0
Total Runs 36 36
Cost per result 0.093 0.159
Total Cost $0.004 $0.005
Input Price $0.100 / 1M $0.100 / 1M
Output Price $0.000 / 1M $0.000 / 1M
Cache Read Price N/A $0.000 / 1M
Cache Write Price N/A $0.000 / 1M
Total Input Tokens 37,001 47,583
Output Tokens 36 0
Reasoning Tokens 0 0
Response Time (avg) 680ms 495ms
Response Time (max) 1.40s 842ms
Response Time (total) 8.16s 5.94s
Parameters 31B ~400B total (~17B active)
Availability Open source Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Bison 1 2.9 3.7 22.2% 1 844ms 17,630 8 0
GPT-6 Luna Decisions 2.5 6.7 0.0% 0 447ms 22,197 0 0

Switch Comparison Pair

Bison 1defaultvsGemini 3 Flash PreviewhighCommand A+lowvsGPT-6 Luna DecisionsdefaultCommand A+nonevsGPT-6 Luna DecisionsdefaultGemini 3 Flash PreviewhighvsGPT-6 Luna DecisionsdefaultCommand A+highvsGPT-6 Luna DecisionsdefaultBison 1defaultvsCommand A+lowBison 1defaultvsCommand A+noneGPT-6 Luna DecisionsdefaultvsXing4.0 29b A4bnoneFree AvailableCommand A+mediumvsGPT-6 Luna DecisionsdefaultGPT-6 Luna DecisionsdefaultvsGrok 4.20noneBison 1defaultvsCommand A+highBison 1defaultvsXing4.0 29b A4bnoneFree Available