Navigate
Advertise here

Ember-1 (high) vs GPT-5.6 Luna (low)

The average score is effectively tied at 6.9 vs 6.9. GPT-5.6 Luna (low) has the lower benchmark cost at $0.049 vs $2.405. GPT-5.6 Luna (low) is faster at 6.96s vs 58.14s, with pass rates of 71.0% vs 56.5%.

Last updated at: 2026-11-13

Compared models

Rank
#235
Total Output Tokens
121,223
Response Time (avg)
58.14s
Total Cost
$2.405
Rank
#237
Total Output Tokens
28,001
Response Time (avg)
6.96s
Total Cost
$0.049
Recommended model GPT-5.6 Luna (low)

It has the best score here (6.9), while costing about 49.3x less than Ember-1 (high).

Detailed comparison

Metric Ember-1 Ember-1 high Release: 2026-09-28 GPT-5.6 Luna GPT-5.6 Luna low Release: 2026-07-09
Score 6.9 6.9
Rank #235 #237
Reliability 8.6 10.0
Consistency 7.2 8.3
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 71.0% 56.5%
Flaky tests 8 5
Total Runs 69 69
Cost per result 20.041 2.428
Total Cost $2.405 $0.049
Input Price $3.000 / 1M $0.200 / 1M
Output Price $15.000 / 1M $1.200 / 1M
Cache Read Price $0.300 / 1M $0.020 / 1M
Cache Write Price N/A $0.250 / 1M
Total Input Tokens 195,489 202,680
Output Tokens 12,475 9,230
Reasoning Tokens 108,748 18,771
Response Time (avg) 58.14s 6.96s
Response Time (max) 255.06s 45.74s
Response Time (total) 1337.19s 160.19s
Parameters ~2.8T total (~104B active) ~400B total (~17B active)
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#235 Ember-1

high
Cost
$0.038
Time
55.1s
Tokens
2,671 tok

#237 GPT-5.6 Luna

low
Cost
$0.011
Time
10.2s
Tokens
1,897 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Ember-1 8.2 7.2 88.9% 1 72.23s 7,144 1,281 23,093
GPT-5.6 Luna 5.5 10.0 33.3% 0 4.61s 7,302 557 3,535

Switch Comparison Pair