Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Ember-1 (max) vs Grok Build 0.1 (medium)

The average score is effectively tied at 6.7 vs 6.7. Grok Build 0.1 (medium) has the lower benchmark cost at $1.419 vs $3.264. Grok Build 0.1 (medium) is faster at 55.13s vs 97.34s, with pass rates of 59.4% vs 58.0%.

Last updated at: 2026-11-13

Compared models

Rank
#254
Total Output Tokens
186,901
Response Time (avg)
97.34s
Total Cost
$3.264
Rank
#248
Total Output Tokens
529,806
Response Time (avg)
55.13s
Total Cost
$1.419
Recommended model Grok Build 0.1 (medium)

It has the best score here (6.7), while costing about 2.3x less than Ember-1 (max).

Detailed comparison

Metric Ember-1 Ember-1 max Release: 2026-09-28 Grok Build 0.1 Grok Build 0.1 medium Release: 2026-05-21
Score 6.7 6.7
Rank #254 #248
Reliability 8.3 10.0
Consistency 7.8 9.6
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 59.4% 58.0%
Flaky tests 6 1
Total Runs 69 69
Cost per result 29.671 10.910
Total Cost $3.264 $1.419
Input Price $3.000 / 1M $1.000 / 1M
Output Price $15.000 / 1M $2.000 / 1M
Cache Read Price $0.300 / 1M $0.200 / 1M
Cache Write Price N/A N/A
Total Input Tokens 153,399 358,616
Output Tokens 7,803 9,651
Reasoning Tokens 179,098 520,155
Response Time (avg) 97.34s 55.13s
Response Time (max) 587.08s 252.69s
Response Time (total) 2238.73s 1268.10s
Parameters ~2.8T total (~104B active) ~300B total (~30B active)
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#254 Ember-1

max
Cost
$0.163
Time
229.4s
Tokens
11,002 tok

#248 SpaceXAI: Grok Build 0.1

medium
Cost
$0.028
Time
81.3s
Tokens
14,009 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Ember-1 5.2 4.4 55.6% 2 105.09s 3,362 1,149 27,957
Grok Build 0.1 5.7 9.7 33.3% 0 108.46s 8,304 1,138 161,452

Switch Comparison Pair