Navigate
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Ember-1 (max) vs Grok 4.7 (xhigh)

The average score is effectively tied at 6.7 vs 6.7. Ember-1 (max) has the lower benchmark cost at $3.264 vs $4.054. Ember-1 (max) is faster at 97.34s vs 123.96s, with pass rates of 59.4% vs 73.9%.

Last updated at: 2026-10-01

Compared models

Rank
#181
Total Output Tokens
186,901
Response Time (avg)
97.34s
Total Cost
$3.264
Rank
#175
Total Output Tokens
572,315
Response Time (avg)
123.96s
Total Cost
$4.054
Recommended model Ember-1 (max)

It has the strongest score in this comparison (6.7) and the best overall balance of cost and response time across all 2 models.

Detailed comparison

Metric Ember-1 Ember-1 max Release: 2026-09-28 Grok 4.7 Grok 4.7 xhigh Release: 2026-09-21
Score 6.7 6.7
Rank #181 #175
Reliability 8.3 9.7
Consistency 7.8 7.8
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 59.4% 73.9%
Flaky tests 6 6
Total Runs 69 69
Cost per result 29.671 24.272
Total Cost $3.264 $4.054
Input Price $3.000 / 1M $2.000 / 1M
Output Price $15.000 / 1M $6.000 / 1M
Total Input Tokens 153,399 310,049
Output Tokens 7,803 6,094
Reasoning Tokens 179,098 566,221
Response Time (avg) 97.34s 123.96s
Response Time (max) 587.08s 775.64s
Response Time (total) 2238.73s 2851.07s
Parameters ~2.8T total (~104B active) ~1.7T total (~170B active)
Availability Closed Closed

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#181 Ember-1

max
Cost
$0.163
Time
229.4s
Tokens
11,002 tok

#175 SpaceXAI: Grok 4.7

xhigh
Cost
$0.235
Time
544.2s
Tokens
39,247 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Ember-1 5.2 4.4 55.6% 2 105.09s 3,362 1,149 27,957
Grok 4.7 5.3 4.5 55.6% 2 414.53s 10,168 327 256,935

Quick Compare

Switch Comparison Pair