Ember-1 (low) vs Grok 4.7 (high)

Compared models

Rank: #120
Total Output Tokens: 37,467
Response Time (avg): 30.98s
Total Cost: $0.662

Rank: #119
Total Output Tokens: 416,086
Response Time (avg): 113.10s
Total Cost: $2.180

Recommended model Ember-1 (low)

It has the best score here (7.5), while costing about 3.3x less than Grok 4.7 (high).

Detailed comparison

Metric	Ember-1 Ember-1 low Release: 2026-09-28	Grok 4.7 Grok 4.7 high Release: 2026-09-21

Metric	Ember-1 Ember-1 low Release: 2026-09-28	Grok 4.7 Grok 4.7 high Release: 2026-09-21
Score	7.5	7.5
Rank	#120	#119
Reliability	8.1	9.5
Consistency	8.5	7.6
Attempts	66/66	66/66
Tests Correct
Attempt pass rate	66.7%	75.8%
Flaky tests	4	7
Total Runs	66	66
Cost per result	5.085	16.765
Total Cost	$0.662	$2.180
Input Price	$3.000 / 1M	$1.600 / 1M
Output Price	$15.000 / 1M	$4.800 / 1M
Total Input Tokens	33,011	113,892
Output Tokens	4,780	6,907
Reasoning Tokens	32,687	409,179
Response Time (avg)	30.98s	113.10s
Response Time (max)	93.10s	573.57s
Response Time (total)	681.50s	2488.20s
Parameters	~2.8T total (~104B active)	~1.7T total (~170B active)
Availability	Closed	Closed

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#120 Ember-1

low

Cost: $0.016
Time: 24.2s
Tokens: 1,165 tok

#119 SpaceXAI: Grok 4.7

high

Cost: $0.110
Time: 301.3s
Tokens: 23,143 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	8.2	7.9	83.3%	1		22.18s	1,402	571	613
Grok 4.7	8.7	7.9	91.7%	1		27.98s	2,743	111	14,914

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	10.0	10.0	100.0%	0		37.91s	8,097	2,518	13,142
Grok 4.7	6.0	4.6	66.7%	2		335.92s	10,266	353	199,976

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	6.5	10.0	50.0%	0		51.45s	12,828	381	689
Grok 4.7	8.6	6.9	83.3%	1		129.30s	75,277	5,730	60,640

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	7.3	5.9	83.3%	1		34.82s	6,076	223	778
Grok 4.7	10.0	10.0	100.0%	0		8.65s	8,937	225	4,043

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	2.9	7.2	11.1%	1		56.17s	1,154	234	12,476
Grok 4.7	5.3	7.2	44.4%	1		306.71s	1,980	10	98,585

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	10.0	10.0	100.0%	0		5.67s	744	139	462
Grok 4.7	4.1	2.7	33.3%	1		17.06s	1,077	52	3,238

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	6.2	5.8	66.7%	1		32.73s	781	121	466
Grok 4.7	8.4	6.9	83.3%	1		14.15s	1,857	57	6,421

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	10.0	10.0	100.0%	0		3.27s	1,452	393	595
Grok 4.7	10.0	10.0	100.0%	0		19.88s	2,430	178	10,706

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	3.0	10.0	0.0%	0		26.43s	0	0	0
Grok 4.7	10.0	10.0	100.0%	0		5.08s	8,536	177	568

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	3.0	10.0	0.0%	0		30.60s	477	200	3,466
Grok 4.7	3.0	10.0	0.0%	0		62.44s	789	14	10,088

Quick Compare

Switch Comparison Pair

Ember-1lowvsMiniMax M3medium MiniMax M3mediumvsGrok 4.7high GPT-5.6 TerralowvsGrok 4.7high Ember-1lowvsGPT 5.3 Chatnone GPT 5.3 ChatnonevsGrok 4.7high Ember-1lowvsQwen3.5 Plus 2026-02-15medium Qwen3.5 Plus 2026-02-15mediumvsGrok 4.7high Ember-1lowvsQwen3.5-27Bmedium Qwen3.5-27BmediumvsGrok 4.7high Ember-1lowvsMercury 2.5 Previewmedium Mercury 2.5 PreviewmediumvsGrok 4.7high Ember-1lowvsGPT-5.4 Minimedium