Ember-1 (high) vs Grok 4.3 (medium)

Compared models

Rank: #158
Total Output Tokens: 110,125
Response Time (avg): 56.77s
Total Cost: $1.798

Rank: #159
Total Output Tokens: 225,904
Response Time (avg): 44.21s
Total Cost: $0.741

Recommended model Grok 4.3 (medium)

It has the best score here (7.0), while costing about 2.4x less than Ember-1 (high).

Detailed comparison

Metric	Ember-1 Ember-1 high Release: 2026-09-28	Grok 4.3 Grok 4.3 medium Release: 2026-05-01

Metric	Ember-1 Ember-1 high Release: 2026-09-28	Grok 4.3 Grok 4.3 medium Release: 2026-05-01
Score	7.1	7.0
Rank	#158	#159
Reliability	8.0	10.0
Consistency	7.3	8.2
Attempts	66/66	66/66
Tests Correct
Attempt pass rate	71.2%	66.7%
Flaky tests	7	5
Total Runs	66	66
Cost per result	14.981	6.168
Total Cost	$1.798	$0.741
Input Price	$3.000 / 1M	$1.250 / 1M
Output Price	$15.000 / 1M	$2.500 / 1M
Total Input Tokens	48,577	140,244
Output Tokens	7,345	13,739
Reasoning Tokens	102,780	212,165
Response Time (avg)	56.77s	44.21s
Response Time (max)	255.06s	216.69s
Response Time (total)	1248.88s	972.64s
Parameters	~2.8T total (~104B active)	~1.5T total (~150B active)
Availability	Closed	Closed

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#158 Ember-1

high

Cost: $0.038
Time: 55.1s
Tokens: 2,671 tok

#159 SpaceXAI: Grok 4.3

medium

Cost: $0.009
Time: 19.0s
Tokens: 3,661 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	8.7	7.9	91.7%	1		24.05s	1,544	886	992
Grok 4.3	10.0	10.0	100.0%	0		8.83s	2,010	88	8,207

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	8.2	7.2	88.9%	1		72.23s	7,144	1,281	23,093
Grok 4.3	5.9	7.7	44.4%	1		41.23s	8,340	1,028	31,226

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	6.4	5.8	66.7%	1		79.89s	28,994	1,667	6,614
Grok 4.3	6.5	10.0	50.0%	0		55.07s	108,468	11,992	21,601

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	7.3	5.9	83.3%	1		36.10s	6,076	230	1,228
Grok 4.3	10.0	10.0	100.0%	0		18.97s	7,761	180	9,546

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	2.9	4.4	22.2%	2		175.49s	1,154	1,023	61,582
Grok 4.3	3.5	4.4	33.3%	2		158.01s	1,977	14	95,783

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	10.0	10.0	100.0%	0		4.49s	744	194	304
Grok 4.3	5.4	2.5	66.7%	1		24.70s	825	70	5,020

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	7.1	5.8	83.3%	1		33.38s	992	162	784
Grok 4.3	9.8	10.0	100.0%	0		18.58s	1,362	57	8,713

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	10.0	10.0	100.0%	0		4.84s	1,452	390	848
Grok 4.3	5.9	7.2	55.6%	1		22.52s	1,689	128	14,468

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	3.0	10.0	0.0%	0		26.45s	0	0	0
Grok 4.3	10.0	10.0	100.0%	0		17.66s	7,263	168	4,615

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	3.0	10.0	0.0%	0		65.34s	477	1,512	7,335
Grok 4.3	3.0	10.0	0.0%	0		44.47s	549	14	12,986

Quick Compare

Switch Comparison Pair

GPT-5.6 SolnonevsGrok 4.3medium GPT-6 LunalowvsGrok 4.3medium Ember-1highvsGPT-5.6 Solnone Ember-1highvsGPT-6 Lunalow Space Bunny AlphahighvsGrok 4.3medium Mercury 2.5highvsGrok 4.3medium DeepSeek V3.2mediumvsEmber-1high GPT-5.5nonevsGrok 4.3medium Ember-1highvsGLM 5.1medium Ember-1highvsGPT-5.5none Ember-1highvsMercury 2medium Solar Pro 4highvsGrok 4.3medium