Ember-1 (low) vs Grok 4.7 (xhigh)

Compared models

Recommended model Ember-1 (low)

Its score stays close to the best score here (7.5 vs 7.5), while costing about 4.0x less than Grok 4.7 (xhigh).

Metric	Ember-1 Ember-1 low Release: 2026-09-28	Grok 4.7 Grok 4.7 xhigh Release: 2026-09-21

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

low

xhigh

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	8.2	7.9	83.3%	1		22.18s	1,402	571	613
Grok 4.7	8.7	7.9	91.7%	1		35.37s	2,754	108	21,953

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	10.0	10.0	100.0%	0		37.91s	8,097	2,518	13,142
Grok 4.7	5.3	4.5	55.6%	2		414.53s	10,168	327	256,935

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	6.5	10.0	50.0%	0		51.45s	12,828	381	689
Grok 4.7	10.0	10.0	100.0%	0		170.10s	85,391	3,689	90,375

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	7.3	5.9	83.3%	1		34.82s	6,076	223	778
Grok 4.7	10.0	10.0	100.0%	0		7.50s	8,943	225	3,639

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	2.9	7.2	11.1%	1		56.17s	1,154	234	12,476
Grok 4.7	3.5	4.4	33.3%	2		190.55s	2,922	11	85,304

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	10.0	10.0	100.0%	0		5.67s	744	139	462
Grok 4.7	4.7	1.6	66.7%	1		26.32s	1,080	86	4,949

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	6.2	5.8	66.7%	1		32.73s	781	121	466
Grok 4.7	9.8	10.0	100.0%	0		17.31s	1,863	57	7,728

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	10.0	10.0	100.0%	0		3.27s	1,452	393	595
Grok 4.7	10.0	10.0	100.0%	0		20.50s	2,439	169	10,900

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	3.0	10.0	0.0%	0		26.43s	0	0	0
Grok 4.7	10.0	10.0	100.0%	0		5.36s	8,544	206	568

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	3.0	10.0	0.0%	0		30.60s	477	200	3,466
Grok 4.7	3.0	10.0	0.0%	0		106.61s	792	12	17,828

Switch Comparison Pair