Ember-1 vs Granite 4.2 8B (low)

Compared models

Recommended model Granite 4.2 8B (low)

Its score stays close to the best score here (5.1 vs 5.2), while costing about 10.7x less than Ember-1.

Metric	Ember-1 Ember-1 none Release: 2026-09-28	Granite 4.2 8B Granite 4.2 8B low Release: 2026-09-02

Metric	Ember-1 Ember-1 none Release: 2026-09-28	Granite 4.2 8B Granite 4.2 8B low Release: 2026-09-02
Score	5.2	5.1
Rank	#297	#302
Reliability	8.1	9.0
Consistency	8.9	10.0
Attempts	66/66	66/66
Tests Correct
Attempt pass rate	42.4%	31.8%
Flaky tests	3	0
Total Runs	66	66
Cost per result	1.528	0.167
Total Cost	$0.123	$0.012
Input Price	$3.000 / 1M	$0.060 / 1M
Output Price	$15.000 / 1M	$0.250 / 1M
Total Input Tokens	27,426	74,721
Output Tokens	2,664	9,205
Reasoning Tokens	0	18,723
Response Time (avg)	19.46s	54.36s
Response Time (max)	93.12s	566.80s
Response Time (total)	428.04s	1195.97s
Parameters	~2.8T total (~104B active)	8B
Availability	Closed	Open source

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

none

low

Provider returned error

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	5.2	7.9	41.7%	1		22.37s	796	867	0
Granite 4.2 8B	8.3	10.0	75.0%	0		11.68s	777	1,463	898

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	5.5	10.0	33.3%	0		1.94s	7,485	393	0
Granite 4.2 8B	5.5	10.0	33.3%	0		13.01s	8,439	2,469	2,984

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	3.0	10.0	0.0%	0		49.01s	12,162	327	0
Granite 4.2 8B	3.0	10.0	0.0%	0		298.21s	46,805	4,085	13,637

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	6.4	5.9	66.7%	1		35.25s	4,017	161	0
Granite 4.2 8B	6.5	10.0	50.0%	0		1.39s	7,683	270	75

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	5.3	10.0	33.3%	0		21.61s	804	68	0
Granite 4.2 8B	5.3	10.0	33.3%	0		26.16s	876	154	290

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	5.0	10.0	0.0%	0		2.28s	540	160	0
Granite 4.2 8B	4.0	10.0	0.0%	0		659ms	561	108	24

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	6.4	5.8	66.7%	1		31.00s	509	81	0
Granite 4.2 8B	3.0	10.0	0.0%	0		75.80s	402	84	378

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	10.0	10.0	100.0%	0		2.54s	840	569	0
Granite 4.2 8B	3.0	10.0	0.0%	0		90.84s	517	181	82

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	3.0	10.0	0.0%	0		26.44s	0	0	0
Granite 4.2 8B	10.0	10.0	100.0%	0		2.23s	8,412	358	265

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	3.0	10.0	0.0%	0		1.05s	273	38	0
Granite 4.2 8B	3.0	10.0	0.0%	0		5.53s	249	33	90

Switch Comparison Pair