Ember-1 (low) vs MiniMax M3 (medium)

Compared models

Recommended model MiniMax M3 (medium)

It has the best score here (7.5), while costing about 2.2x less than Ember-1 (low).

Metric	Ember-1 Ember-1 low Release: 2026-09-28	MiniMax M3 MiniMax M3 medium Release: 2026-06-01

Metric	Ember-1 Ember-1 low Release: 2026-09-28	MiniMax M3 MiniMax M3 medium Release: 2026-06-01
Score	7.5	7.5
Rank	#120	#121
Reliability	8.1	9.7
Consistency	8.5	8.0
Attempts	66/66	66/66
Tests Correct
Attempt pass rate	66.7%	62.1%
Flaky tests	4	5
Total Runs	66	66
Cost per result	5.085	2.724
Total Cost	$0.662	$0.300
Input Price	$3.000 / 1M	$0.300 / 1M
Output Price	$15.000 / 1M	$1.200 / 1M
Total Input Tokens	33,011	121,996
Output Tokens	4,780	90,051
Reasoning Tokens	32,687	185,731
Response Time (avg)	30.98s	75.15s
Response Time (max)	93.10s	431.03s
Response Time (total)	681.50s	1578.24s
Parameters	~2.8T total (~104B active)	428B total (23B active)
Availability	Closed	Weights available

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

low

medium

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	8.2	7.9	83.3%	1		22.18s	1,402	571	613
MiniMax M3	5.5	3.7	66.7%	3		14.95s	2,526	874	3,414

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	10.0	10.0	100.0%	0		37.91s	8,097	2,518	13,142
MiniMax M3	6.1	6.5	55.6%	1		144.74s	5,804	6,223	32,667

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	6.5	10.0	50.0%	0		51.45s	12,828	381	689
MiniMax M3	10.0	10.0	100.0%	0		138.24s	90,204	30,186	87,263

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	7.3	5.9	83.3%	1		34.82s	6,076	223	778
MiniMax M3	10.0	10.0	100.0%	0		14.92s	8,088	514	3,164

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	2.9	7.2	11.1%	1		56.17s	1,154	234	12,476
MiniMax M3	3.2	9.3	0.0%	0		234.97s	875	28,389	31,248

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	10.0	10.0	100.0%	0		5.67s	744	139	462
MiniMax M3	5.1	3.4	33.3%	1		33.25s	954	2,487	2,523

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	6.2	5.8	66.7%	1		32.73s	781	121	466
MiniMax M3	9.8	10.0	100.0%	0		6.14s	1,623	103	920

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	10.0	10.0	100.0%	0		3.27s	1,452	393	595
MiniMax M3	7.9	9.9	66.7%	0		49.91s	2,079	11,946	13,761

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	3.0	10.0	0.0%	0		26.43s	0	0	0
MiniMax M3	10.0	10.0	100.0%	0		11.91s	9,168	281	555

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	3.0	10.0	0.0%	0		30.60s	477	200	3,466
MiniMax M3	3.0	10.0	0.0%	0		100.80s	675	9,048	10,216

Switch Comparison Pair