Ember-1 (low) vs MiMo-V2.5 (medium)

Compared models

Rank: #157
Total Output Tokens: 56,766
Response Time (avg): 34.90s
Total Cost: $1.488

Rank: #152
Total Output Tokens: 341,511
Response Time (avg): 49.20s
Total Cost: $0.419

Recommended model MiMo-V2.5 (medium)

It has the best score here (7.1), while costing about 3.6x less than Ember-1 (low).

Detailed comparison

Metric	Ember-1 Ember-1 low Release: 2026-09-28	MiMo-V2.5 MiMo-V2.5 medium Release: 2026-04-22

Metric	Ember-1 Ember-1 low Release: 2026-09-28	MiMo-V2.5 MiMo-V2.5 medium Release: 2026-04-22
Score	7.0	7.1
Rank	#157	#152
Reliability	8.8	10.0
Consistency	8.2	7.6
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	65.2%	69.6%
Flaky tests	5	7
Total Runs	69	69
Cost per result	11.441	3.491
Total Cost	$1.488	$0.419
Input Price	$3.000 / 1M	$0.140 / 1M
Output Price	$15.000 / 1M	$0.280 / 1M
Total Input Tokens	211,908	259,664
Output Tokens	14,158	8,414
Reasoning Tokens	42,608	333,097
Response Time (avg)	34.90s	49.20s
Response Time (max)	121.29s	316.27s
Response Time (total)	802.79s	1131.69s
Parameters	~2.8T total (~104B active)	310B total (15B active)
Availability	Closed	Open source

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#157 Ember-1

low

Cost: $0.016
Time: 24.2s
Tokens: 1,165 tok

#152 MiMo-V2.5

medium

Cost: $0.002
Time: 54.8s
Tokens: 5,247 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	4.7	3.1	33.3%	1		121.29s	178,897	9,378	9,921
MiMo-V2.5	10.0	10.0	100.0%	0		113.57s	154,208	1,306	13,157

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	8.2	7.9	83.3%	1		22.18s	1,402	571	613
MiMo-V2.5	10.0	10.0	100.0%	0		4.14s	621	281	1,739

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	10.0	10.0	100.0%	0		37.91s	8,097	2,518	13,142
MiMo-V2.5	6.2	4.7	66.7%	2		97.14s	7,422	557	81,977

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	6.5	10.0	50.0%	0		51.45s	12,828	381	689
MiMo-V2.5	8.7	6.9	83.3%	1		77.97s	78,669	4,656	39,393

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	7.3	5.9	83.3%	1		34.82s	6,076	223	778
MiMo-V2.5	2.7	5.7	16.7%	1		6.33s	7,746	306	5,714

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	2.9	7.2	11.1%	1		56.17s	1,154	234	12,476
MiMo-V2.5	3.6	7.2	22.2%	1		137.75s	744	495	138,736

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	10.0	10.0	100.0%	0		5.67s	744	139	462
MiMo-V2.5	5.4	2.5	66.7%	1		5.37s	492	121	418

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	6.2	5.8	66.7%	1		32.73s	781	121	466
MiMo-V2.5	9.9	10.0	100.0%	0		1.80s	672	88	801

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	10.0	10.0	100.0%	0		3.27s	1,452	393	595
MiMo-V2.5	8.2	7.2	88.9%	1		20.25s	660	279	33,254

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	3.0	10.0	0.0%	0		26.43s	0	0	0
MiMo-V2.5	10.0	10.0	100.0%	0		7.29s	8,220	303	2,424

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Ember-1	3.0	10.0	0.0%	0		30.60s	477	200	3,466
MiMo-V2.5	3.0	10.0	0.0%	0		51.29s	210	22	15,484

Quick Compare

Switch Comparison Pair

Ember-1lowvsKimi K2.7 Codemedium Ember-1lowvsGemini 3.1 Flash Lite Previewmedium Ember-1lowvsQwen3.5-122B-A10Bmedium GPT-5.2 ChatnonevsMiMo-V2.5medium Ember-1lowvsGPT-5.2 Chatnone Claude Opus 5nonevsMiMo-V2.5medium Ember-1lowvsGLM 5.3 FlashXmedium Ember-1lowvsGemini 3.1 Flash Litemedium Grok 4.6lowvsMiMo-V2.5medium Gemini 3 Flash PreviewlowvsMiMo-V2.5medium Step 3.7 FlashlowvsMiMo-V2.5medium Muse Glimmer 30BlowvsMiMo-V2.5medium