Granite 4.1 8B vs MiniMax M2.5 (medium)

Compared models

Recommended model Granite 4.1 8B

Its score stays close to the best score here (4.0 vs 4.6), while costing about 51.9x less than MiniMax M2.5 (medium).

Metric	Granite 4.1 8B Granite 4.1 8B none Release: 2026-05-01	MiniMax M2.5 MiniMax M2.5 medium Release: 2026-02-12

Metric	Granite 4.1 8B Granite 4.1 8B none Release: 2026-05-01	MiniMax M2.5 MiniMax M2.5 medium Release: 2026-02-12
Score	4.0	4.6
Rank	#315	#301
Reliability	10.0	10.0
Consistency	10.0	6.6
Attempts	66/66	66/66
Tests Correct
Attempt pass rate	9.1%	43.9%
Flaky tests	0	9
Total Runs	66	66
Cost per result	0.315	6.463
Total Cost	$0.007	$0.327
Input Price	$0.050 / 1M	$0.270 / 1M
Output Price	$0.100 / 1M	$1.080 / 1M
Total Input Tokens	113,836	142,621
Output Tokens	5,996	20,409
Reasoning Tokens	0	251,820
Response Time (avg)	1.44s	69.08s
Response Time (max)	16.67s	251.36s
Response Time (total)	31.75s	1036.24s
Parameters	8B	230B total (10B active)
Availability	Open source	Weights available

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

none

medium

Reached the allocated time limit (300 seconds) without receiving showcase output.

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8B	4.9	10.0	25.0%	0		844ms	645	903	0
MiniMax M2.5	7.9	6.3	83.3%	2		20.82s	612	286	45,344

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8B	4.5	10.0	0.0%	0		775ms	8,344	525	0
MiniMax M2.5	3.4	9.1	0.0%	0		188.58s	6,076	357	106,177

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8B	3.0	10.0	0.0%	0		9.28s	86,631	3,481	0
MiniMax M2.5	3.7	1.8	50.0%	2		83.19s	119,959	16,687	18,834

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8B	3.0	10.0	0.0%	0		575ms	7,617	195	0
MiniMax M2.5	4.6	1.7	66.7%	2		7.48s	6,584	266	3,835

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8B	3.0	10.0	0.0%	0		287ms	777	24	0
MiniMax M2.5	2.9	7.2	11.1%	1		158.88s	368	14	45,372

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8B	4.0	10.0	0.0%	0		499ms	528	115	0
MiniMax M2.5	3.8	2.5	33.3%	1		6.63s	492	25	1,686

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8B	3.6	9.9	0.0%	0		344ms	687	66	0
MiniMax M2.5	7.5	10.0	50.0%	0		621ms	699	156	1,495

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8B	3.2	10.0	0.0%	0		608ms	672	432	0
MiniMax M2.5	5.3	7.2	44.4%	1		11.21s	495	1,069	9,605

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8B	10.0	10.0	100.0%	0		2.17s	7,719	243	0
MiniMax M2.5	10.0	10.0	100.0%	0		15.35s	7,123	269	937

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8B	3.0	10.0	0.0%	0		306ms	216	12	0
MiniMax M2.5	3.0	10.0	0.0%	0		80.79s	213	1,280	18,535

Switch Comparison Pair