Kev 4B vs MiniMax M2.5 (medium)

Compared models

Recommended model MiniMax M2.5 (medium)

It has the strongest score in this comparison (4.3) and the best overall balance of cost and response time across all 2 models.

Metric	Kev 4B Kev 4B none Release: 2026-09-28	MiniMax M2.5 MiniMax M2.5 medium Release: 2026-02-12

Metric	Kev 4B Kev 4B none Release: 2026-09-28	MiniMax M2.5 MiniMax M2.5 medium Release: 2026-02-12
Score	2.4	4.3
Rank	#376	#340
Reliability	10.0	9.3
Consistency	4.9	6.8
Attempts	36/69	69/69
Tests Correct
Attempt pass rate	15.9%	42.0%
Flaky tests	1	9
Total Runs	36	69
Cost per result	0.060	7.104
Total Cost	$0.002	$0.440
Input Price	$0.042 / 1M	$0.270 / 1M
Output Price	$0.000 / 1M	$1.080 / 1M
Cache Read Price	N/A	$0.027 / 1M
Cache Write Price	N/A	N/A
Total Input Tokens	42,804	188,239
Output Tokens	28,061	27,822
Reasoning Tokens	0	262,674
Response Time (avg)	5.63s	102.32s
Response Time (max)	17.79s	600.81s
Response Time (total)	67.61s	1637.05s
Parameters	4B	230B total (10B active)
Availability	Open source	Weights available

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

none

No showcase result has been generated for this model yet.

medium

Reached the allocated time limit (300 seconds) without receiving showcase output.

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Kev 4B	0.0	0.0	0.0%	0		0ms	0	0	0
MiniMax M2.5	3.0	10.0	0.0%	0		600.81s	45,618	7,413	10,854

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Kev 4B	2.3	7.5	0.0%	0		3.65s	5,364	7,514	0
MiniMax M2.5	7.9	6.3	83.3%	2		20.82s	612	286	45,344

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Kev 4B	4.5	6.7	33.3%	0		771ms	21,603	12,207	0
MiniMax M2.5	3.4	9.1	0.0%	0		188.58s	6,076	357	106,177

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Kev 4B	0.0	0.0	0.0%	0		0ms	0	0	0
MiniMax M2.5	3.7	1.8	50.0%	2		83.19s	119,959	16,687	18,834

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Kev 4B	6.5	10.0	50.0%	0		9.09s	11,010	3,573	0
MiniMax M2.5	4.6	1.7	66.7%	2		7.48s	6,584	266	3,835

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Kev 4B	5.3	10.0	33.3%	0		6.34s	2,178	1,905	0
MiniMax M2.5	2.9	7.2	11.1%	1		158.88s	368	14	45,372

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Kev 4B	0.0	0.0	0.0%	0		0ms	0	0	0
MiniMax M2.5	3.8	2.5	33.3%	1		6.63s	492	25	1,686

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Kev 4B	1.5	5.0	0.0%	0		17.27s	2,316	2,688	0
MiniMax M2.5	7.5	10.0	50.0%	0		621ms	699	156	1,495

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Kev 4B	2.0	1.0	22.2%	1		646ms	333	174	0
MiniMax M2.5	5.3	7.2	44.4%	1		11.21s	495	1,069	9,605

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Kev 4B	0.0	0.0	0.0%	0		0ms	0	0	0
MiniMax M2.5	10.0	10.0	100.0%	0		15.35s	7,123	269	937

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Kev 4B	0.0	0.0	0.0%	0		0ms	0	0	0
MiniMax M2.5	3.0	10.0	0.0%	0		80.79s	213	1,280	18,535

Switch Comparison Pair