LFM3-1.7B (default) vs MiniMax M2.5 (medium)

Compared models

Rank: #430
Total Output Tokens: 329,997
Response Time (avg): 16.99s
Total Cost: $0.084

Rank: #425
Total Output Tokens: 284,991
Response Time (avg): 102.32s
Total Cost: $0.440

Recommended model LFM3-1.7B (default)

Its score stays close to the best score here (4.1 vs 4.3), while costing about 5.3x less than MiniMax M2.5 (medium).

Detailed comparison

Metric	LFM3-1.7B LFM3-1.7B default Release: 2026-11-06 Free Available	MiniMax M2.5 MiniMax M2.5 medium Release: 2026-02-12

Metric	LFM3-1.7B LFM3-1.7B default Release: 2026-11-06 Free Available	MiniMax M2.5 MiniMax M2.5 medium Release: 2026-02-12
Score	4.1	4.3
Rank	#430	#425
Reliability	10.0	9.3
Consistency	8.2	6.8
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	34.8%	42.0%
Flaky tests	5	9
Total Runs	69	69
Cost per result	1.672	7.104
Total Cost	$0.084	$0.440
Input Price	$0.080 / 1M	$0.270 / 1M
Output Price	$0.200 / 1M	$1.080 / 1M
Cache Read Price	$0.020 / 1M	$0.027 / 1M
Cache Write Price	N/A	N/A
Total Input Tokens	219,830	188,239
Output Tokens	5,711	27,822
Reasoning Tokens	324,286	262,674
Response Time (avg)	16.99s	102.32s
Response Time (max)	56.52s	600.81s
Response Time (total)	390.77s	1637.05s
Parameters	1.7B	230B total (10B active)
Availability	Weights available	Weights available

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#430 LiquidAI: LFM3-1.7B

default

OpenRouter returned no showcase content (finish_reason: length).

Cost: $0.002
Time: 23.3s
Tokens: 8,320 tok

#425 MiniMax M2.5

medium

Reached the allocated time limit (300 seconds) without receiving showcase output.

Cost: $0.000
Time: 300.0s
Tokens: 0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
LFM3-1.7B	3.4	9.6	0.0%	0		56.52s	149,079	749	32,217
MiniMax M2.5	3.0	10.0	0.0%	0		600.81s	45,618	7,413	10,854

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
LFM3-1.7B	7.0	7.9	66.7%	1		5.98s	672	2,226	16,677
MiniMax M2.5	7.9	6.3	83.3%	2		20.82s	612	286	45,344

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
LFM3-1.7B	2.9	10.0	0.0%	0		26.48s	7,461	0	73,728
MiniMax M2.5	3.4	9.1	0.0%	0		188.58s	6,076	357	106,177

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
LFM3-1.7B	6.5	10.0	50.0%	0		41.31s	40,494	579	73,968
MiniMax M2.5	3.7	1.8	50.0%	2		83.19s	119,959	16,687	18,834

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
LFM3-1.7B	2.9	5.8	16.7%	1		8.32s	7,332	227	14,678
MiniMax M2.5	4.6	1.7	66.7%	2		7.48s	6,584	266	3,835

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
LFM3-1.7B	5.9	7.2	55.6%	1		12.39s	780	20	33,410
MiniMax M2.5	2.9	7.2	11.1%	1		158.88s	368	14	45,372

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
LFM3-1.7B	4.2	9.9	0.0%	0		7.07s	516	221	6,343
MiniMax M2.5	3.8	2.5	33.3%	1		6.63s	492	25	1,686

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
LFM3-1.7B	6.3	10.0	50.0%	0		6.64s	699	66	10,603
MiniMax M2.5	7.5	10.0	50.0%	0		621ms	699	156	1,495

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
LFM3-1.7B	4.2	4.4	44.5%	2		5.33s	717	1,102	13,671
MiniMax M2.5	5.3	7.2	44.4%	1		11.21s	495	1,069	9,605

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
LFM3-1.7B	3.0	10.0	0.0%	0		36.00s	11,879	514	27,467
MiniMax M2.5	10.0	10.0	100.0%	0		15.35s	7,123	269	937

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
LFM3-1.7B	3.0	10.0	0.0%	0		22.16s	201	7	21,524
MiniMax M2.5	3.0	10.0	0.0%	0		80.79s	213	1,280	18,535

Switch Comparison Pair

LFM3-1.7BdefaultFree AvailablevsQwen3.5-9Bmedium Mercury 2.5nonevsLFM3-1.7BdefaultFree Available Mercury 2nonevsMiniMax M2.5medium LFM3-1.7BdefaultFree Availablevsgpt-oss-120bnone MiniMax M2.5mediumvsgpt-oss-120bnone Granite 4.2 8BnonevsMiniMax M2.5medium Trinity Large PreviewdefaultFree AvailablevsMiniMax M2.5medium LFM3-1.7BdefaultFree AvailablevsGLM 4.7 Flashmedium KAT Coder AIR V2.5defaultvsMiniMax M2.5medium Mercury 2.5nonevsMiniMax M2.5medium MiniMax M2.5mediumvsNemotron 3 SupernoneFree Available Ring 2.6 1tdefaultvsMiniMax M2.5medium