Granite 4.2 8B vs LFM3-1.7B (default)

Compared models

Rank: #421
Total Output Tokens: 133,268
Response Time (avg): 84.66s
Total Cost: $0.037

Rank: #430
Total Output Tokens: 329,997
Response Time (avg): 16.99s
Total Cost: $0.084

Recommended model Granite 4.2 8B

It has the best score here (4.4), while costing about 2.3x less than LFM3-1.7B (default).

Detailed comparison

Metric	Granite 4.2 8B Granite 4.2 8B none Release: 2026-09-02	LFM3-1.7B LFM3-1.7B default Release: 2026-11-06 Free Available

Metric	Granite 4.2 8B Granite 4.2 8B none Release: 2026-09-02	LFM3-1.7B LFM3-1.7B default Release: 2026-11-06 Free Available
Score	4.4	4.1
Rank	#421	#430
Reliability	9.1	10.0
Consistency	9.3	8.2
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	15.9%	34.8%
Flaky tests	2	5
Total Runs	69	69
Cost per result	1.206	1.672
Total Cost	$0.037	$0.084
Input Price	$0.060 / 1M	$0.080 / 1M
Output Price	$0.250 / 1M	$0.200 / 1M
Cache Read Price	$0.015 / 1M	$0.020 / 1M
Cache Write Price	N/A	N/A
Total Input Tokens	226,872	219,830
Output Tokens	133,268	5,711
Reasoning Tokens	0	324,286
Response Time (avg)	84.66s	16.99s
Response Time (max)	747.17s	56.52s
Response Time (total)	1947.17s	390.77s
Parameters	8B	1.7B
Availability	Open source	Weights available

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#421 IBM: Granite 4.2 8B

none

Provider returned error

Cost: $0.000
Time: 0.2s
Tokens: 0 tok

#430 LiquidAI: LFM3-1.7B

default

OpenRouter returned no showcase content (finish_reason: length).

Cost: $0.002
Time: 23.3s
Tokens: 8,320 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	5.0	10.0	0.0%	0		49.21s	169,086	2,463	0
LFM3-1.7B	3.4	9.6	0.0%	0		56.52s	149,079	749	32,217

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	4.9	8.1	33.3%	1		17.77s	669	6,026	0
LFM3-1.7B	7.0	7.9	66.7%	1		5.98s	672	2,226	16,677

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	5.5	10.0	33.3%	0		105.60s	8,358	47,944	0
LFM3-1.7B	2.9	10.0	0.0%	0		26.48s	7,461	0	73,728

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	3.0	10.0	0.0%	0		424.28s	30,500	29,755	0
LFM3-1.7B	6.5	10.0	50.0%	0		41.31s	40,494	579	73,968

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	2.9	5.8	16.7%	1		1.05s	7,629	237	0
LFM3-1.7B	2.9	5.8	16.7%	1		8.32s	7,332	227	14,678

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	3.0	10.0	0.0%	0		53.62s	696	38,145	0
LFM3-1.7B	5.9	7.2	55.6%	1		12.39s	780	20	33,410

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	5.0	10.0	0.0%	0		770ms	534	153	0
LFM3-1.7B	4.2	9.9	0.0%	0		7.07s	516	221	6,343

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	3.0	10.0	0.0%	0		79.50s	375	1,275	0
LFM3-1.7B	6.3	10.0	50.0%	0		6.64s	699	66	10,603

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	3.0	10.0	0.0%	0		107.60s	472	6,964	0
LFM3-1.7B	4.2	4.4	44.5%	2		5.33s	717	1,102	13,671

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	10.0	10.0	100.0%	0		1.39s	8,331	291	0
LFM3-1.7B	3.0	10.0	0.0%	0		36.00s	11,879	514	27,467

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	3.0	10.0	0.0%	0		14.60s	222	15	0
LFM3-1.7B	3.0	10.0	0.0%	0		22.16s	201	7	21,524

Switch Comparison Pair

Trinity Large PreviewdefaultFree AvailablevsGranite 4.2 8Bnone Granite 4.2 8BnonevsKAT Coder AIR V2.5default LFM3-1.7BdefaultFree AvailablevsQwen3.5-9Bmedium CobuddymediumFree AvailablevsGranite 4.2 8Bnone Mercury 2.5nonevsLFM3-1.7BdefaultFree Available Granite 4.2 8BnonevsRing 2.6 1tdefault LFM3-1.7BdefaultFree Availablevsgpt-oss-120bnone Granite 4.2 8BnonevsLing 2.6 Flashdefault Granite 4.2 8BnonevsMiniMax M2.5medium LFM3-1.7BdefaultFree AvailablevsGLM 4.7 Flashmedium Granite 4.2 8BnonevsNemotron 3.5 LightninglowFree Available Granite 4.2 8BnonevsLaguna S 2.1lowFree Available