Trinity Large Thinking (low) vs Granite 4.2 8B (medium)

Compared models

Recommended model Granite 4.2 8B (medium)

Its score stays close to the best score here (6.1 vs 6.3), while costing about 24.9x less than Trinity Large Thinking (low).

Metric	Trinity Large Thinking Trinity Large Thinking low Release: 2026-07-28	Granite 4.2 8B Granite 4.2 8B medium Release: 2026-09-02

Metric	Trinity Large Thinking Trinity Large Thinking low Release: 2026-07-28	Granite 4.2 8B Granite 4.2 8B medium Release: 2026-09-02
Score	6.3	6.1
Rank	#222	#235
Reliability	10.0	8.9
Consistency	8.1	9.7
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	47.8%	37.7%
Flaky tests	6	1
Total Runs	69	69
Cost per result	9.163	0.354
Total Cost	$0.700	$0.029
Input Price	$0.250 / 1M	$0.060 / 1M
Output Price	$0.800 / 1M	$0.250 / 1M
Total Input Tokens	347,980	259,708
Output Tokens	121,898	16,567
Reasoning Tokens	720,302	33,580
Response Time (avg)	95.16s	50.47s
Response Time (max)	540.96s	557.96s
Response Time (total)	2188.74s	1160.91s
Parameters	398B total (13B active)	8B
Availability	Weights available	Open source

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

low

medium

Provider returned error

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Trinity Large Thinking	7.4	3.8	66.7%	1		63.23s	225,126	2,088	21,753
Granite 4.2 8B	10.0	10.0	100.0%	0		149.50s	206,799	9,509	21,308

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Trinity Large Thinking	8.3	10.0	75.0%	0		5.70s	663	1,451	5,431
Granite 4.2 8B	8.4	10.0	75.0%	0		10.34s	777	1,452	889

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Trinity Large Thinking	5.3	10.0	33.3%	0		344.45s	5,441	27,039	217,241
Granite 4.2 8B	5.5	10.0	33.3%	0		12.09s	8,439	2,445	3,900

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Trinity Large Thinking	5.2	6.0	33.3%	1		291.02s	99,467	9,848	234,039
Granite 4.2 8B	3.0	10.0	0.0%	0		291.12s	24,807	1,902	6,258

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Trinity Large Thinking	7.3	5.8	83.3%	1		14.30s	6,906	459	9,451
Granite 4.2 8B	6.5	10.0	50.0%	0		1.43s	7,683	270	75

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Trinity Large Thinking	2.9	7.2	11.1%	1		140.26s	756	72,049	217,598
Granite 4.2 8B	5.3	10.0	33.3%	0		13.96s	876	154	290

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Trinity Large Thinking	10.0	10.0	100.0%	0		12.65s	501	5,138	5,695
Granite 4.2 8B	4.0	10.0	0.0%	0		605ms	561	102	24

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Trinity Large Thinking	4.4	6.8	16.7%	1		4.07s	684	45	3,710
Granite 4.2 8B	3.8	6.0	33.3%	1		36.86s	636	127	425

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Trinity Large Thinking	6.3	7.9	44.4%	1		3.28s	678	2,625	3,077
Granite 4.2 8B	3.1	10.0	0.0%	0		75.99s	469	206	56

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Trinity Large Thinking	10.0	10.0	100.0%	0		5.19s	7,551	299	1,430
Granite 4.2 8B	10.0	10.0	100.0%	0		2.28s	8,412	359	214

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Trinity Large Thinking	3.0	10.0	0.0%	0		2.10s	207	857	877
Granite 4.2 8B	3.0	10.0	0.0%	0		2.24s	249	41	141

Switch Comparison Pair