Granite 4.2 8B vs Qwen3.5-9B (medium)

Recommended model Granite 4.2 8B

It has the best score here (4.3), while costing about 2.4x less than Qwen3.5-9B (medium).

Detailed comparison

Metric	Granite 4.2 8B Granite 4.2 8B none Release: 2026-09-02	Qwen3.5-9B Qwen3.5-9B medium Release: 2026-03-02

Metric	Granite 4.2 8B Granite 4.2 8B none Release: 2026-09-02	Qwen3.5-9B Qwen3.5-9B medium Release: 2026-03-02
Score	4.3	3.8
Rank	#285	#298
Reliability	8.6	6.0
Consistency	9.3	8.1
Attempts	66/66	66/66
Tests Correct
Attempt pass rate	16.7%	25.8%
Flaky tests	2	5
Total Runs	66	66
Cost per result	0.847	2.061
Total Cost	$0.026	$0.062
Input Price	$0.100 / 1M	$0.100 / 1M
Output Price	$0.150 / 1M	$0.150 / 1M
Total Input Tokens	57,786	17,195
Output Tokens	130,805	46,735
Reasoning Tokens	0	366,707
Response Time (avg)	86.27s	107.51s
Response Time (max)	747.17s	569.97s
Response Time (total)	1897.96s	1720.15s
Parameters	8B	9B
Availability	Open source	Open source

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

none

Provider returned error

medium

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	4.9	8.1	33.3%	1		17.77s	669	6,026	0
Qwen3.5-9B	5.1	5.8	50.0%	2		34.44s	369	2,621	12,411

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	5.5	10.0	33.3%	0		105.60s	8,358	47,944	0
Qwen3.5-9B	2.9	10.0	0.0%	0		100.88s	2,396	7,890	41,129

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	3.0	10.0	0.0%	0		424.28s	30,500	29,755	0
Qwen3.5-9B	3.0	10.0	0.0%	0		0ms	0	0	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	2.9	5.8	16.7%	1		1.05s	7,629	237	0
Qwen3.5-9B	3.6	5.6	33.3%	1		87.31s	4,722	1,383	32,113

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	3.0	10.0	0.0%	0		53.62s	696	38,145	0
Qwen3.5-9B	3.6	7.2	22.2%	1		272.50s	420	29,239	205,666

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	5.0	10.0	0.0%	0		770ms	534	153	0
Qwen3.5-9B	2.8	1.6	33.3%	1		226.38s	180	0	30,695

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	3.0	10.0	0.0%	0		79.50s	375	1,275	0
Qwen3.5-9B	6.5	10.0	50.0%	0		5.75s	381	491	1,824

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	3.0	10.0	0.0%	0		107.60s	472	6,964	0
Qwen3.5-9B	3.0	10.0	0.0%	0		32.27s	376	1,593	12,026

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	10.0	10.0	100.0%	0		1.39s	8,331	291	0
Qwen3.5-9B	10.0	10.0	100.0%	0		4.31s	8,283	444	1,149

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	3.0	10.0	0.0%	0		14.60s	222	15	0
Qwen3.5-9B	3.0	10.0	0.0%	0		177.02s	68	3,074	29,694

Switch Comparison Pair