Granite 4.1 8b (default) vs Qwen3.5-9B (medium)

Compared models

Rank: #414
Total Output Tokens: 5,996
Response Time (avg): 1.38s
Total Cost: $0.007

Rank: #408
Total Output Tokens: 447,247
Response Time (avg): 110.18s
Total Cost: $0.106

Recommended model Granite 4.1 8b (default)

Its score stays close to the best score here (3.8 vs 4.0), while costing about 16.8x less than Qwen3.5-9B (medium).

Detailed comparison

Metric	Granite 4.1 8b Granite 4.1 8b default Release: 2026-05-01	Qwen3.5-9B Qwen3.5-9B medium Release: 2026-03-02

Metric	Granite 4.1 8b Granite 4.1 8b default Release: 2026-05-01	Qwen3.5-9B Qwen3.5-9B medium Release: 2026-03-02
Score	3.8	4.0
Rank	#414	#408
Reliability	10.0	8.7
Consistency	10.0	7.9
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	8.7%	26.1%
Flaky tests	0	6
Total Runs	69	69
Cost per result	0.315	3.523
Total Cost	$0.007	$0.106
Input Price	$0.050 / 1M	$0.100 / 1M
Output Price	$0.100 / 1M	$0.150 / 1M
Cache Read Price	N/A	N/A
Cache Write Price	N/A	N/A
Total Input Tokens	113,836	387,323
Output Tokens	5,996	48,562
Reasoning Tokens	0	410,431
Response Time (avg)	1.38s	110.18s
Response Time (max)	16.67s	569.97s
Response Time (total)	31.81s	1873.00s
Parameters	8B	9B
Availability	Open source	Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#414 Granite 4.1 8b

default

Cost: $0.001
Time: 3.2s
Tokens: 491 tok

#408 Qwen3.5-9B

medium

Cost: $0.001
Time: 35.9s
Tokens: 3,030 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8b	3.0	10.0	0.0%	0		60ms	0	0	0
Qwen3.5-9B	5.2	3.2	33.3%	1		152.85s	370,128	1,827	43,724

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8b	4.9	10.0	25.0%	0		844ms	645	903	0
Qwen3.5-9B	5.1	5.8	50.0%	2		34.44s	369	2,621	12,411

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8b	4.5	10.0	0.0%	0		775ms	8,344	525	0
Qwen3.5-9B	2.9	10.0	0.0%	0		100.88s	2,396	7,890	41,129

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8b	3.0	10.0	0.0%	0		9.28s	86,631	3,481	0
Qwen3.5-9B	3.0	10.0	0.0%	0		0ms	0	0	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8b	3.0	10.0	0.0%	0		575ms	7,617	195	0
Qwen3.5-9B	3.6	5.6	33.3%	1		87.31s	4,722	1,383	32,113

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8b	3.0	10.0	0.0%	0		287ms	777	24	0
Qwen3.5-9B	3.6	7.2	22.2%	1		272.50s	420	29,239	205,666

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8b	4.0	10.0	0.0%	0		499ms	528	115	0
Qwen3.5-9B	2.8	1.6	33.3%	1		226.38s	180	0	30,695

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8b	3.6	9.9	0.0%	0		344ms	687	66	0
Qwen3.5-9B	6.5	10.0	50.0%	0		5.75s	381	491	1,824

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8b	3.2	10.0	0.0%	0		608ms	672	432	0
Qwen3.5-9B	3.0	10.0	0.0%	0		32.27s	376	1,593	12,026

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8b	10.0	10.0	100.0%	0		2.17s	7,719	243	0
Qwen3.5-9B	10.0	10.0	100.0%	0		4.31s	8,283	444	1,149

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8b	3.0	10.0	0.0%	0		306ms	216	12	0
Qwen3.5-9B	3.0	10.0	0.0%	0		177.02s	68	3,074	29,694

Switch Comparison Pair

Granite 4.1 8bdefaultvsNemotron 3.5 LightningnoneFree Available Mercury 2.5nonevsQwen3.5-9Bmedium Granite 4.1 8bdefaultvsXing4.0 29b A4bmediumFree Available Granite 4.1 8bdefaultvsLing 3.0 Tinyhigh gpt-oss-120bnonevsQwen3.5-9Bmedium Granite 4.1 8bdefaultvsLing 3.0 Tinylow Granite 4.1 8bdefaultvsLing 3.0 Tinymedium Ling 3.0 TinydefaultvsQwen3.5-9Bmedium Nemotron 3.5 LightningnoneFree AvailablevsQwen3.5-9Bmedium Granite 4.1 8bdefaultvsMercury 2.5none Mercury 2nonevsQwen3.5-9Bmedium Ling 3.0 TinyhighvsQwen3.5-9Bmedium