Granite 4.2 8B (low) vs Qwen3.8 27B

Compared models

Recommended model Qwen3.8 27B

It has the best score here (5.4), while costing about 3.7x less than Granite 4.2 8B (low).

Metric	Granite 4.2 8B Granite 4.2 8B low Release: 2026-09-02	Qwen3.8 27B Qwen3.8 27B none Release: 2026-08-14 Free Available

Metric	Granite 4.2 8B Granite 4.2 8B low Release: 2026-09-02	Qwen3.8 27B Qwen3.8 27B none Release: 2026-08-14 Free Available
Score	5.3	5.4
Rank	#280	#272
Reliability	9.2	10.0
Consistency	9.7	10.0
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	33.3%	39.1%
Flaky tests	1	0
Total Runs	69	69
Cost per result	0.508	~0.107
Total Cost	$0.036	~$0.010
Input Price	$0.060 / 1M	N/A
Output Price	$0.250 / 1M	N/A
Total Input Tokens	332,917	281,460
Output Tokens	18,989	13,791
Reasoning Tokens	42,362	0
Response Time (avg)	58.20s	5.05s
Response Time (max)	566.80s	47.42s
Response Time (total)	1338.65s	116.11s
Parameters	8B	27.3B
Availability	Open source	Weights available

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

low

Provider returned error

none

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	6.1	3.1	66.7%	1		142.68s	258,196	9,784	23,639
Qwen3.8 27B	5.0	10.0	0.0%	0		47.42s	158,997	2,346	0

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	8.3	10.0	75.0%	0		11.68s	777	1,463	898
Qwen3.8 27B	6.5	10.0	50.0%	0		828ms	696	267	0

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	5.5	10.0	33.3%	0		13.01s	8,439	2,469	2,984
Qwen3.8 27B	5.5	10.0	33.3%	0		1.19s	7,911	408	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	3.0	10.0	0.0%	0		298.21s	46,805	4,085	13,637
Qwen3.8 27B	3.0	10.0	0.0%	0		24.10s	95,181	9,588	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	6.5	10.0	50.0%	0		1.39s	7,683	270	75
Qwen3.8 27B	6.5	10.0	50.0%	0		1.14s	7,788	246	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	5.3	10.0	33.3%	0		26.16s	876	154	290
Qwen3.8 27B	7.7	10.0	66.7%	0		552ms	798	27	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	4.0	10.0	0.0%	0		659ms	561	108	24
Qwen3.8 27B	4.2	9.9	0.0%	0		1.31s	522	126	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	3.0	10.0	0.0%	0		75.80s	402	84	378
Qwen3.8 27B	6.3	10.0	50.0%	0		582ms	711	72	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	3.0	10.0	0.0%	0		90.84s	517	181	82
Qwen3.8 27B	6.0	10.0	33.3%	0		1.25s	714	411	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	10.0	10.0	100.0%	0		2.23s	8,412	358	265
Qwen3.8 27B	10.0	10.0	100.0%	0		2.75s	7,932	273	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	3.0	10.0	0.0%	0		5.53s	249	33	90
Qwen3.8 27B	3.0	10.0	0.0%	0		703ms	210	27	0

Switch Comparison Pair