Granite 4.2 8B (medium) vs GLM 5.3 FlashX (low)

Compared models

Recommended model Granite 4.2 8B (medium)

It has the best score here (6.1), while costing about 5.6x less than GLM 5.3 FlashX (low).

Metric	Granite 4.2 8B Granite 4.2 8B medium Release: 2026-09-02	GLM 5.3 FlashX GLM 5.3 FlashX low Release: 2026-09-21

Metric	Granite 4.2 8B Granite 4.2 8B medium Release: 2026-09-02	GLM 5.3 FlashX GLM 5.3 FlashX low Release: 2026-09-21
Score	6.1	6.0
Rank	#235	#238
Reliability	8.9	10.0
Consistency	9.7	6.8
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	37.7%	63.8%
Flaky tests	1	9
Total Runs	69	69
Cost per result	0.354	1.423
Total Cost	$0.029	$0.157
Input Price	$0.060 / 1M	$0.370 / 1M
Output Price	$0.250 / 1M	$1.250 / 1M
Total Input Tokens	259,708	277,028
Output Tokens	16,567	11,965
Reasoning Tokens	33,580	31,238
Response Time (avg)	50.47s	9.69s
Response Time (max)	557.96s	77.99s
Response Time (total)	1160.91s	222.83s
Parameters	8B	320B total (18B active)
Availability	Open source	Closed

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

medium

Provider returned error

low

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	10.0	10.0	100.0%	0		149.50s	206,799	9,509	21,308
GLM 5.3 FlashX	4.7	3.1	33.3%	1		77.99s	159,703	1,471	4,696

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	8.4	10.0	75.0%	0		10.34s	777	1,452	889
GLM 5.3 FlashX	8.2	7.9	83.3%	1		1.56s	639	278	353

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	5.5	10.0	33.3%	0		12.09s	8,439	2,445	3,900
GLM 5.3 FlashX	5.5	7.4	44.4%	1		5.45s	7,317	382	4,760

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	3.0	10.0	0.0%	0		291.12s	24,807	1,902	6,258
GLM 5.3 FlashX	2.8	1.6	33.3%	2		42.40s	92,545	8,581	18,553

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	6.5	10.0	50.0%	0		1.43s	7,683	270	75
GLM 5.3 FlashX	10.0	10.0	100.0%	0		1.59s	7,149	210	81

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	5.3	10.0	33.3%	0		13.96s	876	154	290
GLM 5.3 FlashX	3.5	4.4	33.3%	2		3.87s	759	36	2,040

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	4.0	10.0	0.0%	0		605ms	561	102	24
GLM 5.3 FlashX	4.7	1.6	66.7%	1		2.07s	498	137	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	3.8	6.0	33.3%	1		36.86s	636	127	425
GLM 5.3 FlashX	10.0	10.0	100.0%	0		1.34s	678	72	84

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	3.1	10.0	0.0%	0		75.99s	469	206	56
GLM 5.3 FlashX	7.7	7.3	77.8%	1		1.89s	672	460	336

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	10.0	10.0	100.0%	0		2.28s	8,412	359	214
GLM 5.3 FlashX	10.0	10.0	100.0%	0		9.52s	6,861	231	20

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.2 8B	3.0	10.0	0.0%	0		2.24s	249	41	141
GLM 5.3 FlashX	3.0	10.0	0.0%	0		2.69s	207	107	315

Switch Comparison Pair