Granite 4.1 8b (default) vs GLM 4.7 Flash (medium)

Compared models

Rank: #414
Total Output Tokens: 5,996
Response Time (avg): 1.38s
Total Cost: $0.007

Rank: #403
Total Output Tokens: 447,599
Response Time (avg): 150.90s
Total Cost: $0.193

Recommended model Granite 4.1 8b (default)

Its score stays close to the best score here (3.8 vs 4.2), while costing about 30.7x less than GLM 4.7 Flash (medium).

Detailed comparison

Metric	Granite 4.1 8b Granite 4.1 8b default Release: 2026-05-01	GLM 4.7 Flash GLM 4.7 Flash medium Release: 2026-01-19

Metric	Granite 4.1 8b Granite 4.1 8b default Release: 2026-05-01	GLM 4.7 Flash GLM 4.7 Flash medium Release: 2026-01-19
Score	3.8	4.2
Rank	#414	#403
Reliability	10.0	9.4
Consistency	10.0	7.1
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	8.7%	30.4%
Flaky tests	0	8
Total Runs	69	69
Cost per result	0.315	4.822
Total Cost	$0.007	$0.193
Input Price	$0.050 / 1M	$0.061 / 1M
Output Price	$0.100 / 1M	$0.400 / 1M
Cache Read Price	N/A	N/A
Cache Write Price	N/A	N/A
Total Input Tokens	113,836	228,711
Output Tokens	5,996	42,254
Reasoning Tokens	0	422,121
Response Time (avg)	1.38s	150.90s
Response Time (max)	16.67s	1539.97s
Response Time (total)	31.81s	2414.33s
Parameters	8B	30B total (3B active)
Availability	Open source	Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#414 Granite 4.1 8b

default

Cost: $0.001
Time: 3.2s
Tokens: 491 tok

#403 GLM 4.7 Flash

medium

No output was saved. The original provider response or failure reason is unavailable.

Cost: $0.000
Time: 186.2s
Tokens: 12,112 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8b	3.0	10.0	0.0%	0		60ms	0	0	0
GLM 4.7 Flash	3.9	9.6	0.0%	0		399.20s	149,607	0	44,841

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8b	4.9	10.0	25.0%	0		844ms	645	903	0
GLM 4.7 Flash	4.7	5.9	41.7%	2		14.95s	555	1,122	6,110

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8b	4.5	10.0	0.0%	0		775ms	8,344	525	0
GLM 4.7 Flash	3.2	7.4	11.1%	1		55.33s	3,106	4,981	22,387

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8b	3.0	10.0	0.0%	0		9.28s	86,631	3,481	0
GLM 4.7 Flash	2.9	6.0	16.7%	1		802.77s	59,030	2,585	305,678

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8b	3.0	10.0	0.0%	0		575ms	7,617	195	0
GLM 4.7 Flash	6.3	10.0	50.0%	0		1.51s	7,107	584	2,755

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8b	3.0	10.0	0.0%	0		287ms	777	24	0
GLM 4.7 Flash	3.5	4.4	33.3%	2		96.74s	696	31,500	28,565

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8b	4.0	10.0	0.0%	0		499ms	528	115	0
GLM 4.7 Flash	3.6	9.7	0.0%	0		18.14s	318	18	2,138

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8b	3.6	9.9	0.0%	0		344ms	687	66	0
GLM 4.7 Flash	6.2	5.8	66.7%	1		2.97s	636	388	2,181

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8b	3.2	10.0	0.0%	0		608ms	672	432	0
GLM 4.7 Flash	2.9	7.2	11.1%	1		12.93s	521	781	5,255

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8b	10.0	10.0	100.0%	0		2.17s	7,719	243	0
GLM 4.7 Flash	10.0	10.0	100.0%	0		15.95s	6,949	224	1,014

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Granite 4.1 8b	3.0	10.0	0.0%	0		306ms	216	12	0
GLM 4.7 Flash	3.0	10.0	0.0%	0		11.13s	186	71	1,197

Switch Comparison Pair

Granite 4.1 8bdefaultvsNemotron 3.5 LightningnoneFree Available gpt-oss-120bnonevsGLM 4.7 Flashmedium Mercury 2.5nonevsGLM 4.7 Flashmedium Granite 4.1 8bdefaultvsXing4.0 29b A4bmediumFree Available Granite 4.1 8bdefaultvsLing 3.0 Tinyhigh Granite 4.1 8bdefaultvsLing 3.0 Tinylow Mercury 2nonevsGLM 4.7 Flashmedium Granite 4.1 8bdefaultvsLing 3.0 Tinymedium Granite 4.2 8BnonevsGLM 4.7 Flashmedium Trinity Large PreviewdefaultFree AvailablevsGLM 4.7 Flashmedium KAT Coder AIR V2.5defaultvsGLM 4.7 Flashmedium Granite 4.1 8bdefaultvsQwen3.5-9Bmedium