AI BENCHY Compare

IBM: Granite 4.1 8B vs Qwen: Qwen3.5-9B

Muhtasari

Ulinganisho wa benchmark Granite 4.1 8B vs Qwen3.5-9B: Granite 4.1 8B inaongoza kwa average score: 4.0 vs 3.8. Granite 4.1 8B ina gharama ya chini ya benchmark: $0.003 vs $0.036. Granite 4.1 8B ni ya haraka zaidi: 728ms vs 82.24s, na pass rates 9.5% vs 27.0%.

Muundo unaopendekezwa: Granite 4.1 8B - It has the best score here (4.0), while costing about 13.7x less than Qwen3.5-9B.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-06-12

Kipimo	Granite 4.1 8B Granite 4.1 8B none Toleo: 2026-05-01	Qwen3.5-9B Qwen3.5-9B medium Toleo: 2026-03-02

Kipimo	Granite 4.1 8B Granite 4.1 8B none Toleo: 2026-05-01	Qwen3.5-9B Qwen3.5-9B medium Toleo: 2026-03-02
Alama	4.0	3.8
Nafasi	#163	#164
Uaminifu	10.0	6.7
Uthabiti	10.0	8.0
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio	9.5%	27.0%
Majaribio yasiyo thabiti	0	5
Jumla ya uendeshaji	63	63
Gharama kwa matokeo	0.131	1.187
Jumla ya gharama	$0.003	$0.036
Bei ya ingizo	$0.050 / 1M	$0.100 / 1M
Bei ya toleo	$0.100 / 1M	$0.150 / 1M
Jumla ya tokeni za ingizo	46,285	17,070
Tokeni za matokeo	2,911	29,045
Tokeni za hoja	0	209,516
Muda wa majibu (wastani)	728ms	82.24s
Muda wa majibu (upeo)	2.17s	226.38s
Muda wa majibu (jumla)	15.29s	1315.88s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#163 IBM: Granite 4.1 8B

none

Cost: $0.001
Time: 3.2s
Tokens: 491 tok

#164 Qwen3.5-9B

medium

Cost: $0.001
Time: 35.9s
Tokens: 3,030 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Granite 4.1 8B	4.9	10.0	25.0%	0		844ms	645	903	0
Qwen3.5-9B	5.1	5.8	50.0%	2		34.44s	369	2,621	12,411

Uandishi wa msimbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Granite 4.1 8B	4.5	10.0	0.0%	0		775ms	8,344	525	0
Qwen3.5-9B	2.9	10.0	0.0%	0		100.88s	2,396	7,890	41,129

Mchanganyiko	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Granite 4.1 8B	3.0	10.0	0.0%	0		1.88s	19,089	396	0
Qwen3.5-9B	3.0	10.0	0.0%	0		0ms	0	0	0

Uchanganuzi na uchimbaji wa data	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Granite 4.1 8B	3.0	10.0	0.0%	0		575ms	7,617	195	0
Qwen3.5-9B	3.6	5.6	33.3%	1		87.31s	4,722	1,383	32,113

Mahususi kwa domeni	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Granite 4.1 8B	3.0	10.0	0.0%	0		357ms	768	24	0
Qwen3.5-9B	3.6	7.2	22.2%	1		137.75s	295	11,549	48,475

Akili ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Granite 4.1 8B	4.0	10.0	0.0%	0		499ms	528	115	0
Qwen3.5-9B	2.8	1.6	33.3%	1		226.38s	180	0	30,695

Ufuataji wa maagizo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Granite 4.1 8B	3.6	9.9	0.0%	0		344ms	687	66	0
Qwen3.5-9B	6.5	10.0	50.0%	0		5.75s	381	491	1,824

Utatuzi wa mafumbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Granite 4.1 8B	3.2	10.0	0.0%	0		608ms	672	432	0
Qwen3.5-9B	3.0	10.0	0.0%	0		32.27s	376	1,593	12,026

Mwito wa zana	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Granite 4.1 8B	10.0	10.0	100.0%	0		2.17s	7,719	243	0
Qwen3.5-9B	10.0	10.0	100.0%	0		4.31s	8,283	444	1,149

Maarifa ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Granite 4.1 8B	3.0	10.0	0.0%	0		306ms	216	12	0
Qwen3.5-9B	3.0	10.0	0.0%	0		177.02s	68	3,074	29,694

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

Granite 4.1 8BnonevsGLM 4.7 Flashmedium Qwen3.5-9BmediumvsMiMo-V2-Flashnone Granite 4.1 8BnonevsQwen3 Coder Nextmedium Granite 4.1 8BnonevsMiniMax M2.5medium Mercury 2nonevsQwen3.5-9Bmedium Ling-2.6-1TnonevsQwen3.5-9Bmedium CobuddymediumvsGranite 4.1 8Bnone gpt-oss-120bnoneInapatikana burevsQwen3.5-9Bmedium GPT-5.4 NanononevsQwen3.5-9Bmedium Ring-2.6-1TnonevsQwen3.5-9Bmedium Ling-2.6-flashnonevsQwen3.5-9Bmedium Nemotron 3 SupernoneInapatikana burevsQwen3.5-9Bmedium