AI BENCHY Compare

IBM: Granite 4.1 8B vs Qwen: Qwen3.5-9B

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-05-01

Kipimo	Granite 4.1 8B Granite 4.1 8B none Toleo: 2026-05-01	Qwen3.5-9B Qwen3.5-9B medium Toleo: 2026-03-02

Kipimo	Granite 4.1 8B Granite 4.1 8B none Toleo: 2026-05-01	Qwen3.5-9B Qwen3.5-9B medium Toleo: 2026-03-02
Alama	4.3	4.4
Nafasi	#135	#132
Uaminifu	10.0	Haipo
Uthabiti	10.0	7.2
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio	11.1%	33.3%
Majaribio yasiyo thabiti	0	6
Jumla ya uendeshaji	54	54
Gharama kwa matokeo	0.110	0.976
Jumla ya gharama	$0.003	$0.030
Bei ya ingizo	$0.050 / 1M	$0.100 / 1M
Bei ya toleo	$0.100 / 1M	$0.150 / 1M
Tokeni za matokeo	2,712	24,291
Tokeni za hoja	0	172,597
Muda wa majibu (wastani)	767ms	73.64s
Muda wa majibu (upeo)	2.17s	226.38s
Muda wa majibu (jumla)	13.81s	1104.60s

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Granite 4.1 8B	4.9	10.0	25.0%	0		844ms	903	0
Qwen3.5-9B	5.1	5.8	50.0%	2		34.44s	2,621	12,411

Uandishi wa msimbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Granite 4.1 8B	6.9	10.0	0.0%	0		1.07s	339	0
Qwen3.5-9B	2.6	10.0	0.0%	0		135.61s	6,150	31,393

Mchanganyiko	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Granite 4.1 8B	3.0	10.0	0.0%	0		1.88s	396	0
Qwen3.5-9B	3.0	10.0	0.0%	0		0ms	0	0

Uchanganuzi na uchimbaji wa data	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Granite 4.1 8B	3.0	10.0	0.0%	0		575ms	195	0
Qwen3.5-9B	3.6	5.6	33.3%	1		87.31s	1,383	32,113

Mahususi kwa domeni	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Granite 4.1 8B	3.0	10.0	0.0%	0		357ms	24	0
Qwen3.5-9B	3.6	7.2	22.2%	1		137.75s	11,549	48,475

Akili ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Granite 4.1 8B	4.0	10.0	0.0%	0		499ms	115	0
Qwen3.5-9B	2.8	1.6	33.3%	1		226.38s	0	30,695

Ufuataji wa maagizo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Granite 4.1 8B	3.6	9.9	0.0%	0		344ms	66	0
Qwen3.5-9B	6.4	5.8	66.7%	1		17.15s	599	4,517

Utatuzi wa mafumbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Granite 4.1 8B	3.7	10.0	0.0%	0		635ms	431	0
Qwen3.5-9B	3.1	10.0	0.0%	0		33.38s	1,545	11,844

Mwito wa zana	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Granite 4.1 8B	10.0	10.0	100.0%	0		2.17s	243	0
Qwen3.5-9B	10.0	10.0	100.0%	0		4.31s	444	1,149

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

Nemotron 3 Nano Omni 30b A3b ReasoningnoneInapatikana burevsQwen3.5-9Bmedium Ling 2.6 1tnoneInapatikana burevsQwen3.5-9Bmedium Qwen3.5-9BmediumvsGrok 4.1 Fastnone Qwen3.5-9BmediumvsMiMo-V2-Flashnone GPT-5.4 NanononevsQwen3.5-9Bmedium Qwen3.5-9BmediumvsHY3 PreviewnoneInapatikana bure Granite 4.1 8BnonevsGLM 4.7 Flashmedium Mercury 2nonevsQwen3.5-9Bmedium Granite 4.1 8BnonevsQwen3 Coder Nextmedium Laguna Xs.2noneInapatikana burevsQwen3.5-9Bmedium Laguna M.1noneInapatikana burevsQwen3.5-9Bmedium GPT-4o-mininonevsQwen3.5-9Bmedium