AI BENCHY Compare

IBM: Granite 4.1 8B vs OpenAI: GPT-5.4 Nano

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-05-01

Kipimo	Granite 4.1 8B Granite 4.1 8B none Toleo: 2026-05-01	GPT-5.4 Nano GPT-5.4 Nano none Toleo: 2026-03-17

Kipimo	Granite 4.1 8B Granite 4.1 8B none Toleo: 2026-05-01	GPT-5.4 Nano GPT-5.4 Nano none Toleo: 2026-03-17
Alama	4.3	4.6
Nafasi	#135	#127
Uaminifu	10.0	Haipo
Uthabiti	10.0	7.4
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio	11.1%	33.3%
Majaribio yasiyo thabiti	0	6
Jumla ya uendeshaji	54	54
Gharama kwa matokeo	0.110	0.299
Jumla ya gharama	$0.003	$0.009
Bei ya ingizo	$0.050 / 1M	$0.200 / 1M
Bei ya toleo	$0.100 / 1M	$1.250 / 1M
Tokeni za matokeo	2,712	2,762
Tokeni za hoja	0	0
Muda wa majibu (wastani)	767ms	1.40s
Muda wa majibu (upeo)	2.17s	3.84s
Muda wa majibu (jumla)	13.81s	25.14s

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Granite 4.1 8B	4.9	10.0	25.0%	0		844ms	903	0
GPT-5.4 Nano	3.5	8.0	16.7%	1		1.18s	800	0

Uandishi wa msimbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Granite 4.1 8B	6.9	10.0	0.0%	0		1.07s	339	0
GPT-5.4 Nano	7.1	3.7	66.7%	1		1.43s	577	0

Mchanganyiko	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Granite 4.1 8B	3.0	10.0	0.0%	0		1.88s	396	0
GPT-5.4 Nano	3.0	10.0	0.0%	0		3.84s	280	0

Uchanganuzi na uchimbaji wa data	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Granite 4.1 8B	3.0	10.0	0.0%	0		575ms	195	0
GPT-5.4 Nano	6.5	10.0	50.0%	0		1.11s	219	0

Mahususi kwa domeni	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Granite 4.1 8B	3.0	10.0	0.0%	0		357ms	24	0
GPT-5.4 Nano	2.9	4.4	22.2%	2		926ms	52	0

Akili ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Granite 4.1 8B	4.0	10.0	0.0%	0		499ms	115	0
GPT-5.4 Nano	3.8	2.5	33.3%	1		1.31s	180	0

Ufuataji wa maagizo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Granite 4.1 8B	3.6	9.9	0.0%	0		344ms	66	0
GPT-5.4 Nano	6.3	10.0	50.0%	0		787ms	84	0

Utatuzi wa mafumbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Granite 4.1 8B	3.7	10.0	0.0%	0		635ms	431	0
GPT-5.4 Nano	3.7	7.3	22.2%	1		1.29s	348	0

Mwito wa zana	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Granite 4.1 8B	10.0	10.0	100.0%	0		2.17s	243	0
GPT-5.4 Nano	10.0	10.0	100.0%	0		3.40s	222	0

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

GPT-5.4 NanononevsGLM 4.7 Flashmedium Granite 4.1 8BnonevsQwen3.5-9Bmedium GPT-5.4 NanononevsQwen3.5-9Bmedium GPT-5.4 NanononevsQwen3 Coder Nextmedium Granite 4.1 8BnonevsGLM 4.7 Flashmedium Nemotron 3 Nano Omni 30b A3b ReasoningmediumInapatikana burevsGPT-5.4 Nanonone GPT-5.4 NanononevsElephant Alphamedium Granite 4.1 8BnonevsQwen3 Coder Nextmedium MiniMax M2.7mediumvsGPT-5.4 Nanonone Granite 4.1 8BnonevsNemotron 3 Nano Omni 30b A3b ReasoningmediumInapatikana bure Granite 4.1 8BnonevsElephant Alphamedium Granite 4.1 8BnonevsMiniMax M2.7medium