AI BENCHY Compare

Google: Gemma 4 31B vs xAI: Grok 4.1 Fast

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-04-02

Kipimo	Gemma 4 31B Gemma 4 31B none Toleo: 2026-04-02	Grok 4.1 Fast Grok 4.1 Fast medium Toleo: 2025-11-19

Kipimo	Gemma 4 31B Gemma 4 31B none Toleo: 2026-04-02	Grok 4.1 Fast Grok 4.1 Fast medium Toleo: 2025-11-19
Alama	6.7	6.9
Nafasi	#47	#43
Uthabiti	10.0	7.5
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio	52.9%	66.7%
Majaribio yasiyo thabiti	0	5
Jumla ya uendeshaji	51	51
Gharama kwa matokeo	0.023	0.568
Jumla ya gharama	$0.002	$0.052
Bei ya ingizo	$0.140 / 1M	$0.200 / 1M
Bei ya toleo	$0.400 / 1M	$0.500 / 1M
Tokeni za matokeo	660	1,189
Tokeni za hoja	0	84,595
Muda wa majibu (wastani)	2.55s	23.91s
Muda wa majibu (upeo)	4.68s	121.79s
Muda wa majibu (jumla)	38.20s	239.09s

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Gemma 4 31B	6.5	10.0	50.0%	0		1.85s	45	0
Grok 4.1 Fast	8.7	7.9	91.7%	1		3.81s	108	4,741

Mchanganyiko	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Gemma 4 31B	3.0	10.0	0.0%	0		0ms	0	0
Grok 4.1 Fast	10.0	10.0	100.0%	0		37.64s	261	12,272

Uchanganuzi na uchimbaji wa data	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Gemma 4 31B	10.0	10.0	100.0%	0		2.25s	285	0
Grok 4.1 Fast	10.0	10.0	100.0%	0		6.63s	180	5,409

Mahususi kwa domeni	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Gemma 4 31B	7.7	10.0	66.7%	0		3.22s	27	0
Grok 4.1 Fast	5.8	4.4	66.7%	2		121.79s	11	37,657

Akili ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Gemma 4 31B	10.0	10.0	100.0%	0		2.09s	117	0
Grok 4.1 Fast	4.2	9.9	0.0%	0		16.25s	127	3,456

Ufuataji wa maagizo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Gemma 4 31B	6.5	10.0	50.0%	0		2.84s	78	0
Grok 4.1 Fast	6.6	10.0	50.0%	0		5.30s	55	3,489

Puzzle Solving	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Gemma 4 31B	5.5	10.0	33.3%	0		2.95s	108	0
Grok 4.1 Fast	5.3	7.2	44.4%	1		8.08s	187	6,086

Mwito wa zana	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Gemma 4 31B	3.0	10.0	0.0%	0		0ms	0	0
Grok 4.1 Fast	2.8	1.6	33.3%	1		27.71s	260	11,485

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

Gemma 4 31BnonevsGPT-5 Minimedium Qwen3.5 Plus 2026-02-15nonevsGrok 4.1 Fastmedium Gemma 4 31BnonevsNemotron 3 SupermediumInapatikana bure Grok 4.1 FastmediumvsGLM 5none Gemma 4 31BnonevsHunter Alphamedium Claude Sonnet 4.6nonevsGrok 4.1 Fastmedium Gemma 4 31BnonevsGPT-5.4 Minimedium Gemma 4 31BnonevsGrok 4.20medium Gemma 4 31BnonevsMercury 2medium Gemma 4 31BnonevsGPT-5 Nanomedium Gemma 4 31BnonevsKimi K2.5medium Gemma 4 31BnonevsGrok 4.20 Multi Agent Betamedium