Modeli zilizolinganishwa

Ulinganisho wa benchmark Gemma 4 31B (medium) vs Gemma 4 26B A4B (medium) vs Gemini 3 PRO Preview (medium): Gemma 4 26B A4B (medium) inaongoza kwenye Alama kwa 6.8. Gemma 4 31B (medium) inaongoza kwenye Uaminifu kwa 10.0. Gemma 4 26B A4B (medium) ina Jumla ya gharama ya chini zaidi kwa $0.092. Gemini 3 PRO Preview (medium) ndiyo ya haraka zaidi kwa 9.05s.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-09-10

Modeli zilizolinganishwa

Nafasi: #193
Jumla ya tokeni za matokeo: 267,421
Muda wa majibu (wastani): 78.59s
Jumla ya gharama: $0.100

Nafasi: #163
Jumla ya tokeni za matokeo: 253,646
Muda wa majibu (wastani): 104.93s
Jumla ya gharama: $0.092

Nafasi: #212
Jumla ya tokeni za matokeo: 11,592
Muda wa majibu (wastani): 9.05s
Jumla ya gharama: $0.385

Muundo unaopendekezwa Gemma 4 26B A4B (medium)

It has the best score here (6.8), while costing about 2.6x less than miundo mingine katika ulinganisho huu.

Ulinganisho wa kina

Kipimo	Gemma 4 31B Gemma 4 31B medium Toleo: 2026-04-02 Inapatikana bure	Gemma 4 26B A4B Gemma 4 26B A4B medium Toleo: 2026-04-03 Inapatikana bure	Gemini 3 PRO Preview Gemini 3 PRO Preview medium Toleo: 2025-11-18

Kipimo	Gemma 4 31B Gemma 4 31B medium Toleo: 2026-04-02 Inapatikana bure	Gemma 4 26B A4B Gemma 4 26B A4B medium Toleo: 2026-04-03 Inapatikana bure	Gemini 3 PRO Preview Gemini 3 PRO Preview medium Toleo: 2025-11-18
Alama	6.2	6.8	6.0
Nafasi	#193	#163	#212
Uaminifu	10.0	10.0	Haipo
Uthabiti	8.7	9.6	9.5
Majaribio	66/66	66/66	63/66
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio	65.2%	69.7%	63.6%
Majaribio yasiyo thabiti	3	1	0
Jumla ya uendeshaji	66	66	63
Gharama kwa matokeo	1.152	0.623	1.406
Jumla ya gharama	$0.100	$0.092	$0.385
Bei ya ingizo	$0.090 / 1M	$0.070 / 1M	$9.506 / 1M
Bei ya toleo	$0.340 / 1M	$0.340 / 1M	$9.506 / 1M
Jumla ya tokeni za ingizo	94,969	77,528	28,848
Tokeni za matokeo	34,399	26,048	1,490
Tokeni za hoja	233,022	227,598	10,102
Muda wa majibu (wastani)	78.59s	104.93s	9.05s
Muda wa majibu (upeo)	437.40s	912.19s	26.24s
Muda wa majibu (jumla)	1571.84s	2203.52s	90.53s
Vigezo	30.7B	25.2B jumla (3.8B vinavyotumika)	~1.2T jumla (~20B vinavyotumika)
Upatikanaji	Chanzo huria	Chanzo huria	Imefungwa

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#193 Gemma 4 31B

medium

Gharama: $0.002
Muda: 45.7s
Tokeni: 2,696 tok

#163 Gemma 4 26B A4B

medium

Reached the allocated time limit (300 seconds) without receiving showcase output.

Gharama: $0.000
Muda: 300.0s
Tokeni: 0 tok

#212 Gemini 3 PRO Preview

medium

No endpoints found for google/gemini-3-pro-preview.

Gharama: $0.000
Muda: 0.1s
Tokeni: 0 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Kategoria:

Mbinu za kupinga AI	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Gemma 4 31B	10.0	10.0	100.0%	12.89s	816	962	2,046
Gemma 4 26B A4B	10.0	10.0	100.0%	6.20s	816	1,142	3,045
Gemini 3 PRO Preview	10.0	10.0	100.0%	14.99s	500	149	1,485

Uandishi wa msimbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Gemma 4 31B	4.3	5.8	22.2%	1	219.76s	5,568	11,098	33,212
Gemma 4 26B A4B	2.9	10.0	0.0%	0	272.54s	5,062	14,838	44,567
Gemini 3 PRO Preview	3.0	10.0	0.0%	0	0ms	0	0	0

Mchanganyiko	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Gemma 4 31B	2.9	5.8	16.7%	1	433.11s	77,035	12,112	157,552
Gemma 4 26B A4B	6.3	10.0	50.0%	0	492.87s	54,390	5,451	132,113
Gemini 3 PRO Preview	1.5	5.0	0.0%	0	10.37s	13,211	351	952

Uchanganuzi na uchimbaji wa data	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Gemma 4 31B	10.0	10.0	100.0%	21.11s	8,334	1,822	2,951
Gemma 4 26B A4B	10.0	10.0	100.0%	16.51s	8,334	1,567	2,827
Gemini 3 PRO Preview	10.0	10.0	100.0%	10.84s	7,259	279	3,156

Mahususi kwa domeni	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Gemma 4 31B	5.3	7.2	44.4%	1	59.92s	853	4,280	18,729
Gemma 4 26B A4B	5.3	7.2	44.4%	1	35.14s	494	481	15,212
Gemini 3 PRO Preview	5.3	10.0	33.3%	0	7.01s	643	15	1,195

Akili ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Gemma 4 31B	10.0	10.0	100.0%	9.57s	567	105	888
Gemma 4 26B A4B	10.0	10.0	100.0%	29.76s	567	25	5,075
Gemini 3 PRO Preview	10.0	10.0	100.0%	9.34s	486	78	374

Ufuataji wa maagizo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Gemma 4 31B	10.0	10.0	100.0%	12.76s	777	533	2,035
Gemma 4 26B A4B	10.0	10.0	100.0%	17.54s	777	887	4,470
Gemini 3 PRO Preview	9.8	10.0	100.0%	3.26s	623	69	754

Utatuzi wa mafumbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Gemma 4 31B	9.9	10.0	100.0%	26.91s	801	1,795	5,595
Gemma 4 26B A4B	10.0	10.0	100.0%	5.79s	801	410	2,128
Gemini 3 PRO Preview	10.0	10.0	100.0%	3.88s	570	225	1,215

Mwito wa zana	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Gemma 4 31B	3.0	10.0	0.0%	0ms	0	0	0
Gemma 4 26B A4B	10.0	10.0	100.0%	9.01s	6,096	450	1,256
Gemini 3 PRO Preview	10.0	10.0	100.0%	11.96s	5,556	324	971

Maarifa ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Gemma 4 31B	3.0	10.0	0.0%	90.14s	218	1,692	10,014
Gemma 4 26B A4B	3.0	10.0	0.0%	180.87s	191	797	16,905
Gemini 3 PRO Preview	3.0	10.0	0.0%	0ms	0	0	0

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho