AI BENCHY Compare

Anthropic: Claude Sonnet 5 vs Google: Gemma 4 31B

Muhtasari

Ulinganisho wa benchmark Claude Sonnet 5 vs Gemma 4 31B: Gemma 4 31B inaongoza kwa average score: 6.3 vs 5.7. Gemma 4 31B ina gharama ya chini ya benchmark: $0.033 vs $0.287. Claude Sonnet 5 ni ya haraka zaidi: 4.74s vs 56.55s, na pass rates 42.9% vs 69.8%.

Muundo unaopendekezwa: Gemma 4 31B - It has the best score here (6.3), while costing about 8.8x less than Claude Sonnet 5.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-06-30

Kipimo	Claude Sonnet 5 Claude Sonnet 5 none Toleo: 2026-06-30	Gemma 4 31B Gemma 4 31B medium Toleo: 2026-04-02 Inapatikana bure

Kipimo	Claude Sonnet 5 Claude Sonnet 5 none Toleo: 2026-06-30	Gemma 4 31B Gemma 4 31B medium Toleo: 2026-04-02 Inapatikana bure
Alama	5.7	6.3
Nafasi	#117	#90
Uaminifu	10.0	10.0
Uthabiti	8.6	9.4
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio	42.9%	69.8%
Majaribio yasiyo thabiti	4	1
Jumla ya uendeshaji	63	63
Gharama kwa matokeo	4.098	0.257
Jumla ya gharama	$0.287	$0.033
Bei ya ingizo	$2.000 / 1M	$0.120 / 1M
Bei ya toleo	$10.000 / 1M	$0.350 / 1M
Jumla ya tokeni za ingizo	76,797	17,957
Tokeni za matokeo	13,325	22,356
Tokeni za hoja	0	65,726
Muda wa majibu (wastani)	4.74s	56.55s
Muda wa majibu (upeo)	29.46s	437.40s
Muda wa majibu (jumla)	99.46s	1074.41s

Onyesho la kizazi

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#117 Claude Sonnet 5

none

Gharama: $0.061
Muda: 53.7s
Tokeni: 6,172 tok

#90 Gemma 4 31B

medium

Gharama: $0.002
Muda: 45.7s
Tokeni: 2,696 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Claude Sonnet 5	5.3	10.0	25.0%	0		3.60s	834	1,813	0
Gemma 4 31B	10.0	10.0	100.0%	0		12.89s	816	962	2,046

Uandishi wa msimbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Claude Sonnet 5	4.6	7.9	22.2%	1		3.67s	10,590	1,864	0
Gemma 4 31B	4.3	5.8	22.2%	1		219.76s	5,568	11,098	33,212

Mchanganyiko	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Claude Sonnet 5	3.0	10.0	0.0%	0		29.46s	38,775	6,340	0
Gemma 4 31B	3.0	10.0	0.0%	0		0ms	0	0	0

Uchanganuzi na uchimbaji wa data	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Claude Sonnet 5	10.0	10.0	100.0%	0		3.01s	10,503	309	0
Gemma 4 31B	10.0	10.0	100.0%	0		21.11s	8,334	1,822	2,951

Mahususi kwa domeni	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Claude Sonnet 5	5.3	7.2	44.4%	1		3.28s	975	933	0
Gemma 4 31B	7.7	10.0	66.7%	0		38.48s	876	4,349	8,985

Akili ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Claude Sonnet 5	4.7	3.1	33.3%	1		2.81s	708	272	0
Gemma 4 31B	10.0	10.0	100.0%	0		9.57s	567	105	888

Ufuataji wa maagizo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Claude Sonnet 5	6.4	10.0	50.0%	0		2.58s	909	103	0
Gemma 4 31B	10.0	10.0	100.0%	0		12.76s	777	533	2,035

Utatuzi wa mafumbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Claude Sonnet 5	6.0	7.4	55.6%	1		3.22s	894	778	0
Gemma 4 31B	9.9	10.0	100.0%	0		26.91s	801	1,795	5,595

Mwito wa zana	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Claude Sonnet 5	10.0	10.0	100.0%	0		6.80s	12,351	522	0
Gemma 4 31B	3.0	10.0	0.0%	0		0ms	0	0	0

Maarifa ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Claude Sonnet 5	3.0	10.0	0.0%	0		4.31s	258	391	0
Gemma 4 31B	3.0	10.0	0.0%	0		90.14s	218	1,692	10,014

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho