AI BENCHY Compare

Anthropic: Claude Opus 4.8 vs Google: Gemma 4 31B

Muhtasari

Ulinganisho wa benchmark Claude Opus 4.8 vs Gemma 4 31B: Claude Opus 4.8 inaongoza kwa average score: 7.2 vs 6.3. Gemma 4 31B ina gharama ya chini ya benchmark: $0.033 vs $0.539. Claude Opus 4.8 ni ya haraka zaidi: 3.47s vs 56.55s, na pass rates 61.9% vs 69.8%.

Muundo unaopendekezwa: Claude Opus 4.8 - It has the best score here (7.2), while responding about 16.3x faster than Gemma 4 31B.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-06-18

Kipimo	Claude Opus 4.8 Claude Opus 4.8 none Toleo: 2026-05-28	Gemma 4 31B Gemma 4 31B medium Toleo: 2026-04-02 Inapatikana bure

Kipimo	Claude Opus 4.8 Claude Opus 4.8 none Toleo: 2026-05-28	Gemma 4 31B Gemma 4 31B medium Toleo: 2026-04-02 Inapatikana bure
Alama	7.2	6.3
Nafasi	#57	#88
Uaminifu	10.0	10.0
Uthabiti	9.2	9.4
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio	61.9%	69.8%
Majaribio yasiyo thabiti	2	1
Jumla ya uendeshaji	63	63
Gharama kwa matokeo	4.485	0.257
Jumla ya gharama	$0.539	$0.033
Bei ya ingizo	$5.000 / 1M	$0.120 / 1M
Bei ya toleo	$25.000 / 1M	$0.350 / 1M
Jumla ya tokeni za ingizo	67,104	17,957
Tokeni za matokeo	8,107	22,356
Tokeni za hoja	0	65,726
Muda wa majibu (wastani)	3.47s	56.55s
Muda wa majibu (upeo)	17.73s	437.40s
Muda wa majibu (jumla)	72.90s	1074.41s

Onyesho la kizazi

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#57 Claude Opus 4.8

none

Gharama: $0.053
Muda: 22.0s
Tokeni: 2,253 tok

#88 Gemma 4 31B

medium

Gharama: $0.002
Muda: 45.7s
Tokeni: 2,696 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Claude Opus 4.8	6.5	10.0	50.0%	0		3.40s	834	1,472	0
Gemma 4 31B	10.0	10.0	100.0%	0		12.89s	816	962	2,046

Uandishi wa msimbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Claude Opus 4.8	5.5	10.0	33.3%	0		3.29s	10,590	1,332	0
Gemma 4 31B	4.3	5.8	22.2%	1		219.76s	5,568	11,098	33,212

Mchanganyiko	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Claude Opus 4.8	9.5	10.0	100.0%	0		17.73s	29,658	3,259	0
Gemma 4 31B	3.0	10.0	0.0%	0		0ms	0	0	0

Uchanganuzi na uchimbaji wa data	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Claude Opus 4.8	7.3	5.8	83.3%	1		1.77s	10,503	308	0
Gemma 4 31B	10.0	10.0	100.0%	0		21.11s	8,334	1,822	2,951

Mahususi kwa domeni	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Claude Opus 4.8	5.3	7.2	44.4%	1		1.66s	975	61	0
Gemma 4 31B	7.7	10.0	66.7%	0		38.48s	876	4,349	8,985

Akili ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Claude Opus 4.8	10.0	10.0	100.0%	0		3.48s	708	230	0
Gemma 4 31B	10.0	10.0	100.0%	0		9.57s	567	105	888

Ufuataji wa maagizo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Claude Opus 4.8	9.9	10.0	100.0%	0		1.37s	909	95	0
Gemma 4 31B	10.0	10.0	100.0%	0		12.76s	777	533	2,035

Utatuzi wa mafumbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Claude Opus 4.8	7.7	10.0	66.7%	0		2.74s	894	783	0
Gemma 4 31B	9.9	10.0	100.0%	0		26.91s	801	1,795	5,595

Mwito wa zana	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Claude Opus 4.8	10.0	10.0	100.0%	0		5.35s	11,775	355	0
Gemma 4 31B	3.0	10.0	0.0%	0		0ms	0	0	0

Maarifa ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Claude Opus 4.8	3.0	10.0	0.0%	0		3.41s	258	212	0
Gemma 4 31B	3.0	10.0	0.0%	0		90.14s	218	1,692	10,014

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho