Modeli zilizolinganishwa

Ulinganisho wa benchmark GPT-5.5 (medium) vs GPT-5.4 (medium) vs Gemini 3.1 Pro Preview (medium) vs Claude Opus 4.7 (medium): Gemini 3.1 Pro Preview (medium) inaongoza kwenye Alama kwa 9.2. GPT-5.5 (medium) inaongoza kwenye Uaminifu kwa 10.0. Gemini 3.1 Pro Preview (medium) ina Jumla ya gharama ya chini zaidi kwa $1.352. Claude Opus 4.7 (medium) ndiyo ya haraka zaidi kwa 7.62s.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-09-28

Modeli zilizolinganishwa

Nafasi: #33
Jumla ya tokeni za matokeo: 125,316
Muda wa majibu (wastani): 38.97s
Jumla ya gharama: $4.163

Nafasi: #56
Jumla ya tokeni za matokeo: 90,466
Muda wa majibu (wastani): 22.85s
Jumla ya gharama: $1.560

Nafasi: #22
Jumla ya tokeni za matokeo: 97,238
Muda wa majibu (wastani): 20.62s
Jumla ya gharama: $1.352

Nafasi: #49
Jumla ya tokeni za matokeo: 29,990
Muda wa majibu (wastani): 7.62s
Jumla ya gharama: $1.476

Muundo unaopendekezwa Gemini 3.1 Pro Preview (medium)

It has the best score here (9.2), while costing about 1.8x less than miundo mingine katika ulinganisho huu.

Ulinganisho wa kina

Kipimo	GPT-5.5 GPT-5.5 medium Toleo: 2026-04-24	GPT-5.4 GPT-5.4 medium Toleo: 2026-03-05	Gemini 3.1 Pro Preview Gemini 3.1 Pro Preview medium Toleo: 2026-02-19	Claude Opus 4.7 Claude Opus 4.7 medium Toleo: 2026-04-16

Kipimo	GPT-5.5 GPT-5.5 medium Toleo: 2026-04-24	GPT-5.4 GPT-5.4 medium Toleo: 2026-03-05	Gemini 3.1 Pro Preview Gemini 3.1 Pro Preview medium Toleo: 2026-02-19	Claude Opus 4.7 Claude Opus 4.7 medium Toleo: 2026-04-16
Alama	9.0	8.5	9.2	8.7
Nafasi	#33	#56	#22	#49
Uaminifu	10.0	10.0	10.0	10.0
Uthabiti	8.9	8.6	10.0	9.6
Majaribio	66/66	66/66	66/66	66/66
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio	87.9%	77.3%	90.9%	83.3%
Majaribio yasiyo thabiti	3	4	0	1
Jumla ya uendeshaji	66	66	66	66
Gharama kwa matokeo	23.127	10.399	6.758	8.200
Jumla ya gharama	$4.163	$1.560	$1.352	$1.476
Bei ya ingizo	$5.000 / 1M	$2.500 / 1M	$2.000 / 1M	$5.000 / 1M
Bei ya toleo	$30.000 / 1M	$15.000 / 1M	$12.000 / 1M	$25.000 / 1M
Jumla ya tokeni za ingizo	80,668	81,136	92,296	145,249
Tokeni za matokeo	5,617	6,155	5,232	24,948
Tokeni za hoja	119,699	84,311	92,006	5,042
Muda wa majibu (wastani)	38.97s	22.85s	20.62s	7.62s
Muda wa majibu (upeo)	332.10s	100.41s	88.68s	65.40s
Muda wa majibu (jumla)	857.43s	502.78s	329.94s	159.94s
Vigezo	~1.5T jumla (~100B vinavyotumika)	~1.5T jumla (~100B vinavyotumika)	~1.2T jumla (~20B vinavyotumika)	~5T jumla (~500B vinavyotumika)
Upatikanaji	Imefungwa	Imefungwa	Imefungwa	Imefungwa

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#33 GPT-5.5

medium

Gharama: $0.112
Muda: 71.9s
Tokeni: 3,807 tok

#56 GPT-5.4

medium

Gharama: $0.214
Muda: 199.6s
Tokeni: 14,349 tok

#22 Gemini 3.1 Pro Preview

medium

Gharama: $0.115
Muda: 87.2s
Tokeni: 9,629 tok

#49 Claude Opus 4.7

medium

Gharama: $0.059
Muda: 26.8s
Tokeni: 2,475 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Kategoria:

Mbinu za kupinga AI	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
GPT-5.5	10.0	10.0	100.0%	4.66s	606	250	1,335
GPT-5.4	8.3	10.0	75.0%	4.11s	606	240	1,511
Gemini 3.1 Pro Preview	10.0	10.0	100.0%	7.90s	498	112	3,218
Claude Opus 4.7	8.3	10.0	75.0%	1.85s	894	348	0

Uandishi wa msimbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
GPT-5.5	8.8	7.8	88.9%	1	59.77s	7,305	362	24,959
GPT-5.4	8.8	7.8	88.9%	1	44.36s	7,305	433	24,216
Gemini 3.1 Pro Preview	7.9	9.9	66.7%	0	40.17s	8,124	435	41,247
Claude Opus 4.7	7.6	7.2	77.8%	1	12.96s	10,635	7,629	1,114

Mchanganyiko	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
GPT-5.5	10.0	10.0	100.0%	33.52s	57,466	3,944	6,735
GPT-5.4	10.0	10.0	100.0%	29.77s	58,038	4,214	13,351
Gemini 3.1 Pro Preview	9.8	10.0	100.0%	40.39s	67,910	3,687	23,111
Claude Opus 4.7	10.0	10.0	100.0%	43.42s	104,347	15,459	3,928

Uchanganuzi na uchimbaji wa data	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
GPT-5.5	10.0	10.0	100.0%	4.18s	7,140	234	593
GPT-5.4	10.0	10.0	100.0%	5.32s	7,140	234	804
Gemini 3.1 Pro Preview	10.0	10.0	100.0%	7.72s	7,265	279	3,904
Claude Opus 4.7	10.0	10.0	100.0%	2.37s	10,533	324	0

Mahususi kwa domeni	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
GPT-5.5	5.3	7.2	44.4%	1	168.16s	732	67	80,505
GPT-5.4	5.3	7.2	44.4%	1	72.44s	628	61	36,544
Gemini 3.1 Pro Preview	7.7	10.0	66.7%	0	20.29s	644	18	11,704
Claude Opus 4.7	7.7	10.0	66.7%	0	1.19s	627	51	0

Akili ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
GPT-5.5	10.0	10.0	100.0%	0	4.16s	477	138	223
GPT-5.4	4.7	3.1	33.3%	1	4.92s	477	145	321
Gemini 3.1 Pro Preview	10.0	10.0	100.0%	0	11.77s	490	108	1,179
Claude Opus 4.7	10.0	10.0	100.0%	0	2.87s	723	256	0

Ufuataji wa maagizo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
GPT-5.5	10.0	10.0	100.0%	3.36s	660	93	538
GPT-5.4	10.0	10.0	100.0%	3.11s	660	93	897
Gemini 3.1 Pro Preview	10.0	10.0	100.0%	9.56s	621	72	2,236
Claude Opus 4.7	10.0	10.0	100.0%	1.57s	939	114	0

Utatuzi wa mafumbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
GPT-5.5	10.0	10.0	100.0%	0	6.76s	642	241	2,225
GPT-5.4	8.2	7.2	88.9%	1	9.14s	642	441	3,815
Gemini 3.1 Pro Preview	10.0	10.0	100.0%	0	6.90s	570	235	3,128
Claude Opus 4.7	10.0	10.0	100.0%	0	2.43s	939	370	0

Mwito wa zana	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
GPT-5.5	10.0	10.0	100.0%	10.57s	5,445	258	832
GPT-5.4	10.0	10.0	100.0%	13.28s	5,445	264	1,031
Gemini 3.1 Pro Preview	10.0	10.0	100.0%	23.15s	6,018	274	982
Claude Opus 4.7	10.0	10.0	100.0%	4.17s	15,339	373	0

Maarifa ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
GPT-5.5	2.8	1.6	33.3%	1	37.86s	195	30	1,754
GPT-5.4	3.0	10.0	0.0%	0	13.95s	195	30	1,821
Gemini 3.1 Pro Preview	10.0	10.0	100.0%	0	6.27s	156	12	1,297
Claude Opus 4.7	3.0	10.0	0.0%	0	2.25s	273	24	0

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

Claude Opus 4.7mediumvsGLM 5.3 Flashmax Claude Opus 4.7mediumvsGemini 3.6 Flashlow Claude Opus 5.5highvsGemini 3.1 Pro Previewmedium Claude Fable 5.1highvsGPT-5.5medium GPT-5.4mediumvsQwen3.8 Maxlow Claude Opus 5highvsGemini 3.1 Pro Previewmedium GPT-5.5mediumvsGrok 4.5high Claude Opus 4.7mediumvsMuse Spark 1.2high Claude Opus 4.7mediumvsGemini 3.5 Flash Litehigh DeepSeek V4.1 FlashlowvsGPT-5.4medium DeepSeek V4.1 FlashhighvsGPT-5.4medium Claude Opus 5.5lowvsGemini 3.1 Pro Previewmedium