Ember-1 (max) vs GPT-5.4

Modeli zilizolinganishwa

Muundo unaopendekezwa GPT-5.4

Its score stays close to the best score here (5.8 vs 5.9), while costing about 7.0x less than Ember-1 (max).

Kipimo	Ember-1 Ember-1 max Toleo: 2026-09-28	GPT-5.4 GPT-5.4 none Toleo: 2026-03-05

Kipimo	Ember-1 Ember-1 max Toleo: 2026-09-28	GPT-5.4 GPT-5.4 none Toleo: 2026-03-05
Alama	5.9	5.8
Nafasi	#248	#254
Uaminifu	7.5	10.0
Uthabiti	7.7	9.2
Majaribio	66/66	66/66
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio	57.6%	34.9%
Majaribio yasiyo thabiti	6	2
Jumla ya uendeshaji	66	66
Gharama kwa matokeo	27.915	5.667
Jumla ya gharama	$2.792	$0.397
Bei ya ingizo	$3.000 / 1M	$2.500 / 1M
Bei ya toleo	$15.000 / 1M	$15.000 / 1M
Jumla ya tokeni za ingizo	26,449	108,641
Tokeni za matokeo	4,183	8,339
Tokeni za hoja	176,623	0
Muda wa majibu (wastani)	98.92s	2.08s
Muda wa majibu (upeo)	587.08s	15.63s
Muda wa majibu (jumla)	2176.20s	45.75s
Vigezo	~2.8T jumla (~104B vinavyotumika)	~1.5T jumla (~100B vinavyotumika)
Upatikanaji	Imefungwa	Imefungwa

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

max

none

Kategoria:

Mbinu za kupinga AI	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Ember-1	8.7	7.9	91.7%	1		23.74s	1,533	613	1,394
GPT-5.4	3.2	8.0	8.3%	1		1.21s	606	406	0

Uandishi wa msimbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Ember-1	5.2	4.4	55.6%	2		105.09s	3,362	1,149	27,957
GPT-5.4	5.5	10.0	33.3%	0		1.62s	7,305	516	0

Mchanganyiko	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Ember-1	6.5	10.0	50.0%	0		64.37s	12,819	775	4,538
GPT-5.4	3.0	10.0	0.0%	0		9.26s	85,439	6,195	0

Uchanganuzi na uchimbaji wa data	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Ember-1	6.4	5.9	66.7%	1		39.79s	4,285	185	1,182
GPT-5.4	10.0	10.0	100.0%	0		1.04s	7,140	222	0

Mahususi kwa domeni	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Ember-1	3.6	7.2	22.2%	1		471.21s	1,015	84	136,143
GPT-5.4	5.3	7.2	44.4%	1		1.15s	732	68	0

Akili ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Ember-1	10.0	10.0	100.0%	0		7.04s	741	193	716
GPT-5.4	4.4	9.9	0.0%	0		1.78s	477	184	0

Ufuataji wa maagizo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Ember-1	6.2	5.8	66.7%	1		32.97s	777	132	574
GPT-5.4	6.5	10.0	50.0%	0		1.07s	660	81	0

Utatuzi wa mafumbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Ember-1	7.7	10.0	66.7%	0		6.57s	1,443	681	1,368
GPT-5.4	5.6	9.8	33.3%	0		1.44s	642	381	0

Mwito wa zana	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Ember-1	3.0	10.0	0.0%	0		26.36s	0	0	0
GPT-5.4	10.0	10.0	100.0%	0		2.75s	5,445	246	0

Maarifa ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Ember-1	3.0	10.0	0.0%	0		24.95s	474	371	2,751
GPT-5.4	3.0	10.0	0.0%	0		990ms	195	40	0

Badilisha jozi ya ulinganisho