Ember-1 (high) vs Grok 4.20 (medium)

Modeli zilizolinganishwa

Muundo unaopendekezwa Grok 4.20 (medium)

Its score stays close to the best score here (7.0 vs 7.1), while costing about 2.2x less than Ember-1 (high).

Kipimo	Ember-1 Ember-1 high Toleo: 2026-09-28	Grok 4.20 Grok 4.20 medium Toleo: 2026-03-31

Kipimo	Ember-1 Ember-1 high Toleo: 2026-09-28	Grok 4.20 Grok 4.20 medium Toleo: 2026-03-31
Alama	7.1	7.0
Nafasi	#158	#167
Uaminifu	8.0	10.0
Uthabiti	7.3	8.2
Majaribio	66/66	66/66
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio	71.2%	60.6%
Majaribio yasiyo thabiti	7	5
Jumla ya uendeshaji	66	66
Gharama kwa matokeo	14.981	10.365
Jumla ya gharama	$1.798	$0.805
Bei ya ingizo	$3.000 / 1M	$1.250 / 1M
Bei ya toleo	$15.000 / 1M	$2.500 / 1M
Jumla ya tokeni za ingizo	48,577	102,986
Tokeni za matokeo	7,345	5,860
Tokeni za hoja	102,780	264,399
Muda wa majibu (wastani)	56.77s	32.56s
Muda wa majibu (upeo)	255.06s	199.66s
Muda wa majibu (jumla)	1248.88s	716.36s
Vigezo	~2.8T jumla (~104B vinavyotumika)	~1T jumla (~100B vinavyotumika)
Upatikanaji	Imefungwa	Imefungwa

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

high

medium

Kategoria:

Mbinu za kupinga AI	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Ember-1	8.7	7.9	91.7%	1		24.05s	1,544	886	992
Grok 4.20	8.2	7.9	83.3%	1		3.95s	2,010	287	8,312

Uandishi wa msimbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Ember-1	8.2	7.2	88.9%	1		72.23s	7,144	1,281	23,093
Grok 4.20	6.3	6.6	55.6%	1		109.93s	8,307	268	103,150

Mchanganyiko	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Ember-1	6.4	5.8	66.7%	1		79.89s	28,994	1,667	6,614
Grok 4.20	8.7	6.9	83.3%	1		42.25s	71,267	3,776	44,009

Uchanganuzi na uchimbaji wa data	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Ember-1	7.3	5.9	83.3%	1		36.10s	6,076	230	1,228
Grok 4.20	10.0	10.0	100.0%	0		4.17s	7,761	180	5,333

Mahususi kwa domeni	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Ember-1	2.9	4.4	22.2%	2		175.49s	1,154	1,023	61,582
Grok 4.20	2.9	7.2	11.1%	1		49.71s	1,959	872	59,761

Akili ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Ember-1	10.0	10.0	100.0%	0		4.49s	744	194	304
Grok 4.20	3.9	2.6	33.3%	1		24.48s	825	65	6,440

Ufuataji wa maagizo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Ember-1	7.1	5.8	83.3%	1		33.38s	992	162	784
Grok 4.20	9.8	10.0	100.0%	0		4.26s	1,362	57	6,419

Utatuzi wa mafumbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Ember-1	10.0	10.0	100.0%	0		4.84s	1,452	390	848
Grok 4.20	7.7	10.0	66.7%	0		6.22s	1,689	149	7,913

Mwito wa zana	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Ember-1	3.0	10.0	0.0%	0		26.45s	0	0	0
Grok 4.20	3.0	10.0	0.0%	0		13.68s	7,275	197	6,620

Maarifa ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Ember-1	3.0	10.0	0.0%	0		65.34s	477	1,512	7,335
Grok 4.20	3.0	10.0	0.0%	0		63.48s	531	9	16,442

Badilisha jozi ya ulinganisho