Urambazaji
Advertise here

Ember-1 (max) vs Grok Build 0.1 (medium)

average score iko karibu sawa: 6.7 vs 6.7. Grok Build 0.1 (medium) ina gharama ya chini ya benchmark: $1.419 vs $3.264. Grok Build 0.1 (medium) ni ya haraka zaidi: 55.13s vs 97.34s, na pass rates 59.4% vs 58.0%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-10-01

Modeli zilizolinganishwa

Nafasi
#181
Jumla ya tokeni za matokeo
186,901
Muda wa majibu (wastani)
97.34s
Jumla ya gharama
$3.264
Nafasi
#176
Jumla ya tokeni za matokeo
529,806
Muda wa majibu (wastani)
55.13s
Jumla ya gharama
$1.419
Muundo unaopendekezwa Grok Build 0.1 (medium)

It has the best score here (6.7), while costing about 2.3x less than Ember-1 (max).

Ulinganisho wa kina

Kipimo Ember-1 Ember-1 max Toleo: 2026-09-28 Grok Build 0.1 Grok Build 0.1 medium Toleo: 2026-05-21
Alama 6.7 6.7
Nafasi #181 #176
Uaminifu 8.3 10.0
Uthabiti 7.8 9.6
Majaribio 69/69 69/69
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 59.4% 58.0%
Majaribio yasiyo thabiti 6 1
Jumla ya uendeshaji 69 69
Gharama kwa matokeo 29.671 10.910
Jumla ya gharama $3.264 $1.419
Bei ya ingizo $3.000 / 1M $1.000 / 1M
Bei ya toleo $15.000 / 1M $2.000 / 1M
Jumla ya tokeni za ingizo 153,399 358,616
Tokeni za matokeo 7,803 9,651
Tokeni za hoja 179,098 520,155
Muda wa majibu (wastani) 97.34s 55.13s
Muda wa majibu (upeo) 587.08s 252.69s
Muda wa majibu (jumla) 2238.73s 1268.10s
Vigezo ~2.8T jumla (~104B vinavyotumika) ~300B jumla (~30B vinavyotumika)
Upatikanaji Imefungwa Imefungwa

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#181 Ember-1

max
Gharama
$0.163
Muda
229.4s
Tokeni
11,002 tok

#176 SpaceXAI: Grok Build 0.1

medium
Gharama
$0.028
Muda
81.3s
Tokeni
14,009 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Ember-1 5.2 4.4 55.6% 2 105.09s 3,362 1,149 27,957
Grok Build 0.1 5.7 9.7 33.3% 0 108.46s 8,304 1,138 161,452

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho