Urambazaji
Advertise here

ERNIE-Light-DT-1.0 (low) vs Muse Ember (minimal)

Muse Ember (minimal) inaongoza kwa average score: 8.9 vs 6.4. Muse Ember (minimal) ina gharama ya chini ya benchmark: $0.047 vs $0.489. Muse Ember (minimal) ni ya haraka zaidi: 5.30s vs 8.91s, na pass rates 65.2% vs 76.8%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-11-13

Modeli zilizolinganishwa

Nafasi
#288
Jumla ya tokeni za matokeo
43,895
Muda wa majibu (wastani)
8.91s
Jumla ya gharama
$0.489
Nafasi
#76
Jumla ya tokeni za matokeo
40,577
Muda wa majibu (wastani)
5.30s
Jumla ya gharama
$0.047
Muundo unaopendekezwa Muse Ember (minimal)

It has the best score here (8.9), while costing about 10.4x less than ERNIE-Light-DT-1.0 (low).

Ulinganisho wa kina

Kipimo ERNIE-Light-DT-1.0 ERNIE-Light-DT-1.0 low Toleo: 2026-11-12 Muse Ember Muse Ember minimal Toleo: 2026-11-09
Alama 6.4 8.9
Nafasi #288 #76
Uaminifu 9.3 9.7
Uthabiti 7.0 9.6
Majaribio 69/69 69/69
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 65.2% 76.8%
Majaribio yasiyo thabiti 9 1
Jumla ya uendeshaji 69 69
Gharama kwa matokeo 4.441 0.276
Jumla ya gharama $0.489 $0.047
Bei ya ingizo $1.130 / 1M $0.100 / 1M
Bei ya toleo $3.941 / 1M $0.500 / 1M
Bei ya kusoma akiba $0.113 / 1M $0.004 / 1M
Bei ya kuandika akiba Haipo $0.125 / 1M
Jumla ya tokeni za ingizo 279,234 265,844
Tokeni za matokeo 13,328 10,584
Tokeni za hoja 30,567 29,993
Muda wa majibu (wastani) 8.91s 5.30s
Muda wa majibu (upeo) 96.92s 48.15s
Muda wa majibu (jumla) 204.98s 121.82s
Vigezo ~320B jumla (~18B vinavyotumika) ~150B jumla (~10B vinavyotumika)
Upatikanaji Imefungwa Imefungwa

Bei za akiba zinahusu tokeni za ingizo. Kusoma hutumia tena maelekezo yaliyohifadhiwa; kuandika huyahifadhi na kunaweza kuongeza gharama. Tokeni za matokeo hutumia bei ya matokeo.

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#288 ERNIE-Light-DT-1.0

low
Gharama
$0.005
Muda
7.7s
Tokeni
1,177 tok

#76 Muse Ember

minimal
Gharama
$0.002
Muda
4.5s
Tokeni
2,690 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
ERNIE-Light-DT-1.0 5.7 4.8 55.6% 2 5.33s 7,317 468 4,231
Muse Ember 10.0 10.0 100.0% 0 2.66s 7,410 577 6,099

Badilisha jozi ya ulinganisho