Urambazaji
Advertise here

Ember-1 (max) vs Qwen3.7 Flash (medium)

Ember-1 (max) inaongoza kwa average score: 6.7 vs 6.6. Qwen3.7 Flash (medium) ina gharama ya chini ya benchmark: $0.076 vs $3.264. Qwen3.7 Flash (medium) ni ya haraka zaidi: 51.80s vs 97.34s, na pass rates 59.4% vs 62.3%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-10-01

Modeli zilizolinganishwa

Nafasi
#181
Jumla ya tokeni za matokeo
186,901
Muda wa majibu (wastani)
97.34s
Jumla ya gharama
$3.264
Nafasi
#187
Jumla ya tokeni za matokeo
514,925
Muda wa majibu (wastani)
51.80s
Jumla ya gharama
$0.076
Muundo unaopendekezwa Qwen3.7 Flash (medium)

Its score stays close to the best score here (6.6 vs 6.7), while costing about 43.0x less than Ember-1 (max).

Ulinganisho wa kina

Kipimo Ember-1 Ember-1 max Toleo: 2026-09-28 Qwen3.7 Flash Qwen3.7 Flash medium Toleo: 2026-07-28
Alama 6.7 6.6
Nafasi #181 #187
Uaminifu 8.3 10.0
Uthabiti 7.8 7.3
Majaribio 69/69 69/69
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 59.4% 62.3%
Majaribio yasiyo thabiti 6 8
Jumla ya uendeshaji 69 69
Gharama kwa matokeo 29.671 0.760
Jumla ya gharama $3.264 $0.076
Bei ya ingizo $3.000 / 1M $0.030 / 1M
Bei ya toleo $15.000 / 1M $0.130 / 1M
Jumla ya tokeni za ingizo 153,399 300,394
Tokeni za matokeo 7,803 14,081
Tokeni za hoja 179,098 500,844
Muda wa majibu (wastani) 97.34s 51.80s
Muda wa majibu (upeo) 587.08s 593.64s
Muda wa majibu (jumla) 2238.73s 1191.42s
Vigezo ~2.8T jumla (~104B vinavyotumika) ~35B jumla (~3B vinavyotumika)
Upatikanaji Imefungwa Imefungwa

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#181 Ember-1

max
Gharama
$0.163
Muda
229.4s
Tokeni
11,002 tok

#187 Qwen3.7 Flash

medium
Reached the allocated time limit (600 seconds) without receiving showcase output.
Gharama
$0.000
Muda
600.0s
Tokeni
0 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Ember-1 5.2 4.4 55.6% 2 105.09s 3,362 1,149 27,957
Qwen3.7 Flash 6.2 6.9 55.6% 1 46.78s 7,893 563 61,902

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho