Urambazaji
Advertise here

Ember-1 (max) vs Qwen3.5-35B-A3B

average score iko karibu sawa: 5.9 vs 5.9. Qwen3.5-35B-A3B ina gharama ya chini ya benchmark: $0.135 vs $2.792. Qwen3.5-35B-A3B ni ya haraka zaidi: 12.73s vs 98.92s, na pass rates 57.6% vs 39.4%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-09-28

Modeli zilizolinganishwa

Nafasi
#248
Jumla ya tokeni za matokeo
180,806
Muda wa majibu (wastani)
98.92s
Jumla ya gharama
$2.792
Nafasi
#244
Jumla ya tokeni za matokeo
86,616
Muda wa majibu (wastani)
12.73s
Jumla ya gharama
$0.135
Muundo unaopendekezwa Qwen3.5-35B-A3B

It has the best score here (5.9), while costing about 20.8x less than Ember-1 (max).

Ulinganisho wa kina

Kipimo Ember-1 Ember-1 max Toleo: 2026-09-28 Qwen3.5-35B-A3B Qwen3.5-35B-A3B none Toleo: 2026-02-24
Alama 5.9 5.9
Nafasi #248 #244
Uaminifu 7.5 10.0
Uthabiti 7.7 8.6
Majaribio 66/66 66/66
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 57.6% 39.4%
Majaribio yasiyo thabiti 6 4
Jumla ya uendeshaji 66 66
Gharama kwa matokeo 27.915 1.841
Jumla ya gharama $2.792 $0.135
Bei ya ingizo $3.000 / 1M $0.163 / 1M
Bei ya toleo $15.000 / 1M $1.300 / 1M
Jumla ya tokeni za ingizo 26,449 134,530
Tokeni za matokeo 4,183 86,616
Tokeni za hoja 176,623 0
Muda wa majibu (wastani) 98.92s 12.73s
Muda wa majibu (upeo) 587.08s 209.15s
Muda wa majibu (jumla) 2176.20s 279.97s
Vigezo ~2.8T jumla (~104B vinavyotumika) 35B jumla (3B vinavyotumika)
Upatikanaji Imefungwa Chanzo huria

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#248 Ember-1

max
Gharama
$0.163
Muda
229.4s
Tokeni
11,002 tok

#244 Qwen3.5-35B-A3B

none
Gharama
$0.005
Muda
28.4s
Tokeni
4,518 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Ember-1 5.2 4.4 55.6% 2 105.09s 3,362 1,149 27,957
Qwen3.5-35B-A3B 5.5 10.0 33.3% 0 1.39s 7,808 571 0

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho