Urambazaji
Advertise here

Seed-2.0-Code (high) vs Qwen3.8 27B (low)

Qwen3.8 27B (low) inaongoza kwa average score: 7.6 vs 7.5. Qwen3.8 27B (low) ina gharama ya chini ya benchmark: ~$0.089 vs $1.448. Qwen3.8 27B (low) ni ya haraka zaidi: 46.60s vs 124.87s, na pass rates 65.2% vs 68.1%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-10-01

Modeli zilizolinganishwa

Nafasi
#121
Jumla ya tokeni za matokeo
432,850
Muda wa majibu (wastani)
124.87s
Jumla ya gharama
$1.448
Nafasi
#117
Jumla ya tokeni za matokeo
209,143
Muda wa majibu (wastani)
46.60s
Jumla ya gharama
~$0.089
Muundo unaopendekezwa Qwen3.8 27B (low)

It has the best score here (7.6), while costing about 16.4x less than Seed-2.0-Code (high).

Ulinganisho wa kina

Kipimo Seed-2.0-Code Seed-2.0-Code high Toleo: 2026-08-12 Qwen3.8 27B Qwen3.8 27B low Toleo: 2026-08-14 Inapatikana bure
Alama 7.5 7.6
Nafasi #121 #117
Uaminifu 9.0 10.0
Uthabiti 7.9 9.7
Majaribio 69/69 69/69
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 65.2% 68.1%
Majaribio yasiyo thabiti 5 1
Jumla ya uendeshaji 69 69
Gharama kwa matokeo 12.061 ~0.589
Jumla ya gharama $1.448 ~$0.089
Bei ya ingizo $0.500 / 1M Haipo
Bei ya toleo $3.000 / 1M Haipo
Jumla ya tokeni za ingizo 297,321 315,290
Tokeni za matokeo 8,997 1,607
Tokeni za hoja 423,853 207,536
Muda wa majibu (wastani) 124.87s 46.60s
Muda wa majibu (upeo) 675.30s 376.04s
Muda wa majibu (jumla) 2871.96s 1071.83s
Vigezo ~200B jumla (~20B vinavyotumika) 27.3B
Upatikanaji Imefungwa Uzani unapatikana

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#121 Seed-2.0-Code

high
Gharama
$0.037
Muda
183.6s
Tokeni
12,388 tok

#117 Qwen3.8 27B

low
Gharama
~$0.003
Muda
92.8s
Tokeni
6,902 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Seed-2.0-Code 6.2 6.5 55.6% 1 266.74s 6,750 432 124,956
Qwen3.8 27B 7.7 10.0 66.7% 0 140.92s 8,127 585 86,694

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho