Urambazaji
Advertise here

Claude Sonnet 5.5 (low) vs Ember-1 (high)

average score iko karibu sawa: 6.9 vs 6.9. Claude Sonnet 5.5 (low) ina gharama ya chini ya benchmark: $0.909 vs $2.405. Claude Sonnet 5.5 (low) ni ya haraka zaidi: 7.46s vs 58.14s, na pass rates 46.4% vs 71.0%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-10-01

Modeli zilizolinganishwa

Nafasi
#166
Jumla ya tokeni za matokeo
32,443
Muda wa majibu (wastani)
7.46s
Jumla ya gharama
$0.909
Nafasi
#163
Jumla ya tokeni za matokeo
121,223
Muda wa majibu (wastani)
58.14s
Jumla ya gharama
$2.405
Muundo unaopendekezwa Claude Sonnet 5.5 (low)

It has the best score here (6.9), while costing about 2.6x less than Ember-1 (high).

Ulinganisho wa kina

Kipimo Claude Sonnet 5.5 Claude Sonnet 5.5 low Toleo: 2026-09-29 Ember-1 Ember-1 high Toleo: 2026-09-28
Alama 6.9 6.9
Nafasi #166 #163
Uaminifu 10.0 8.6
Uthabiti 9.4 7.2
Majaribio 69/69 69/69
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 46.4% 71.0%
Majaribio yasiyo thabiti 2 8
Jumla ya uendeshaji 69 69
Gharama kwa matokeo 9.082 20.041
Jumla ya gharama $0.909 $2.405
Bei ya ingizo $2.000 / 1M $3.000 / 1M
Bei ya toleo $10.000 / 1M $15.000 / 1M
Jumla ya tokeni za ingizo 291,853 195,489
Tokeni za matokeo 24,116 12,475
Tokeni za hoja 8,327 108,748
Muda wa majibu (wastani) 7.46s 58.14s
Muda wa majibu (upeo) 46.61s 255.06s
Muda wa majibu (jumla) 171.47s 1337.19s
Vigezo ~1T jumla (~100B vinavyotumika) ~2.8T jumla (~104B vinavyotumika)
Upatikanaji Imefungwa Imefungwa

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#166 Claude Sonnet 5.5

low
Gharama
$0.020
Muda
15.3s
Tokeni
2,077 tok

#163 Ember-1

high
Gharama
$0.038
Muda
55.1s
Tokeni
2,671 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Claude Sonnet 5.5 3.2 9.7 0.0% 0 5.81s 10,608 5,903 0
Ember-1 8.2 7.2 88.9% 1 72.23s 7,144 1,281 23,093

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho