Urambazaji
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Claude Sonnet 5.5 (medium) vs Mercury 2.5 (high)

average score iko karibu sawa: 6.5 vs 6.5. Mercury 2.5 (high) ina gharama ya chini ya benchmark: $0.044 vs $1.100. Mercury 2.5 (high) ni ya haraka zaidi: 7.62s vs 8.03s, na pass rates 40.6% vs 59.4%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-11-13

Modeli zilizolinganishwa

Nafasi
#267
Jumla ya tokeni za matokeo
37,748
Muda wa majibu (wastani)
8.03s
Jumla ya gharama
$1.100
Nafasi
#271
Jumla ya tokeni za matokeo
193,676
Muda wa majibu (wastani)
7.62s
Jumla ya gharama
$0.044
Muundo unaopendekezwa Mercury 2.5 (high)

It has the best score here (6.5), while costing about 25.3x less than Claude Sonnet 5.5 (medium).

Ulinganisho wa kina

Kipimo Claude Sonnet 5.5 Claude Sonnet 5.5 medium Toleo: 2026-09-29 Mercury 2.5 Mercury 2.5 high Toleo: 2026-09-08
Alama 6.5 6.5
Nafasi #267 #271
Uaminifu 10.0 9.8
Uthabiti 9.7 8.7
Majaribio 69/69 69/69
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 40.6% 59.4%
Majaribio yasiyo thabiti 1 4
Jumla ya uendeshaji 69 69
Gharama kwa matokeo 12.221 0.362
Jumla ya gharama $1.100 $0.044
Bei ya ingizo $2.000 / 1M $0.040 / 1M
Bei ya toleo $10.000 / 1M $0.150 / 1M
Bei ya kusoma akiba $0.200 / 1M $0.004 / 1M
Bei ya kuandika akiba $2.500 / 1M Haipo
Jumla ya tokeni za ingizo 361,183 358,562
Tokeni za matokeo 26,609 4,266
Tokeni za hoja 11,139 189,410
Muda wa majibu (wastani) 8.03s 7.62s
Muda wa majibu (upeo) 51.18s 80.30s
Muda wa majibu (jumla) 184.80s 175.36s
Vigezo ~1T jumla (~100B vinavyotumika) ~100B
Upatikanaji Imefungwa Imefungwa

Bei za akiba zinahusu tokeni za ingizo. Kusoma hutumia tena maelekezo yaliyohifadhiwa; kuandika huyahifadhi na kunaweza kuongeza gharama. Tokeni za matokeo hutumia bei ya matokeo.

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#267 Claude Sonnet 5.5

medium
Gharama
$0.024
Muda
17.4s
Tokeni
2,525 tok

#271 Mercury 2.5

high
Gharama
$0.001
Muda
3.5s
Tokeni
2,447 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Claude Sonnet 5.5 3.4 9.7 0.0% 0 6.07s 10,608 6,767 0
Mercury 2.5 6.4 7.8 44.4% 1 6.58s 7,757 415 44,012

Badilisha jozi ya ulinganisho