Urambazaji
Advertise here

Mercury 2.5 Preview (high) vs Beam 1.0 501B A23B (medium)

Beam 1.0 501B A23B (medium) inaongoza kwa average score: 6.6 vs 6.5. Mercury 2.5 Preview (high) ina gharama ya chini ya benchmark: $0.040 vs $0.499. Beam 1.0 501B A23B (medium) ni ya haraka zaidi: 6.27s vs 7.61s, na pass rates 65.2% vs 65.2%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-10-17

Modeli zilizolinganishwa

Nafasi
#224
Jumla ya tokeni za matokeo
180,597
Muda wa majibu (wastani)
7.61s
Jumla ya gharama
$0.040
Nafasi
#220
Jumla ya tokeni za matokeo
98,521
Muda wa majibu (wastani)
6.27s
Jumla ya gharama
$0.499
Muundo unaopendekezwa Mercury 2.5 Preview (high)

Its score stays close to the best score here (6.5 vs 6.6), while costing about 12.8x less than Beam 1.0 501B A23B (medium).

Ulinganisho wa kina

Kipimo Mercury 2.5 Preview Mercury 2.5 Preview high Toleo: 2026-09-02 Beam 1.0 501B A23B Beam 1.0 501B A23B medium Toleo: 2026-10-17
Alama 6.5 6.6
Nafasi #224 #220
Uaminifu 9.9 10.0
Uthabiti 8.0 9.3
Majaribio 69/69 69/69
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 65.2% 65.2%
Majaribio yasiyo thabiti 6 2
Jumla ya uendeshaji 69 69
Gharama kwa matokeo 0.319 3.561
Jumla ya gharama $0.040 $0.499
Bei ya ingizo $0.040 / 1M $1.000 / 1M
Bei ya toleo $0.150 / 1M $3.000 / 1M
Bei ya kusoma akiba Haipo $0.100 / 1M
Bei ya kuandika akiba Haipo Haipo
Jumla ya tokeni za ingizo 298,512 202,937
Tokeni za matokeo 3,178 4,328
Tokeni za hoja 177,419 94,193
Muda wa majibu (wastani) 7.61s 6.27s
Muda wa majibu (upeo) 86.84s 31.55s
Muda wa majibu (jumla) 175.08s 144.28s
Vigezo ~100B 501B jumla (23B vinavyotumika)
Upatikanaji Imefungwa Chanzo huria

Bei za akiba zinahusu tokeni za ingizo. Kusoma hutumia tena maelekezo yaliyohifadhiwa; kuandika huyahifadhi na kunaweza kuongeza gharama. Tokeni za matokeo hutumia bei ya matokeo.

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#224 Mercury 2.5 Preview

high
Gharama
$0.001
Muda
4.5s
Tokeni
3,851 tok

#220 Beam 1.0 501B A23B

medium
Gharama
$0.005
Muda
11.8s
Tokeni
4,267 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Mercury 2.5 Preview 6.7 7.8 55.6% 1 6.13s 7,751 485 42,569
Beam 1.0 501B A23B 10.0 10.0 100.0% 0 11.81s 7,791 440 27,204

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

KAT-Coder-Pro V2.5lowvsBeam 1.0 501B A23BmediumBeam 1.0 501B A23BmediumvsStep 3.7 FlashhighMercury 2.5 PreviewhighvsQwen3.6 35B A3BmediumMercury 2.5 PreviewhighvsBeam 1.0 501B A23BxhighMercury 2.5 PreviewhighvsGLM 5.3lowClaude Sonnet 5.5mediumvsMercury 2.5 PreviewhighMercury 2.5 PreviewhighvsGLM 5.1noneLongCat 2.0lowvsBeam 1.0 501B A23BmediumMercury 2.5 PreviewhighvsGrok 4.3mediumMercury 2.5 PreviewhighvsLaguna XS 2.1mediumInapatikana bureMercury 2.5 PreviewhighvsKAT-Coder-Pro V2.5lowMercury 2.5 PreviewhighvsQwen3.5-122B-A10Bnone