Urambazaji
Advertise here

Mercury 2.5 (high) vs Grok 4.3 (medium)

average score iko karibu sawa: 7.1 vs 7.0. Mercury 2.5 (high) ina gharama ya chini ya benchmark: $0.031 vs $0.741. Mercury 2.5 (high) ni ya haraka zaidi: 4.32s vs 44.21s, na pass rates 62.1% vs 66.7%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-09-08

Modeli zilizolinganishwa

Nafasi
#134
Jumla ya tokeni za matokeo
174,547
Muda wa majibu (wastani)
4.32s
Jumla ya gharama
$0.031
Nafasi
#135
Jumla ya tokeni za matokeo
225,904
Muda wa majibu (wastani)
44.21s
Jumla ya gharama
$0.741
Muundo unaopendekezwa Mercury 2.5 (high)

It has the best score here (7.1), while costing about 23.9x less than Grok 4.3 (medium).

Ulinganisho wa kina

Kipimo Mercury 2.5 Mercury 2.5 high Toleo: 2026-09-08 Grok 4.3 Grok 4.3 medium Toleo: 2026-05-01
Alama 7.1 7.0
Nafasi #134 #135
Uaminifu 9.7 10.0
Uthabiti 8.6 8.2
Majaribio 66/66 66/66
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 62.1% 66.7%
Majaribio yasiyo thabiti 4 5
Jumla ya uendeshaji 66 66
Gharama kwa matokeo 0.259 6.168
Jumla ya gharama $0.031 $0.741
Bei ya ingizo $0.040 / 1M $1.250 / 1M
Bei ya toleo $0.150 / 1M $2.500 / 1M
Jumla ya tokeni za ingizo 120,068 140,244
Tokeni za matokeo 3,402 13,739
Tokeni za hoja 171,145 212,165
Muda wa majibu (wastani) 4.32s 44.21s
Muda wa majibu (upeo) 23.63s 216.69s
Muda wa majibu (jumla) 95.06s 972.64s
Vigezo ~100B ~1.5T jumla (~150B vinavyotumika)
Upatikanaji Imefungwa Imefungwa

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#134 Mercury 2.5

high
Gharama
$0.001
Muda
3.5s
Tokeni
2,447 tok

#135 SpaceXAI: Grok 4.3

medium
Gharama
$0.009
Muda
19.0s
Tokeni
3,661 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Mercury 2.5 6.4 7.8 44.4% 1 6.58s 7,757 415 44,012
Grok 4.3 5.9 7.7 44.4% 1 41.23s 8,340 1,028 31,226

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho