Urambazaji
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Mercury 2.5 Preview (medium) vs Qwen4 Max

Qwen4 Max inaongoza kwa average score: 7.0 vs 6.8. Mercury 2.5 Preview (medium) ina gharama ya chini ya benchmark: $0.039 vs $0.465. Qwen4 Max ni ya haraka zaidi: 6.38s vs 6.66s, na pass rates 66.7% vs 63.8%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-11-16

Modeli zilizolinganishwa

Nafasi
#248
Jumla ya tokeni za matokeo
150,107
Muda wa majibu (wastani)
6.66s
Jumla ya gharama
$0.039
Nafasi
#230
Jumla ya tokeni za matokeo
9,342
Muda wa majibu (wastani)
6.38s
Jumla ya gharama
$0.465
Muundo unaopendekezwa Mercury 2.5 Preview (medium)

Its score stays close to the best score here (6.8 vs 7.0), while costing about 12.1x less than Qwen4 Max.

Ulinganisho wa kina

Kipimo Mercury 2.5 Preview Mercury 2.5 Preview medium Toleo: 2026-09-02 Qwen4 Max Qwen4 Max none Toleo: 2026-11-16
Alama 6.8 7.0
Nafasi #248 #230
Uaminifu 10.0 10.0
Uthabiti 9.6 9.6
Majaribio 69/69 69/69
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 66.7% 63.8%
Majaribio yasiyo thabiti 1 1
Jumla ya uendeshaji 69 69
Gharama kwa matokeo 0.244 3.321
Jumla ya gharama $0.039 $0.465
Bei ya ingizo $0.040 / 1M $1.500 / 1M
Bei ya toleo $0.150 / 1M $4.500 / 1M
Bei ya kusoma akiba Haipo $0.075 / 1M
Bei ya kuandika akiba Haipo $1.875 / 1M
Jumla ya tokeni za ingizo 397,291 281,902
Tokeni za matokeo 6,355 9,342
Tokeni za hoja 143,752 0
Muda wa majibu (wastani) 6.66s 6.38s
Muda wa majibu (upeo) 74.63s 67.27s
Muda wa majibu (jumla) 153.29s 146.64s
Vigezo ~100B ~2.4T jumla (~95B vinavyotumika)
Upatikanaji Imefungwa Imefungwa

Bei za akiba zinahusu tokeni za ingizo. Kusoma hutumia tena maelekezo yaliyohifadhiwa; kuandika huyahifadhi na kunaweza kuongeza gharama. Tokeni za matokeo hutumia bei ya matokeo.

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#248 Mercury 2.5 Preview

medium
Gharama
$0.001
Muda
2.7s
Tokeni
2,241 tok

#230 Qwen4 Max

none
Gharama
$0.027
Muda
123.5s
Tokeni
6,091 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Mercury 2.5 Preview 7.8 10.0 66.7% 0 3.86s 7,839 552 22,126
Qwen4 Max 5.8 10.0 33.3% 0 1.97s 8,010 384 0

Badilisha jozi ya ulinganisho