Urambazaji
Advertise here

Mercury 2 (medium) vs Qwen3.6 35B A3B (medium)

Mercury 2 (medium) inaongoza kwa average score: 6.6 vs 6.5. Mercury 2 (medium) ina gharama ya chini ya benchmark: $0.121 vs $0.834. Mercury 2 (medium) ni ya haraka zaidi: 4.40s vs 59.92s, na pass rates 53.6% vs 58.0%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-10-17

Modeli zilizolinganishwa

Nafasi
#218
Jumla ya tokeni za matokeo
96,943
Muda wa majibu (wastani)
4.40s
Jumla ya gharama
$0.121
Nafasi
#223
Jumla ya tokeni za matokeo
769,570
Muda wa majibu (wastani)
59.92s
Jumla ya gharama
$0.834
Muundo unaopendekezwa Mercury 2 (medium)

It has the best score here (6.6), while costing about 6.9x less than Qwen3.6 35B A3B (medium).

Ulinganisho wa kina

Kipimo Mercury 2 Mercury 2 medium Toleo: 2026-02-24 Qwen3.6 35B A3B Qwen3.6 35B A3B medium Toleo: 2026-04-20
Alama 6.6 6.5
Nafasi #218 #223
Uaminifu 10.0 10.0
Uthabiti 8.1 9.0
Majaribio 69/69 69/69
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 53.6% 58.0%
Majaribio yasiyo thabiti 5 3
Jumla ya uendeshaji 69 69
Gharama kwa matokeo 1.201 6.732
Jumla ya gharama $0.121 $0.834
Bei ya ingizo $0.250 / 1M $0.150 / 1M
Bei ya toleo $0.750 / 1M $1.000 / 1M
Bei ya kusoma akiba $0.025 / 1M $0.050 / 1M
Bei ya kuandika akiba Haipo Haipo
Jumla ya tokeni za ingizo 189,300 282,192
Tokeni za matokeo 10,854 75,306
Tokeni za hoja 86,089 700,868
Muda wa majibu (wastani) 4.40s 59.92s
Muda wa majibu (upeo) 34.92s 817.57s
Muda wa majibu (jumla) 96.81s 1258.32s
Vigezo ~100B 35B jumla (3B vinavyotumika)
Upatikanaji Imefungwa Chanzo huria

Bei za akiba zinahusu tokeni za ingizo. Kusoma hutumia tena maelekezo yaliyohifadhiwa; kuandika huyahifadhi na kunaweza kuongeza gharama. Tokeni za matokeo hutumia bei ya matokeo.

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#218 Mercury 2

medium
Gharama
$0.002
Muda
2.1s
Tokeni
1,702 tok

#223 Qwen3.6 35B A3B

medium
Reached the allocated time limit (300 seconds) without receiving showcase output.
Gharama
$0.000
Muda
300.0s
Tokeni
0 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Mercury 2 8.2 7.7 77.8% 1 2.04s 7,065 296 11,328
Qwen3.6 35B A3B 7.7 10.0 66.7% 0 50.55s 5,051 7,929 37,223

Badilisha jozi ya ulinganisho