Urambazaji
AI BENCHY
Advertise here

Mercury 2 vs Qwen3 Coder Next (medium)

Mercury 2 inaongoza kwa average score: 4.7 vs 4.6. Mercury 2 ina gharama ya chini ya benchmark: $0.030 vs $0.034. Mercury 2 ni ya haraka zaidi: 825ms vs 9.07s, na pass rates 24.2% vs 25.8%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-09-03

Nafasi
#281
Jumla ya tokeni za matokeo
9,584
Muda wa majibu (wastani)
825ms
Jumla ya gharama
$0.030
Nafasi
#283
Jumla ya tokeni za matokeo
19,069
Muda wa majibu (wastani)
9.07s
Jumla ya gharama
$0.034
Muundo unaopendekezwa Mercury 2

It has the best score here (4.7), while responding about 11.0x faster than Qwen3 Coder Next (medium).

Ulinganisho wa kina

Kipimo Mercury 2 Mercury 2 none Toleo: 2026-02-24 Qwen3 Coder Next Qwen3 Coder Next medium Toleo: 2026-02-03
Alama 4.7 4.6
Nafasi #281 #283
Uaminifu 10.0 10.0
Uthabiti 9.2 8.6
Majaribio 66/66 66/66
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 24.2% 25.8%
Majaribio yasiyo thabiti 2 4
Jumla ya uendeshaji 66 66
Gharama kwa matokeo 0.740 1.058
Jumla ya gharama $0.030 $0.034
Bei ya ingizo $0.250 / 1M $0.120 / 1M
Bei ya toleo $0.750 / 1M $0.800 / 1M
Jumla ya tokeni za ingizo 89,637 148,203
Tokeni za matokeo 9,584 19,069
Tokeni za hoja 0 0
Muda wa majibu (wastani) 825ms 9.07s
Muda wa majibu (upeo) 4.52s 81.80s
Muda wa majibu (jumla) 18.14s 154.19s
Vigezo ~100B 80B jumla (3B vinavyotumika)
Upatikanaji Imefungwa Chanzo huria

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#281 Mercury 2

none
Gharama
$0.002
Muda
1.8s
Tokeni
1,514 tok

#283 Qwen3 Coder Next

medium
SVG batili
Gharama
$0.000
Muda
300.0s
Tokeni
0 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Mercury 2 3.4 9.6 0.0% 0 1.03s 7,229 3,088 0
Qwen3 Coder Next 3.7 7.2 22.2% 1 924ms 7,185 336 0

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho