Urambazaji
Advertise here

Mercury 2.5 (low) vs Qwen3.5-9B

average score iko karibu sawa: 5.1 vs 5.1. Mercury 2.5 (low) ina gharama ya chini ya benchmark: $0.011 vs $0.021. Mercury 2.5 (low) ni ya haraka zaidi: 1.35s vs 19.19s, na pass rates 39.4% vs 19.7%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-09-08

Modeli zilizolinganishwa

Nafasi
#265
Jumla ya tokeni za matokeo
33,719
Muda wa majibu (wastani)
1.35s
Jumla ya gharama
$0.011
Nafasi
#267
Jumla ya tokeni za matokeo
37,484
Muda wa majibu (wastani)
19.19s
Jumla ya gharama
$0.021
Muundo unaopendekezwa Mercury 2.5 (low)

It has the best score here (5.1), while costing about 1.9x less than Qwen3.5-9B.

Ulinganisho wa kina

Kipimo Mercury 2.5 Mercury 2.5 low Toleo: 2026-09-08 Qwen3.5-9B Qwen3.5-9B none Toleo: 2026-03-02
Alama 5.1 5.1
Nafasi #265 #267
Uaminifu 9.8 10.0
Uthabiti 8.1 9.7
Majaribio 66/66 66/66
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 39.4% 19.7%
Majaribio yasiyo thabiti 5 1
Jumla ya uendeshaji 66 66
Gharama kwa matokeo 0.177 0.490
Jumla ya gharama $0.011 $0.021
Bei ya ingizo $0.040 / 1M $0.100 / 1M
Bei ya toleo $0.150 / 1M $0.150 / 1M
Jumla ya tokeni za ingizo 138,020 144,416
Tokeni za matokeo 6,083 37,484
Tokeni za hoja 27,636 0
Muda wa majibu (wastani) 1.35s 19.19s
Muda wa majibu (upeo) 7.48s 382.06s
Muda wa majibu (jumla) 29.74s 422.25s
Vigezo ~100B 9B
Upatikanaji Imefungwa Chanzo huria

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#265 Mercury 2.5

low
Gharama
$0.001
Muda
2.4s
Tokeni
1,236 tok

#267 Qwen3.5-9B

none
Reached the allocated time limit (300 seconds) without receiving showcase output.
Gharama
$0.000
Muda
300.0s
Tokeni
0 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Mercury 2.5 5.5 10.0 33.3% 0 972ms 7,909 521 2,269
Qwen3.5-9B 3.9 7.8 11.1% 1 5.60s 7,913 1,042 0

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho