Urambazaji
Advertise here

Granite 4.2 8B (high) vs Mercury 2.5 Preview (default)

average score iko karibu sawa: 4.7 vs 4.7. Mercury 2.5 Preview (default) ina gharama ya chini ya benchmark: $0.023 vs $0.111. Mercury 2.5 Preview (default) ni ya haraka zaidi: 7.05s vs 235.35s, na pass rates 37.7% vs 29.0%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-11-16

Modeli zilizolinganishwa

Nafasi
#423
Jumla ya tokeni za matokeo
576,052
Muda wa majibu (wastani)
235.35s
Jumla ya gharama
$0.111
Nafasi
#419
Jumla ya tokeni za matokeo
86,367
Muda wa majibu (wastani)
7.05s
Jumla ya gharama
$0.023
Muundo unaopendekezwa Mercury 2.5 Preview (default)

It has the best score here (4.7), while costing about 4.8x less than Granite 4.2 8B (high).

Ulinganisho wa kina

Kipimo Granite 4.2 8B Granite 4.2 8B high Toleo: 2026-09-02 Mercury 2.5 Preview Mercury 2.5 Preview default Toleo: 2026-09-02
Alama 4.7 4.7
Nafasi #423 #419
Uaminifu 8.2 9.9
Uthabiti 6.4 8.3
Majaribio 69/69 69/69
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 37.7% 29.0%
Majaribio yasiyo thabiti 10 5
Jumla ya uendeshaji 69 69
Gharama kwa matokeo 2.751 0.559
Jumla ya gharama $0.111 $0.023
Bei ya ingizo $0.060 / 1M $0.040 / 1M
Bei ya toleo $0.250 / 1M $0.150 / 1M
Bei ya kusoma akiba $0.015 / 1M Haipo
Bei ya kuandika akiba Haipo Haipo
Jumla ya tokeni za ingizo 282,658 250,541
Tokeni za matokeo 198,563 86,367
Tokeni za hoja 462,804 0
Muda wa majibu (wastani) 235.35s 7.05s
Muda wa majibu (upeo) 685.87s 84.96s
Muda wa majibu (jumla) 5413.09s 162.25s
Vigezo 8B ~100B
Upatikanaji Chanzo huria Imefungwa

Bei za akiba zinahusu tokeni za ingizo. Kusoma hutumia tena maelekezo yaliyohifadhiwa; kuandika huyahifadhi na kunaweza kuongeza gharama. Tokeni za matokeo hutumia bei ya matokeo.

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#423 IBM: Granite 4.2 8B

high
Provider returned error
Gharama
$0.000
Muda
0.2s
Tokeni
0 tok

#419 Mercury 2.5 Preview

default
SVG batili
Gharama
$0.001
Muda
3.3s
Tokeni
3,122 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Granite 4.2 8B 3.8 4.3 33.3% 2 515.34s 7,047 42,438 154,749
Mercury 2.5 Preview 4.7 7.9 22.2% 1 459ms 7,850 650 0

Badilisha jozi ya ulinganisho