Urambazaji
Advertise here

Claude Haiku 5.5 (low) vs Gemma 4 26B A4B (medium)

Claude Haiku 5.5 (low) inaongoza kwa average score: 8.6 vs 7.3. Claude Haiku 5.5 (low) ina gharama ya chini ya benchmark: $0.061 vs $0.101. Claude Haiku 5.5 (low) ni ya haraka zaidi: 7.51s vs 105.03s, na pass rates 76.8% vs 71.0%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-11-17

Modeli zilizolinganishwa

Nafasi
#115
Jumla ya tokeni za matokeo
61,650
Muda wa majibu (wastani)
7.51s
Jumla ya gharama
$0.061
Nafasi
#211
Jumla ya tokeni za matokeo
269,351
Muda wa majibu (wastani)
105.03s
Jumla ya gharama
$0.101
Muundo unaopendekezwa Claude Haiku 5.5 (low)

It has the best score here (8.6), while costing about 1.7x less than Gemma 4 26B A4B (medium).

Ulinganisho wa kina

Kipimo Claude Haiku 5.5 Claude Haiku 5.5 low Toleo: 2026-10-07 Gemma 4 26B A4B Gemma 4 26B A4B medium Toleo: 2026-04-03 Inapatikana bure
Alama 8.6 7.3
Nafasi #115 #211
Uaminifu 10.0 10.0
Uthabiti 8.9 9.6
Majaribio 69/69 69/69
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 76.8% 71.0%
Majaribio yasiyo thabiti 3 1
Jumla ya uendeshaji 69 69
Gharama kwa matokeo 0.378 0.679
Jumla ya gharama $0.061 $0.101
Bei ya ingizo $0.100 / 1M $0.090 / 1M
Bei ya toleo $0.500 / 1M $0.300 / 1M
Bei ya kusoma akiba $0.010 / 1M $0.050 / 1M
Bei ya kuandika akiba $0.125 / 1M Haipo
Jumla ya tokeni za ingizo 296,301 224,367
Tokeni za matokeo 10,672 27,095
Tokeni za hoja 50,978 242,256
Muda wa majibu (wastani) 7.51s 105.03s
Muda wa majibu (upeo) 44.43s 912.19s
Muda wa majibu (jumla) 172.74s 2310.63s
Vigezo ~50B 25.2B jumla (3.8B vinavyotumika)
Upatikanaji Imefungwa Chanzo huria

Bei za akiba zinahusu tokeni za ingizo. Kusoma hutumia tena maelekezo yaliyohifadhiwa; kuandika huyahifadhi na kunaweza kuongeza gharama. Tokeni za matokeo hutumia bei ya matokeo.

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#115 Claude Haiku 5.5

low
Gharama
$0.001
Muda
7.4s
Tokeni
1,851 tok

#211 Gemma 4 26B A4B

medium
Reached the allocated time limit (300 seconds) without receiving showcase output.
Gharama
$0.000
Muda
300.0s
Tokeni
0 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Claude Haiku 5.5 7.9 7.5 77.8% 1 7.30s 10,608 531 11,618
Gemma 4 26B A4B 2.9 10.0 0.0% 0 272.54s 5,062 14,838 44,567

Badilisha jozi ya ulinganisho