Urambazaji
Advertise here

Claude Fable 5.1 (low) vs Mistral Large 4 (medium)

average score iko karibu sawa: 6.2 vs 6.2. Mistral Large 4 (medium) ina gharama ya chini ya benchmark: $1.456 vs $3.395. Claude Fable 5.1 (low) ni ya haraka zaidi: 11.40s vs 265.03s, na pass rates 55.1% vs 55.1%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-10-06

Modeli zilizolinganishwa

Nafasi
#239
Jumla ya tokeni za matokeo
26,073
Muda wa majibu (wastani)
11.40s
Jumla ya gharama
$3.395
Nafasi
#240
Jumla ya tokeni za matokeo
627,233
Muda wa majibu (wastani)
265.03s
Jumla ya gharama
$1.456
Muundo unaopendekezwa Claude Fable 5.1 (low)

It has the best score here (6.2), while responding about 23.3x faster than Mistral Large 4 (medium).

Ulinganisho wa kina

Kipimo Claude Fable 5.1 Claude Fable 5.1 low Toleo: 2026-09-02 Mistral Large 4 Mistral Large 4 medium Toleo: 2026-10-06
Alama 6.2 6.2
Nafasi #239 #240
Uaminifu 10.0 9.2
Uthabiti 8.9 7.6
Majaribio 69/69 69/69
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 55.1% 55.1%
Majaribio yasiyo thabiti 3 7
Jumla ya uendeshaji 69 69
Gharama kwa matokeo 30.862 16.168
Jumla ya gharama $3.395 $1.456
Bei ya ingizo $10.000 / 1M $0.680 / 1M
Bei ya toleo $50.000 / 1M $2.090 / 1M
Bei ya kusoma akiba $0.250 / 1M $0.070 / 1M
Bei ya kuandika akiba $12.500 / 1M Haipo
Jumla ya tokeni za ingizo 209,116 212,024
Tokeni za matokeo 10,031 166,422
Tokeni za hoja 16,042 562,095
Muda wa majibu (wastani) 11.40s 265.03s
Muda wa majibu (upeo) 34.77s 1760.20s
Muda wa majibu (jumla) 262.14s 6095.69s
Vigezo ~9.5T jumla (~878B vinavyotumika) 1.05T jumla (49B vinavyotumika)
Upatikanaji Imefungwa Imefungwa

Bei za akiba zinahusu tokeni za ingizo. Kusoma hutumia tena maelekezo yaliyohifadhiwa; kuandika huyahifadhi na kunaweza kuongeza gharama. Tokeni za matokeo hutumia bei ya matokeo.

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#239 Claude Fable 5.1

low
Gharama
$0.126
Muda
28.5s
Tokeni
2,652 tok

#240 Mistral Large 4

medium
Gharama
$0.011
Muda
63.4s
Tokeni
5,291 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Claude Fable 5.1 3.4 10.0 0.0% 0 6.75s 10,608 1,753 0
Mistral Large 4 3.4 7.2 22.2% 1 1201.87s 7,189 33,530 303,140

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho