Urambazaji
Advertise here

Claude Fable 5.1 (low) vs KAT-Coder-Pro V2.5

Claude Fable 5.1 (low) inaongoza kwa average score: 6.2 vs 6.1. KAT-Coder-Pro V2.5 ina gharama ya chini ya benchmark: $0.487 vs $3.395. Claude Fable 5.1 (low) ni ya haraka zaidi: 11.40s vs 24.96s, na pass rates 55.1% vs 68.1%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-10-01

Modeli zilizolinganishwa

Nafasi
#230
Jumla ya tokeni za matokeo
26,073
Muda wa majibu (wastani)
11.40s
Jumla ya gharama
$3.395
Nafasi
#236
Jumla ya tokeni za matokeo
139,572
Muda wa majibu (wastani)
24.96s
Jumla ya gharama
$0.487
Muundo unaopendekezwa KAT-Coder-Pro V2.5

Its score stays close to the best score here (6.1 vs 6.2), while costing about 7.0x less than Claude Fable 5.1 (low).

Ulinganisho wa kina

Kipimo Claude Fable 5.1 Claude Fable 5.1 low Toleo: 2026-09-02 KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 none Toleo: 2026-07-14
Alama 6.2 6.1
Nafasi #230 #236
Uaminifu 10.0 10.0
Uthabiti 8.9 7.1
Majaribio 69/69 69/69
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 55.1% 68.1%
Majaribio yasiyo thabiti 3 8
Jumla ya uendeshaji 69 69
Gharama kwa matokeo 30.862 4.419
Jumla ya gharama $3.395 $0.487
Bei ya ingizo $10.000 / 1M $0.740 / 1M
Bei ya toleo $50.000 / 1M $2.960 / 1M
Jumla ya tokeni za ingizo 209,116 98,508
Tokeni za matokeo 10,031 139,572
Tokeni za hoja 16,042 0
Muda wa majibu (wastani) 11.40s 24.96s
Muda wa majibu (upeo) 34.77s 335.41s
Muda wa majibu (jumla) 262.14s 574.12s
Vigezo ~9.5T jumla (~878B vinavyotumika) ~700B jumla (~72B vinavyotumika)
Upatikanaji Imefungwa Imefungwa

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#230 Claude Fable 5.1

low
Gharama
$0.126
Muda
28.5s
Tokeni
2,652 tok

#236 KAT-Coder-Pro V2.5

none
Gharama
$0.010
Muda
29.0s
Tokeni
3,439 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Claude Fable 5.1 3.4 10.0 0.0% 0 6.75s 10,608 1,753 0
KAT-Coder-Pro V2.5 6.1 4.7 66.7% 2 22.52s 7,893 22,440 0

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho