Urambazaji
AI BENCHY
Advertise here

KAT-Coder-Air V2.5 (high) vs Inkling Small (low)

Inkling Small (low) inaongoza kwa average score: 5.7 vs 5.6. Inkling Small (low) ina gharama ya chini ya benchmark: $0.059 vs $0.077. Inkling Small (low) ni ya haraka zaidi: 2.08s vs 15.90s, na pass rates 43.9% vs 50.0%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-08-01

Nafasi
#168
Jumla ya tokeni za matokeo
115,331
Muda wa majibu (wastani)
15.90s
Jumla ya gharama
$0.077
Nafasi
#164
Jumla ya tokeni za matokeo
14,653
Muda wa majibu (wastani)
2.08s
Jumla ya gharama
$0.059
Muundo unaopendekezwa Inkling Small (low)

It has the best score here (5.7), while responding about 7.6x faster than KAT-Coder-Air V2.5 (high).

Ulinganisho wa kina

Kipimo KAT-Coder-Air V2.5 KAT-Coder-Air V2.5 high Toleo: 2026-07-14 Inkling Small Inkling Small low Toleo: 2026-08-01
Alama 5.6 5.7
Nafasi #168 #164
Uaminifu 9.9 10.0
Uthabiti 7.7 8.6
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 43.9% 50.0%
Majaribio yasiyo thabiti 6 4
Jumla ya uendeshaji 66 66
Gharama kwa matokeo 1.097 0.648
Jumla ya gharama $0.077 $0.059
Bei ya ingizo $0.150 / 1M $0.500 / 1M
Bei ya toleo $0.600 / 1M $1.200 / 1M
Jumla ya tokeni za ingizo 50,470 81,438
Tokeni za matokeo 3,957 2,715
Tokeni za hoja 111,374 11,938
Muda wa majibu (wastani) 15.90s 2.08s
Muda wa majibu (upeo) 118.35s 5.82s
Muda wa majibu (jumla) 349.71s 45.87s

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#168 KAT-Coder-Air V2.5

high
SVG batili
Gharama
$0.000
Muda
300.0s
Tokeni
0 tok

#164 Thinking Machines: Inkling Small

low
Gharama
$0.001
Muda
5.9s
Tokeni
759 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
KAT-Coder-Air V2.5 4.3 7.3 11.1% 1 39.07s 6,948 1,166 55,883
Inkling Small 4.6 5.0 33.3% 2 3.70s 7,374 375 4,332

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho