Urambazaji
Advertise here

KAT Coder AIR V2.5 (high) vs Mistral Small 4 (medium)

average score iko karibu sawa: 5.2 vs 5.1. KAT Coder AIR V2.5 (high) ina gharama ya chini ya benchmark: $0.077 vs $0.126. Mistral Small 4 (medium) ni ya haraka zaidi: 12.68s vs 15.23s, na pass rates 40.6% vs 42.0%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-11-13

Modeli zilizolinganishwa

Nafasi
#386
Jumla ya tokeni za matokeo
114,654
Muda wa majibu (wastani)
15.23s
Jumla ya gharama
$0.077
Nafasi
#389
Jumla ya tokeni za matokeo
127,970
Muda wa majibu (wastani)
12.68s
Jumla ya gharama
$0.126
Muundo unaopendekezwa KAT Coder AIR V2.5 (high)

It has the best score here (5.2), while costing about 1.6x less than Mistral Small 4 (medium).

Ulinganisho wa kina

Kipimo KAT Coder AIR V2.5 KAT Coder AIR V2.5 high Toleo: 2026-07-14 Mistral Small 4 Mistral Small 4 medium Toleo: 2026-03-16
Alama 5.2 5.1
Nafasi #386 #389
Uaminifu 9.8 9.7
Uthabiti 8.2 7.1
Majaribio 69/69 69/69
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 40.6% 42.0%
Majaribio yasiyo thabiti 5 8
Jumla ya uendeshaji 69 69
Gharama kwa matokeo 1.091 2.502
Jumla ya gharama $0.077 $0.126
Bei ya ingizo $0.150 / 1M $0.150 / 1M
Bei ya toleo $0.600 / 1M $0.600 / 1M
Bei ya kusoma akiba Haipo $0.015 / 1M
Bei ya kuandika akiba Haipo Haipo
Jumla ya tokeni za ingizo 50,423 321,955
Tokeni za matokeo 4,144 41,555
Tokeni za hoja 110,510 94,946
Muda wa majibu (wastani) 15.23s 12.68s
Muda wa majibu (upeo) 118.35s 59.15s
Muda wa majibu (jumla) 350.26s 291.66s
Vigezo ~35B jumla (~3B vinavyotumika) 119B jumla (6B vinavyotumika)
Upatikanaji Imefungwa Chanzo huria

Bei za akiba zinahusu tokeni za ingizo. Kusoma hutumia tena maelekezo yaliyohifadhiwa; kuandika huyahifadhi na kunaweza kuongeza gharama. Tokeni za matokeo hutumia bei ya matokeo.

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#386 KAT Coder AIR V2.5

high
Reached the allocated time limit (300 seconds) without receiving showcase output.
Gharama
$0.000
Muda
300.0s
Tokeni
0 tok

#389 Mistral Small 4

medium
Gharama
$0.006
Muda
47.9s
Tokeni
9,857 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
KAT Coder AIR V2.5 4.3 7.3 11.1% 1 39.07s 6,948 1,166 55,883
Mistral Small 4 4.4 5.1 33.3% 2 39.98s 7,636 11,635 54,715

Badilisha jozi ya ulinganisho