Urambazaji
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

KAT Coder AIR V2.5 (high) vs Mistral Small 4 (medium)

average score iko karibu sawa: 5.2 vs 5.1. KAT Coder AIR V2.5 (high) ina gharama ya chini ya benchmark: $0.077 vs $0.126. Mistral Small 4 (medium) ni ya haraka zaidi: 12.68s vs 15.23s, na pass rates 40.6% vs 42.0%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-10-01

Modeli zilizolinganishwa

Nafasi
#288
Jumla ya tokeni za matokeo
114,654
Muda wa majibu (wastani)
15.23s
Jumla ya gharama
$0.077
Nafasi
#291
Jumla ya tokeni za matokeo
136,501
Muda wa majibu (wastani)
12.68s
Jumla ya gharama
$0.126
Muundo unaopendekezwa KAT Coder AIR V2.5 (high)

It has the best score here (5.2), while costing about 1.6x less than Mistral Small 4 (medium).

Ulinganisho wa kina

Kipimo KAT Coder AIR V2.5 KAT Coder AIR V2.5 high Toleo: 2026-07-14 Mistral Small 4 Mistral Small 4 medium Toleo: 2026-03-16
Alama 5.2 5.1
Nafasi #288 #291
Uaminifu 9.8 9.7
Uthabiti 8.2 7.1
Majaribio 69/69 69/69
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 40.6% 42.0%
Majaribio yasiyo thabiti 5 8
Jumla ya uendeshaji 69 69
Gharama kwa matokeo 1.091 2.502
Jumla ya gharama $0.077 $0.126
Bei ya ingizo $0.000 / 1M $0.150 / 1M
Bei ya toleo $0.000 / 1M $0.600 / 1M
Jumla ya tokeni za ingizo 50,423 321,955
Tokeni za matokeo 4,144 41,555
Tokeni za hoja 110,510 94,946
Muda wa majibu (wastani) 15.23s 12.68s
Muda wa majibu (upeo) 118.35s 59.15s
Muda wa majibu (jumla) 350.26s 291.66s
Vigezo ~35B jumla (~3B vinavyotumika) 119B jumla (6B vinavyotumika)
Upatikanaji Imefungwa Chanzo huria

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#288 KAT Coder AIR V2.5

high
Reached the allocated time limit (300 seconds) without receiving showcase output.
Gharama
$0.000
Muda
300.0s
Tokeni
0 tok

#291 Mistral Small 4

medium
Gharama
$0.006
Muda
47.9s
Tokeni
9,857 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
KAT Coder AIR V2.5 4.3 7.3 11.1% 1 39.07s 6,948 1,166 55,883
Mistral Small 4 4.4 5.1 33.3% 2 39.98s 7,636 11,635 54,715

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho