Urambazaji
Advertise here

KAT Coder AIR V2.5 (high) vs Mistral Small 4

average score iko karibu sawa: 5.2 vs 5.1. Mistral Small 4 ina gharama ya chini ya benchmark: $0.047 vs $0.077. Mistral Small 4 ni ya haraka zaidi: 3.12s vs 15.23s, na pass rates 40.6% vs 24.6%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-10-01

Modeli zilizolinganishwa

Nafasi
#288
Jumla ya tokeni za matokeo
114,654
Muda wa majibu (wastani)
15.23s
Jumla ya gharama
$0.077
Nafasi
#292
Jumla ya tokeni za matokeo
10,913
Muda wa majibu (wastani)
3.12s
Jumla ya gharama
$0.047
Muundo unaopendekezwa Mistral Small 4

It has the best score here (5.1), while costing about 1.6x less than KAT Coder AIR V2.5 (high).

Ulinganisho wa kina

Kipimo KAT Coder AIR V2.5 KAT Coder AIR V2.5 high Toleo: 2026-07-14 Mistral Small 4 Mistral Small 4 none Toleo: 2026-03-16
Alama 5.2 5.1
Nafasi #288 #292
Uaminifu 9.8 10.0
Uthabiti 8.2 9.6
Majaribio 69/69 69/69
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 40.6% 24.6%
Majaribio yasiyo thabiti 5 1
Jumla ya uendeshaji 69 69
Gharama kwa matokeo 1.091 0.928
Jumla ya gharama $0.077 $0.047
Bei ya ingizo $0.000 / 1M $0.150 / 1M
Bei ya toleo $0.000 / 1M $0.600 / 1M
Jumla ya tokeni za ingizo 50,423 265,602
Tokeni za matokeo 4,144 10,913
Tokeni za hoja 110,510 0
Muda wa majibu (wastani) 15.23s 3.12s
Muda wa majibu (upeo) 118.35s 45.46s
Muda wa majibu (jumla) 350.26s 71.87s
Vigezo ~35B jumla (~3B vinavyotumika) 119B jumla (6B vinavyotumika)
Upatikanaji Imefungwa Chanzo huria

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#288 KAT Coder AIR V2.5

high
Reached the allocated time limit (300 seconds) without receiving showcase output.
Gharama
$0.000
Muda
300.0s
Tokeni
0 tok

#292 Mistral Small 4

none
Gharama
$0.002
Muda
10.4s
Tokeni
2,370 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
KAT Coder AIR V2.5 4.3 7.3 11.1% 1 39.07s 6,948 1,166 55,883
Mistral Small 4 3.7 9.7 0.0% 0 901ms 7,636 619 0

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

Mercury 2.5lowvsMistral Small 4noneKAT Coder AIR V2.5mediumvsMistral Small 4noneLing 3.0 FlashnonevsKAT Coder AIR V2.5highKAT Coder AIR V2.5highvsInkling SmalllowInapatikana bureKAT Coder AIR V2.5highvsMistral Small 4mediumMistral Small 4nonevsNemotron 3.5 LightninghighInapatikana bureMercury 2.5lowvsKAT Coder AIR V2.5highKAT Coder AIR V2.5highvsMiMo-V2.5-PrononeMistral Small 4nonevsLaguna S 2.1mediumInapatikana bureMistral Small 4nonevsInkling SmalllowInapatikana bureKAT Coder AIR V2.5highvsQwen3.6 35B A3BnoneKAT Coder AIR V2.5highvsLaguna XS 2.1noneInapatikana bure