AI BENCHY Compare

Kwaipilot: KAT-Coder-Air V2.5 vs Mistral: Mistral Small 4

Muhtasari

Mistral Small 4 (medium) inaongoza kwa average score: 5.1 vs 4.9. KAT-Coder-Air V2.5 ina gharama ya chini ya benchmark: $0.037 vs $0.068. KAT-Coder-Air V2.5 ni ya haraka zaidi: 6.99s vs 9.40s, na pass rates 38.1% vs 44.4%.

Muundo unaopendekezwaMistral Small 4 (medium)It has the strongest score in this comparison (5.1) and the best overall balance of cost and response time across all 2 models.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-07-14

Kipimo	KAT-Coder-Air V2.5 KAT-Coder-Air V2.5 none Toleo: 2026-07-14	Mistral Small 4 Mistral Small 4 medium Toleo: 2026-03-16

Kipimo	KAT-Coder-Air V2.5 KAT-Coder-Air V2.5 none Toleo: 2026-07-14	Mistral Small 4 Mistral Small 4 medium Toleo: 2026-03-16
Alama	4.9	5.1
Nafasi	#168	#160
Uaminifu	10.0	10.0
Uthabiti	7.1	6.9
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio	38.1%	44.4%
Majaribio yasiyo thabiti	7	8
Jumla ya uendeshaji	63	63
Gharama kwa matokeo	0.724	1.344
Jumla ya gharama	$0.037	$0.068
Bei ya ingizo	$0.150 / 1M	$0.150 / 1M
Bei ya toleo	$0.600 / 1M	$0.600 / 1M
Jumla ya tokeni za ingizo	41,328	42,576
Tokeni za matokeo	49,933	24,184
Tokeni za hoja	0	84,678
Muda wa majibu (wastani)	6.99s	9.40s
Muda wa majibu (upeo)	24.94s	59.15s
Muda wa majibu (jumla)	146.78s	197.39s

Onyesho la kizazi

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#168 KAT-Coder-Air V2.5

none

Gharama: $0.002
Muda: 14.5s
Tokeni: 2,619 tok

#160 Mistral Small 4

medium

Gharama: $0.006
Muda: 47.9s
Tokeni: 9,857 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Kategoria:

Mbinu za kupinga AI	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Air V2.5	5.3	5.6	50.0%	2		2.68s	672	3,044	0
Mistral Small 4	5.6	3.8	66.7%	3		2.67s	708	4,055	4,778

Uandishi wa msimbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Air V2.5	3.3	9.6	0.0%	0		14.31s	6,472	16,918	0
Mistral Small 4	4.4	5.1	33.3%	2		39.98s	7,636	11,635	54,715

Mchanganyiko	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Air V2.5	4.7	1.6	66.7%	1		24.94s	15,131	6,788	0
Mistral Small 4	3.0	10.0	0.0%	0		25.25s	18,706	2,612	10,700

Uchanganuzi na uchimbaji wa data	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Air V2.5	6.3	5.8	66.7%	1		2.66s	7,776	1,268	0
Mistral Small 4	7.3	5.9	83.3%	1		1.23s	6,171	335	723

Mahususi kwa domeni	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Air V2.5	2.9	7.2	11.1%	1		6.24s	771	7,818	0
Mistral Small 4	5.3	7.2	44.4%	1		6.11s	742	2,621	6,904

Akili ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Air V2.5	5.0	10.0	0.0%	0		12.02s	516	656	0
Mistral Small 4	4.8	10.0	0.0%	0		2.05s	519	821	828

Ufuataji wa maagizo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Air V2.5	9.9	10.0	100.0%	0		1.75s	699	858	0
Mistral Small 4	7.3	5.8	83.3%	1		1.38s	729	540	1,031

Utatuzi wa mafumbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Air V2.5	2.9	4.4	22.2%	2		1.84s	696	1,255	0
Mistral Small 4	3.4	9.7	0.0%	0		2.17s	735	1,226	2,632

Mwito wa zana	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Air V2.5	10.0	10.0	100.0%	0		5.13s	8,391	1,560	0
Mistral Small 4	10.0	10.0	100.0%	0		3.50s	6,420	321	810

Maarifa ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Air V2.5	3.0	10.0	0.0%	0		17.96s	204	9,768	0
Mistral Small 4	3.0	10.0	0.0%	0		5.92s	210	18	1,557

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

North Mini CodenoneInapatikana burevsMistral Small 4medium Mistral Small 4mediumvsMiMo-V2.5none Mistral Small 4mediumvsQwen3.5-9Bnone CobuddymediumvsKAT-Coder-Air V2.5none Mistral Small 4mediumvsQwen3 Coder Nextnone Mistral Small 4mediumvsQwen3.6 35B A3Bnone Trinity Large PreviewnonevsMistral Small 4medium Mistral Small 4mediumvsGPT-4o-mininone DeepSeek V3.2nonevsMistral Small 4medium Mistral Small 4mediumvsQwen3.5-122B-A10Bnone Mistral Small 4mediumvsGPT-5.4 Mininone KAT-Coder-Air V2.5nonevsMiniMax M2.5medium