AI BENCHY Compare

Kwaipilot: KAT-Coder-Pro V2.5 vs Qwen: Qwen3.6 27B

Muhtasari

KAT-Coder-Pro V2.5 inaongoza kwa average score: 6.8 vs 6.6. KAT-Coder-Pro V2.5 ina gharama ya chini ya benchmark: $0.220 vs $0.336. KAT-Coder-Pro V2.5 ni ya haraka zaidi: 10.81s vs 59.71s, na pass rates 71.4% vs 60.3%.

Muundo unaopendekezwaKAT-Coder-Pro V2.5It has the best score here (6.8), while costing about 1.5x less than Qwen3.6 27B (medium).

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-07-14

Kipimo	KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 none Toleo: 2026-07-14	Qwen3.6 27B Qwen3.6 27B medium Toleo: 2026-04-20

Kipimo	KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 none Toleo: 2026-07-14	Qwen3.6 27B Qwen3.6 27B medium Toleo: 2026-04-20
Alama	6.8	6.6
Nafasi	#89	#99
Uaminifu	10.0	10.0
Uthabiti	7.3	8.2
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio	71.4%	60.3%
Majaribio yasiyo thabiti	7	5
Jumla ya uendeshaji	63	63
Gharama kwa matokeo	1.992	3.361
Jumla ya gharama	$0.220	$0.336
Bei ya ingizo	$0.740 / 1M	$0.290 / 1M
Bei ya toleo	$2.960 / 1M	$2.400 / 1M
Jumla ya tokeni za ingizo	42,749	39,376
Tokeni za matokeo	63,338	16,189
Tokeni za hoja	0	122,521
Muda wa majibu (wastani)	10.81s	59.71s
Muda wa majibu (upeo)	53.57s	168.22s
Muda wa majibu (jumla)	227.02s	1254.01s

Onyesho la kizazi

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#89 KAT-Coder-Pro V2.5

none

Gharama: $0.010
Muda: 29.0s
Tokeni: 3,439 tok

#99 Qwen3.6 27B

medium

Gharama: $0.009
Muda: 39.6s
Tokeni: 3,090 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Kategoria:

Mbinu za kupinga AI	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	8.7	7.9	91.7%	1		4.58s	672	3,998	0
Qwen3.6 27B	8.3	10.0	75.0%	0		12.62s	453	582	4,311

Uandishi wa msimbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	6.1	4.7	66.7%	2		22.52s	7,893	22,440	0
Qwen3.6 27B	7.7	10.0	66.7%	0		142.99s	5,051	7,968	43,367

Mchanganyiko	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	4.7	1.6	66.7%	1		30.76s	15,131	5,366	0
Qwen3.6 27B	7.0	3.7	66.7%	1		83.07s	15,104	2,088	14,689

Uchanganuzi na uchimbaji wa data	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	10.0	10.0	100.0%	0		5.07s	7,776	2,361	0
Qwen3.6 27B	3.5	1.4	50.0%	2		37.30s	7,778	568	9,404

Mahususi kwa domeni	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	3.6	7.2	22.2%	1		21.64s	771	20,972	0
Qwen3.6 27B	2.9	7.2	11.1%	1		73.38s	662	3,510	20,352

Akili ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	4.8	3.2	33.3%	1		5.16s	516	1,067	0
Qwen3.6 27B	6.5	3.4	66.7%	1		39.53s	516	81	3,045

Ufuataji wa maagizo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	9.8	10.0	100.0%	0		2.61s	699	1,084	0
Qwen3.6 27B	10.0	10.0	100.0%	0		37.96s	699	346	6,548

Utatuzi wa mafumbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	8.2	7.2	88.9%	1		3.03s	696	1,929	0
Qwen3.6 27B	7.7	10.0	66.7%	0		61.14s	696	255	12,044

Mwito wa zana	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	10.0	10.0	100.0%	0		5.93s	8,391	1,103	0
Qwen3.6 27B	10.0	10.0	100.0%	0		16.88s	8,213	390	2,954

Maarifa ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	3.0	10.0	0.0%	0		9.91s	204	3,018	0
Qwen3.6 27B	3.0	10.0	0.0%	0		80.99s	204	401	5,807

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho