AI BENCHY Compare

Kwaipilot: KAT-Coder-Pro V2.5 vs Z.ai: GLM 5.1

Muhtasari

GLM 5.1 (medium) inaongoza kwa average score: 7.1 vs 6.8. KAT-Coder-Pro V2.5 ina gharama ya chini ya benchmark: $0.220 vs $0.288. KAT-Coder-Pro V2.5 ni ya haraka zaidi: 10.81s vs 33.67s, na pass rates 71.4% vs 68.3%.

Muundo unaopendekezwaKAT-Coder-Pro V2.5Its score stays close to the best score here (6.8 vs 7.1), while responding about 3.1x faster than GLM 5.1 (medium).

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-07-14

Kipimo	KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 none Toleo: 2026-07-14	GLM 5.1 GLM 5.1 medium Toleo: 2026-04-07

Kipimo	KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 none Toleo: 2026-07-14	GLM 5.1 GLM 5.1 medium Toleo: 2026-04-07
Alama	6.8	7.1
Nafasi	#89	#80
Uaminifu	10.0	6.7
Uthabiti	7.3	8.3
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio	71.4%	68.3%
Majaribio yasiyo thabiti	7	4
Jumla ya uendeshaji	63	63
Gharama kwa matokeo	1.992	2.496
Jumla ya gharama	$0.220	$0.288
Bei ya ingizo	$0.740 / 1M	$0.966 / 1M
Bei ya toleo	$2.960 / 1M	$3.036 / 1M
Jumla ya tokeni za ingizo	42,749	32,995
Tokeni za matokeo	63,338	11,655
Tokeni za hoja	0	75,421
Muda wa majibu (wastani)	10.81s	33.67s
Muda wa majibu (upeo)	53.57s	172.60s
Muda wa majibu (jumla)	227.02s	673.41s

Onyesho la kizazi

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#89 KAT-Coder-Pro V2.5

none

Gharama: $0.010
Muda: 29.0s
Tokeni: 3,439 tok

#80 GLM 5.1

medium

SVG batili

Gharama: $0.000
Muda: 300.0s
Tokeni: 0 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Kategoria:

Mbinu za kupinga AI	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	8.7	7.9	91.7%	1		4.58s	672	3,998	0
GLM 5.1	10.0	10.0	100.0%	0		8.31s	555	401	5,122

Uandishi wa msimbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	6.1	4.7	66.7%	2		22.52s	7,893	22,440	0
GLM 5.1	4.6	3.7	44.5%	2		109.63s	5,702	4,871	37,826

Mchanganyiko	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	4.7	1.6	66.7%	1		30.76s	15,131	5,366	0
GLM 5.1	9.5	10.0	100.0%	0		43.11s	17,298	327	4,206

Uchanganuzi na uchimbaji wa data	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	10.0	10.0	100.0%	0		5.07s	7,776	2,361	0
GLM 5.1	10.0	10.0	100.0%	0		9.33s	7,107	991	4,552

Mahususi kwa domeni	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	3.6	7.2	22.2%	1		21.64s	771	20,972	0
GLM 5.1	5.3	10.0	33.3%	0		29.77s	489	969	11,314

Akili ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	4.8	3.2	33.3%	1		5.16s	516	1,067	0
GLM 5.1	10.0	10.0	100.0%	0		20.95s	477	2,875	2,875

Ufuataji wa maagizo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	9.8	10.0	100.0%	0		2.61s	699	1,084	0
GLM 5.1	6.4	5.8	66.7%	1		7.47s	634	204	1,617

Utatuzi wa mafumbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	8.2	7.2	88.9%	1		3.03s	696	1,929	0
GLM 5.1	8.2	7.2	88.9%	1		31.64s	609	935	5,730

Mwito wa zana	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	10.0	10.0	100.0%	0		5.93s	8,391	1,103	0
GLM 5.1	3.0	10.0	0.0%	0		0ms	0	0	0

Maarifa ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	3.0	10.0	0.0%	0		9.91s	204	3,018	0
GLM 5.1	3.0	10.0	0.0%	0		29.40s	124	82	2,179

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

Step 3.7 FlashhighvsGLM 5.1medium Ring-2.6-1TmediumvsKAT-Coder-Pro V2.5none Gemini 3.5 FlashminimalvsKAT-Coder-Pro V2.5none KAT-Coder-Pro V2.5nonevsQwen3.5-Flashmedium KAT-Coder-Pro V2.5nonevsQwen3.6 35B A3Bmedium KAT-Coder-Pro V2.5nonevsMiMo-V2.5medium Qwen3.7 PlusnonevsGLM 5.1medium DeepSeek V4 PrononevsGLM 5.1medium Gemini 3.5 FlashnonevsGLM 5.1medium KAT-Coder-Pro V2.5nonevsgpt-oss-120bmediumInapatikana bure Claude Opus 4.8nonevsGLM 5.1medium KAT-Coder-Pro V2.5nonevsGPT-5 Nanomedium