AI BENCHY Compare

Kwaipilot: KAT-Coder-Pro V2.5 vs StepFun: Step 3.7 Flash

Muhtasari

Step 3.7 Flash (medium) inaongoza kwa average score: 8.5 vs 8.0. KAT-Coder-Pro V2.5 (low) ina gharama ya chini ya benchmark: $0.220 vs $0.376. KAT-Coder-Pro V2.5 (low) ni ya haraka zaidi: 10.44s vs 20.35s, na pass rates 71.4% vs 73.0%.

Muundo unaopendekezwaKAT-Coder-Pro V2.5 (low)Its score stays close to the best score here (8.0 vs 8.5), while costing about 1.7x less than Step 3.7 Flash (medium).

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-07-14

Kipimo	KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 low Toleo: 2026-07-14	Step 3.7 Flash Step 3.7 Flash medium Toleo: 2026-05-29

Kipimo	KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 low Toleo: 2026-07-14	Step 3.7 Flash Step 3.7 Flash medium Toleo: 2026-05-29
Alama	8.0	8.5
Nafasi	#35	#23
Uaminifu	9.9	9.9
Uthabiti	7.3	9.3
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio	71.4%	73.0%
Majaribio yasiyo thabiti	7	2
Jumla ya uendeshaji	63	61
Gharama kwa matokeo	1.991	2.686
Jumla ya gharama	$0.220	$0.376
Bei ya ingizo	$0.740 / 1M	$0.200 / 1M
Bei ya toleo	$2.960 / 1M	$1.150 / 1M
Jumla ya tokeni za ingizo	42,750	39,981
Tokeni za matokeo	2,167	319,958
Tokeni za hoja	61,133	0
Muda wa majibu (wastani)	10.44s	20.35s
Muda wa majibu (upeo)	51.34s	113.98s
Muda wa majibu (jumla)	219.17s	427.42s

Onyesho la kizazi

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#35 KAT-Coder-Pro V2.5

low

Gharama: $0.016
Muda: 47.6s
Tokeni: 5,182 tok

#23 Step 3.7 Flash

medium

Gharama: $0.006
Muda: 46.2s
Tokeni: 4,466 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Kategoria:

Mbinu za kupinga AI	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	6.9	5.8	75.0%	2		4.20s	672	277	4,228
Step 3.7 Flash	8.7	7.9	91.7%	1		9.65s	756	32,185	0

Uandishi wa msimbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	7.8	10.0	66.7%	0		24.87s	7,893	402	24,945
Step 3.7 Flash	8.8	7.8	88.9%	1		27.42s	7,437	44,797	0

Mchanganyiko	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	10.0	10.0	100.0%	0		14.59s	15,132	394	3,391
Step 3.7 Flash	10.0	10.0	100.0%	0		9.06s	13,683	7,106	0

Uchanganuzi na uchimbaji wa data	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	10.0	10.0	100.0%	0		4.19s	7,776	288	1,917
Step 3.7 Flash	10.0	10.0	100.0%	0		2.75s	7,398	3,020	0

Mahususi kwa domeni	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	4.1	4.4	44.5%	2		17.52s	771	35	16,877
Step 3.7 Flash	7.7	10.0	66.7%	0		48.27s	708	70,347	0

Akili ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	4.1	2.7	33.3%	1		2.32s	516	99	412
Step 3.7 Flash	4.0	10.0	0.0%	0		6.85s	525	3,987	0

Ufuataji wa maagizo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	10.0	10.0	100.0%	0		2.53s	699	83	1,008
Step 3.7 Flash	9.8	10.0	100.0%	0		1.83s	735	2,166	0

Utatuzi wa mafumbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	6.4	4.4	77.8%	2		3.11s	696	289	1,820
Step 3.7 Flash	5.7	9.9	33.3%	0		6.19s	756	15,071	0

Mwito wa zana	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	10.0	10.0	100.0%	0		18.45s	8,391	282	834
Step 3.7 Flash	10.0	10.0	100.0%	0		4.16s	7,746	2,115	0

Maarifa ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Pro V2.5	3.0	10.0	0.0%	0		17.06s	204	18	5,701
Step 3.7 Flash	3.0	10.0	0.0%	0		113.98s	237	139,164	0

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho