AI BENCHY Compare

MoonshotAI: Kimi K2.5 vs StepFun: Step 3.7 Flash

Muhtasari

Ulinganisho wa benchmark Kimi K2.5 vs Step 3.7 Flash: Step 3.7 Flash inaongoza kwa average score: 7.7 vs 7.5. Kimi K2.5 ina gharama ya chini ya benchmark: $0.328 vs $0.341. Step 3.7 Flash ni ya haraka zaidi: 15.74s vs 98.43s, na pass rates 68.3% vs 68.3%.

Muundo unaopendekezwa: Step 3.7 Flash - It has the best score here (7.7), while responding about 6.3x faster than Kimi K2.5.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-06-12

Kipimo	Kimi K2.5 Kimi K2.5 medium Toleo: 2026-01-27	Step 3.7 Flash Step 3.7 Flash low Toleo: 2026-05-29

Kipimo	Kimi K2.5 Kimi K2.5 medium Toleo: 2026-01-27	Step 3.7 Flash Step 3.7 Flash low Toleo: 2026-05-29
Alama	7.5	7.7
Nafasi	#45	#42
Uaminifu	10.0	10.0
Uthabiti	6.9	8.4
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio	68.3%	68.3%
Majaribio yasiyo thabiti	8	4
Jumla ya uendeshaji	63	63
Gharama kwa matokeo	3.704	2.840
Jumla ya gharama	$0.328	$0.341
Bei ya ingizo	$0.400 / 1M	$0.200 / 1M
Bei ya toleo	$1.900 / 1M	$1.150 / 1M
Jumla ya tokeni za ingizo	34,312	40,101
Tokeni za matokeo	48,379	289,325
Tokeni za hoja	157,747	0
Muda wa majibu (wastani)	98.43s	15.74s
Muda wa majibu (upeo)	281.00s	124.75s
Muda wa majibu (jumla)	1378.03s	330.63s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#45 MoonshotAI: Kimi K2.5

medium

Cost: $0.030
Time: 58.6s
Tokens: 8,683 tok

#42 Step 3.7 Flash

low

Invalid SVG

Cost: $0.004
Time: 25.3s
Tokens: 3,072 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Kimi K2.5	7.3	5.8	83.3%	2		51.38s	634	2,789	8,880
Step 3.7 Flash	8.7	7.9	91.7%	1		4.02s	756	10,896	0

Uandishi wa msimbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Kimi K2.5	6.1	4.6	66.7%	2		217.49s	6,935	5,705	74,693
Step 3.7 Flash	8.2	7.2	88.9%	1		9.46s	7,437	18,685	0

Mchanganyiko	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Kimi K2.5	10.0	10.0	100.0%	0		71.37s	11,280	703	3,713
Step 3.7 Flash	10.0	10.0	100.0%	0		7.98s	13,683	6,426	0

Uchanganuzi na uchimbaji wa data	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Kimi K2.5	10.0	10.0	100.0%	0		49.78s	7,020	563	7,940
Step 3.7 Flash	7.3	5.8	83.3%	1		2.29s	7,398	2,667	0

Mahususi kwa domeni	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Kimi K2.5	3.5	4.4	33.3%	2		137.29s	485	20,753	30,564
Step 3.7 Flash	5.3	7.2	44.4%	1		43.31s	828	104,487	0

Akili ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Kimi K2.5	6.5	3.4	66.7%	1		69.73s	480	3,815	4,262
Step 3.7 Flash	3.4	9.3	0.0%	0		7.00s	525	4,604	0

Ufuataji wa maagizo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Kimi K2.5	10.0	10.0	100.0%	0		92.47s	675	5,371	6,547
Step 3.7 Flash	9.8	10.0	100.0%	0		1.58s	735	1,857	0

Utatuzi wa mafumbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Kimi K2.5	5.3	7.3	44.4%	1		43.23s	659	8,426	12,692
Step 3.7 Flash	5.5	9.9	33.3%	0		1.84s	756	3,564	0

Mwito wa zana	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Kimi K2.5	10.0	10.0	100.0%	0		31.74s	5,933	242	812
Step 3.7 Flash	10.0	10.0	100.0%	0		3.25s	7,746	1,360	0

Maarifa ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Kimi K2.5	3.0	10.0	0.0%	0		83.95s	211	12	7,644
Step 3.7 Flash	3.0	10.0	0.0%	0		124.75s	237	134,779	0

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho