AI BENCHY Compare

Mistral: Mistral Small 4 vs StepFun: Step 3.5 Flash

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-04-11

Kipimo	Mistral Small 4 Mistral Small 4 medium Toleo: 2026-03-16	Step 3.5 Flash Step 3.5 Flash none Toleo: 2026-02-01

Kipimo	Mistral Small 4 Mistral Small 4 medium Toleo: 2026-03-16	Step 3.5 Flash Step 3.5 Flash none Toleo: 2026-02-01
Alama	5.7	3.0
Nafasi	#69	#93
Uthabiti	6.8	10.0
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio	50.0%	0.0%
Majaribio yasiyo thabiti	7	0
Jumla ya uendeshaji	54	3
Gharama kwa matokeo	0.674	0.000
Jumla ya gharama	$0.034	$0.000
Bei ya ingizo	$0.150 / 1M	$0.100 / 1M
Bei ya toleo	$0.600 / 1M	$0.300 / 1M
Tokeni za matokeo	15,084	0
Tokeni za hoja	39,408	0
Muda wa majibu (wastani)	5.64s	0ms
Muda wa majibu (upeo)	30.49s	0ms
Muda wa majibu (jumla)	101.52s	0ms

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	5.6	3.8	66.7%	3		2.67s	4,055	4,778
Step 3.5 Flash	-	-	-	-	-	-	-	-

Uandishi wa msimbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	6.7	3.5	66.7%	1		30.49s	2,796	11,296
Step 3.5 Flash	3.0	10.0	0.0%	0		0ms	0	0

Mchanganyiko	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	3.0	10.0	0.0%	0		25.25s	2,612	10,700
Step 3.5 Flash	-	-	-	-	-	-	-	-

Uchanganuzi na uchimbaji wa data	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	7.3	5.9	83.3%	1		1.23s	335	723
Step 3.5 Flash	-	-	-	-	-	-	-	-

Mahususi kwa domeni	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	5.3	7.2	44.4%	1		6.11s	2,621	6,904
Step 3.5 Flash	-	-	-	-	-	-	-	-

Akili ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	4.8	10.0	0.0%	0		2.05s	821	828
Step 3.5 Flash	-	-	-	-	-	-	-	-

Ufuataji wa maagizo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	7.3	5.8	83.3%	1		1.38s	540	1,031
Step 3.5 Flash	-	-	-	-	-	-	-	-

Utatuzi wa mafumbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	3.4	9.7	0.0%	0		2.00s	983	2,338
Step 3.5 Flash	-	-	-	-	-	-	-	-

Mwito wa zana	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	10.0	10.0	100.0%	0		3.50s	321	810
Step 3.5 Flash	-	-	-	-	-	-	-	-

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

Mistral Small 4mediumvsQwen3.5-122B-A10Bnone Mistral Small 4mediumvsGLM 4.7 Flashnone Mistral Small 4mediumvsGLM 5.1none Mistral Small 4mediumvsKimi K2.5none Mistral Small 4mediumvsGLM 5 Turbonone Mistral Small 4mediumvsQwen3.5-27Bnone Mistral Small 4mediumvsGPT-5.4none Trinity Large PreviewnoneInapatikana burevsMistral Small 4medium Mistral Small 4mediumvsMiMo-V2-Pronone Mistral Small 4mediumvsGrok 4.20none Mistral Small 4mediumvsgpt-oss-120bnoneInapatikana bure DeepSeek V3.2nonevsMistral Small 4medium