AI BENCHY Compare

Mistral: Mistral Small 4 vs StepFun: Step 3.5 Flash

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-03-17

Kipimo	Mistral Small 4 Mistral Small 4 medium Toleo: 2026-03-16	Step 3.5 Flash Step 3.5 Flash medium Toleo: 2026-02-01 Inapatikana bure

Kipimo	Mistral Small 4 Mistral Small 4 medium Toleo: 2026-03-16	Step 3.5 Flash Step 3.5 Flash medium Toleo: 2026-02-01 Inapatikana bure
Nafasi	#55	#22
Alama	5.6	7.9
Uthabiti	7.0	9.1
Gharama kwa matokeo	0.502	0.000
Jumla ya gharama	$0.026	$0.000
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio	49.0%	70.6%
Majaribio yasiyo thabiti	6	2
Jumla ya uendeshaji	51	49
Tokeni za matokeo	12,288	71,904
Tokeni za hoja	28,112	155,607
Muda wa majibu (wastani)	4.18s	26.78s
Muda wa majibu (upeo)	25.25s	170.45s
Muda wa majibu (jumla)	71.03s	294.58s

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	5.6	3.8	66.7%	3		2.67s	4,055	4,778
Step 3.5 Flash	10.0	10.0	100.0%	0		13.56s	14,376	17,668

Mchanganyiko	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	3.0	10.0	0.0%	0		25.25s	2,612	10,700
Step 3.5 Flash	10.0	10.0	100.0%	0		29.57s	1,176	12,984

Uchanganuzi na uchimbaji wa data	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	7.3	5.9	83.3%	1		1.23s	335	723
Step 3.5 Flash	10.0	10.0	100.0%	0		15.01s	600	13,886

Mahususi kwa domeni	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	5.3	7.2	44.4%	1		6.11s	2,621	6,904
Step 3.5 Flash	5.3	7.2	44.4%	1		170.45s	45,350	90,436

Akili ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	4.8	10.0	0.0%	0		2.05s	821	828
Step 3.5 Flash	5.5	10.0	0.0%	0		6.54s	2,214	2,584

Ufuataji wa maagizo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	7.3	5.8	83.3%	1		1.38s	540	1,031
Step 3.5 Flash	8.5	6.8	83.3%	1		4.98s	2,284	3,412

Puzzle Solving	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	3.4	9.7	0.0%	0		2.00s	983	2,338
Step 3.5 Flash	5.3	10.0	33.3%	0		7.72s	5,629	10,835

Mwito wa zana	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	10.0	10.0	100.0%	0		3.50s	321	810
Step 3.5 Flash	10.0	10.0	100.0%	0		11.91s	275	3,802

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

Mistral Small 4mediumvsGLM 5 Turbonone Mistral Small 4mediumvsGLM 4.7 Flashnone Mistral Small 4mediumvsQwen3.5-27Bnone Mistral Small 4mediumvsGPT-5.4none Gemini 3.1 Flash Lite PreviewnonevsStep 3.5 FlashmediumInapatikana bure GPT-5.2 ChatnonevsStep 3.5 FlashmediumInapatikana bure Gemini 3 Flash PreviewnonevsStep 3.5 FlashmediumInapatikana bure Gemini 3.1 Flash Lite PreviewlowvsStep 3.5 FlashmediumInapatikana bure Mistral Small 4mediumvsQwen3.5-122B-A10Bnone Mistral Small 4mediumvsGrok 4.20 Betanone Mistral Small 4mediumvsKimi K2.5none Mistral Small 4mediumvsHunter Alphanone