AI BENCHY Compare

Mistral: Mistral Small 4 vs OpenAI: GPT-4o-mini

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-03-17

Kipimo	Mistral Small 4 Mistral Small 4 none Toleo: 2026-03-16	GPT-4o-mini GPT-4o-mini none Toleo: 2024-07-18

Kipimo	Mistral Small 4 Mistral Small 4 none Toleo: 2026-03-16	GPT-4o-mini GPT-4o-mini none Toleo: 2024-07-18
Nafasi	#61	#63
Alama	5.3	5.0
Uthabiti	9.5	10.0
Gharama kwa matokeo	0.108	0.115
Jumla ya gharama	$0.006	$0.005
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio	33.3%	23.5%
Majaribio yasiyo thabiti	1	0
Jumla ya uendeshaji	51	51
Tokeni za matokeo	1,624	1,600
Tokeni za hoja	0	0
Muda wa majibu (wastani)	629ms	1.94s
Muda wa majibu (upeo)	1.72s	7.58s
Muda wa majibu (jumla)	10.70s	19.44s

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	3.4	7.9	16.7%	1		395ms	182	0
GPT-4o-mini	4.8	10.0	25.0%	0		1.34s	186	0

Mchanganyiko	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	3.0	10.0	0.0%	0		1.72s	496	0
GPT-4o-mini	3.0	10.0	0.0%	0		7.58s	568	0

Uchanganuzi na uchimbaji wa data	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	10.0	10.0	100.0%	0		822ms	261	0
GPT-4o-mini	10.0	10.0	100.0%	0		1.27s	183	0

Mahususi kwa domeni	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	5.3	10.0	33.3%	0		367ms	28	0
GPT-4o-mini	3.0	10.0	0.0%	0		637ms	15	0

Akili ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	4.0	10.0	0.0%	0		729ms	205	0
GPT-4o-mini	4.0	10.0	0.0%	0		909ms	66	0

Ufuataji wa maagizo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	6.5	10.0	50.0%	0		380ms	69	0
GPT-4o-mini	4.8	10.0	0.0%	0		1.27s	69	0

Puzzle Solving	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	3.1	9.9	0.0%	0		589ms	170	0
GPT-4o-mini	3.7	10.0	0.0%	0		1.30s	308	0

Mwito wa zana	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	10.0	10.0	100.0%	0		1.40s	213	0
GPT-4o-mini	10.0	10.0	100.0%	0		2.51s	205	0

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

GPT-4o-mininonevsQwen3 Coder Nextmedium GPT-4o-mininonevsGLM 4.7 Flashmedium Mistral Small 4nonevsQwen3 Coder Nextmedium Mistral Small 4mediumvsGPT-4o-mininone GPT-4o-mininonevsQwen3.5-9Bmedium Mistral Small 4nonevsGLM 4.7 Flashmedium MiniMax M2.5mediumInapatikana burevsMistral Small 4none Mistral Small 4nonevsgpt-oss-120bmediumInapatikana bure Mistral Small 4nonevsQwen3.5-9Bmedium MiniMax M2.5mediumInapatikana burevsGPT-4o-mininone Mistral Small 4nonevsGrok 4.20 Multi-Agent Betamedium Mistral Small 4nonevsGPT-5 Nanomedium