Mistral Small 4 (medium) vs GPT-4o-mini

Muundo unaopendekezwa GPT-4o-mini

Its score stays close to the best score here (5.0 vs 5.1), while costing about 9.8x less than Mistral Small 4 (medium).

Ulinganisho wa kina

Kipimo	Mistral Small 4 Mistral Small 4 medium Toleo: 2026-03-16	GPT-4o-mini GPT-4o-mini none Toleo: 2024-07-18

Kipimo	Mistral Small 4 Mistral Small 4 medium Toleo: 2026-03-16	GPT-4o-mini GPT-4o-mini none Toleo: 2024-07-18
Alama	5.1	5.0
Nafasi	#195	#203
Uaminifu	10.0	10.0
Uthabiti	7.0	9.9
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio	42.4%	22.7%
Majaribio yasiyo thabiti	8	0
Jumla ya uendeshaji	66	66
Gharama kwa matokeo	1.913	0.195
Jumla ya gharama	$0.096	$0.010
Bei ya ingizo	$0.150 / 1M	$0.150 / 1M
Bei ya toleo	$0.600 / 1M	$0.600 / 1M
Jumla ya tokeni za ingizo	140,494	53,136
Tokeni za matokeo	39,462	2,911
Tokeni za hoja	92,362	0
Muda wa majibu (wastani)	10.77s	1.99s
Muda wa majibu (upeo)	59.15s	7.58s
Muda wa majibu (jumla)	236.94s	29.86s

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

medium

none

Kategoria:

Mbinu za kupinga AI	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	5.6	3.8	66.7%	3		2.67s	708	4,055	4,778
GPT-4o-mini	4.8	10.0	25.0%	0		1.34s	618	186	0

Uandishi wa msimbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	4.4	5.1	33.3%	2		39.98s	7,636	11,635	54,715
GPT-4o-mini	3.2	9.6	0.0%	0		1.63s	7,314	367	0

Mchanganyiko	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	3.0	10.0	0.0%	0		32.40s	116,624	17,890	18,384
GPT-4o-mini	3.0	10.0	0.0%	0		6.32s	29,916	1,497	0

Uchanganuzi na uchimbaji wa data	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	7.3	5.9	83.3%	1		1.23s	6,171	335	723
GPT-4o-mini	10.0	10.0	100.0%	0		1.27s	7,161	183	0

Mahususi kwa domeni	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	5.3	7.2	44.4%	1		6.11s	742	2,621	6,904
GPT-4o-mini	3.0	10.0	0.0%	0		637ms	732	15	0

Akili ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	4.8	10.0	0.0%	0		2.05s	519	821	828
GPT-4o-mini	4.0	10.0	0.0%	0		909ms	480	66	0

Ufuataji wa maagizo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	7.3	5.8	83.3%	1		1.38s	729	540	1,031
GPT-4o-mini	6.3	10.0	50.0%	0		1.11s	666	69	0

Utatuzi wa mafumbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	3.4	9.7	0.0%	0		2.17s	735	1,226	2,632
GPT-4o-mini	3.5	10.0	0.0%	0		1.21s	651	308	0

Mwito wa zana	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	10.0	10.0	100.0%	0		3.50s	6,420	321	810
GPT-4o-mini	10.0	10.0	100.0%	0		2.51s	5,400	205	0

Maarifa ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mistral Small 4	3.0	10.0	0.0%	0		5.92s	210	18	1,557
GPT-4o-mini	3.0	10.0	0.0%	0		794ms	198	15	0

Badilisha jozi ya ulinganisho