Inception: Mercury 2 vs Mistral: Mistral Small 4

Mistral Small 4 (medium) inaongoza kwa average score: 5.1 vs 4.6. Mercury 2 ina gharama ya chini ya benchmark: $0.030 vs $0.096. Mercury 2 ni ya haraka zaidi: 829ms vs 10.77s, na pass rates 22.7% vs 42.4%.

Muundo unaopendekezwaMercury 2Its score stays close to the best score here (4.6 vs 5.1), while costing about 3.3x less than Mistral Small 4 (medium).

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-07-18

Kipimo	Mercury 2 Mercury 2 none Toleo: 2026-02-24	Mistral Small 4 Mistral Small 4 medium Toleo: 2026-03-16

Kipimo	Mercury 2 Mercury 2 none Toleo: 2026-02-24	Mistral Small 4 Mistral Small 4 medium Toleo: 2026-03-16
Alama	4.6	5.1
Nafasi	#185	#163
Uaminifu	10.0	10.0
Uthabiti	9.2	7.0
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio	22.7%	42.4%
Majaribio yasiyo thabiti	2	8
Jumla ya uendeshaji	66	66
Gharama kwa matokeo	0.734	1.913
Jumla ya gharama	$0.030	$0.096
Bei ya ingizo	$0.250 / 1M	$0.150 / 1M
Bei ya toleo	$0.750 / 1M	$0.600 / 1M
Jumla ya tokeni za ingizo	88,704	140,494
Tokeni za matokeo	9,564	39,462
Tokeni za hoja	0	92,362
Muda wa majibu (wastani)	829ms	10.77s
Muda wa majibu (upeo)	4.52s	59.15s
Muda wa majibu (jumla)	18.24s	236.94s

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#185 Mercury 2

none

Gharama: $0.002
Muda: 1.8s
Tokeni: 1,514 tok

#163 Mistral Small 4

medium

Gharama: $0.006
Muda: 47.9s
Tokeni: 9,857 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Kategoria:

Mbinu za kupinga AI	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mercury 2	3.0	10.0	0.0%	0		483ms	631	286	0
Mistral Small 4	5.6	3.8	66.7%	3		2.67s	708	4,055	4,778

Uandishi wa msimbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mercury 2	3.4	9.6	0.0%	0		1.03s	7,229	3,088	0
Mistral Small 4	4.4	5.1	33.3%	2		39.98s	7,636	11,635	54,715

Mchanganyiko	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mercury 2	3.0	10.0	0.0%	0		2.56s	65,412	5,256	0
Mistral Small 4	3.0	10.0	0.0%	0		32.40s	116,624	17,890	18,384

Uchanganuzi na uchimbaji wa data	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mercury 2	7.3	5.9	83.3%	1		667ms	6,362	180	0
Mistral Small 4	7.3	5.9	83.3%	1		1.23s	6,171	335	723

Mahususi kwa domeni	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mercury 2	5.3	7.2	44.4%	1		534ms	784	46	0
Mistral Small 4	5.3	7.2	44.4%	1		6.11s	742	2,621	6,904

Akili ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mercury 2	4.8	10.0	0.0%	0		628ms	495	159	0
Mistral Small 4	4.8	10.0	0.0%	0		2.05s	519	821	828

Ufuataji wa maagizo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mercury 2	6.5	10.0	50.0%	0		551ms	691	82	0
Mistral Small 4	7.3	5.8	83.3%	1		1.38s	729	540	1,031

Utatuzi wa mafumbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mercury 2	3.1	10.0	0.0%	0		535ms	694	251	0
Mistral Small 4	3.4	9.7	0.0%	0		2.17s	735	1,226	2,632

Mwito wa zana	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mercury 2	10.0	10.0	100.0%	0		1.27s	6,193	197	0
Mistral Small 4	10.0	10.0	100.0%	0		3.50s	6,420	321	810

Maarifa ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mercury 2	3.0	10.0	0.0%	0		548ms	213	19	0
Mistral Small 4	3.0	10.0	0.0%	0		5.92s	210	18	1,557

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

Mistral Small 4mediumvsMiMo-V2.5none Mistral Small 4mediumvsQwen3.5-9Bnone Mistral Small 4mediumvsQwen3 Coder Nextnone North Mini CodenoneInapatikana burevsMistral Small 4medium CobuddymediumvsMercury 2none Mercury 2nonevsQwen3 Coder Nextmedium Mercury 2nonevsMiniMax M2.5medium Mistral Small 4mediumvsInklingnone DeepSeek V3.2nonevsMistral Small 4medium Mistral Small 4mediumvsGPT-4o-mininone Ling-2.6-1TnonevsMistral Small 4medium Mistral Small 4mediumvsQwen3.6 35B A3Bnone