Urambazaji
AI BENCHY
Advertise here

AI BENCHY Compare

Inception: Mercury 2 vs Mistral: Mistral Small 4

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-06-03

Kipimo Mercury 2 Mercury 2 none Toleo: 2026-02-24 Mistral Small 4 Mistral Small 4 medium Toleo: 2026-03-16
Alama 4.6 5.4
Nafasi #153 #129
Uaminifu 10.0 10.0
Uthabiti 9.1 7.1
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 25.0% 45.0%
Majaribio yasiyo thabiti 2 7
Jumla ya uendeshaji 60 60
Gharama kwa matokeo 0.216 1.112
Jumla ya gharama $0.009 $0.056
Bei ya ingizo $0.250 / 1M $0.150 / 1M
Bei ya toleo $0.750 / 1M $0.600 / 1M
Jumla ya tokeni za ingizo 25,515 39,834
Tokeni za matokeo 3,001 21,871
Tokeni za hoja 0 68,349
Muda wa majibu (wastani) 614ms 8.35s
Muda wa majibu (upeo) 1.27s 59.15s
Muda wa majibu (jumla) 12.28s 167.08s

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Mercury 2 3.0 10.0 0.0% 0 483ms 631 286 0
Mistral Small 4 5.6 3.8 66.7% 3 2.67s 708 4,055 4,778
Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Mercury 2 3.5 9.4 0.0% 0 831ms 4,631 1,650 0
Mistral Small 4 5.1 6.8 33.3% 1 44.82s 4,894 9,322 38,386
Mchanganyiko Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Mercury 2 3.0 10.0 0.0% 0 606ms 4,821 131 0
Mistral Small 4 3.0 10.0 0.0% 0 25.25s 18,706 2,612 10,700
Uchanganuzi na uchimbaji wa data Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Mercury 2 7.3 5.9 83.3% 1 667ms 6,362 180 0
Mistral Small 4 7.3 5.9 83.3% 1 1.23s 6,171 335 723
Mahususi kwa domeni Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Mercury 2 5.3 7.2 44.4% 1 534ms 784 46 0
Mistral Small 4 5.3 7.2 44.4% 1 6.11s 742 2,621 6,904
Akili ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Mercury 2 4.8 10.0 0.0% 0 628ms 495 159 0
Mistral Small 4 4.8 10.0 0.0% 0 2.05s 519 821 828
Ufuataji wa maagizo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Mercury 2 6.5 10.0 50.0% 0 551ms 691 82 0
Mistral Small 4 7.3 5.8 83.3% 1 1.38s 729 540 1,031
Utatuzi wa mafumbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Mercury 2 3.1 10.0 0.0% 0 535ms 694 251 0
Mistral Small 4 3.4 9.7 0.0% 0 2.17s 735 1,226 2,632
Mwito wa zana Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Mercury 2 10.0 10.0 100.0% 0 1.27s 6,193 197 0
Mistral Small 4 10.0 10.0 100.0% 0 3.50s 6,420 321 810
Maarifa ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Mercury 2 3.0 10.0 0.0% 0 548ms 213 19 0
Mistral Small 4 3.0 10.0 0.0% 0 5.92s 210 18 1,557

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

Mistral Small 4mediumvsGrok 4.20noneDeepSeek V3.2nonevsMistral Small 4mediumMistral Small 4mediumvsgpt-oss-120bnoneInapatikana bureMistral Small 4mediumvsQwen3.5-122B-A10BnoneMistral Small 4mediumvsGLM 5 TurbononeMistral Small 4mediumvsKimi K2.5noneMistral Small 4mediumvsQwen3.6 FlashnoneMercury 2nonevsQwen3 Coder NextmediumMercury 2nonevsGLM 4.7 FlashmediumMistral Small 4mediumvsKimi K2.6noneInapatikana bureMistral Small 4mediumvsMiMo-V2.5-PrononeMistral Small 4mediumvsGPT-5.4none