Urambazaji
AI BENCHY
Advertise here

AI BENCHY Compare

Google: Gemma 4 31B vs Inception: Mercury 2

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-05-29

Kipimo Gemma 4 31B Gemma 4 31B none Toleo: 2026-04-02 Inapatikana bure Mercury 2 Mercury 2 medium Toleo: 2026-02-24
Alama 6.7 6.5
Nafasi #83 #92
Uaminifu 10.0 10.0
Uthabiti 10.0 8.8
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 50.0% 51.7%
Majaribio yasiyo thabiti 0 3
Jumla ya uendeshaji 60 60
Gharama kwa matokeo 0.030 0.611
Jumla ya gharama $0.003 $0.055
Bei ya ingizo $0.120 / 1M $0.250 / 1M
Bei ya toleo $0.370 / 1M $0.750 / 1M
Tokeni za matokeo 1,398 4,022
Tokeni za hoja 0 58,405
Muda wa majibu (wastani) 4.05s 2.27s
Muda wa majibu (upeo) 26.13s 14.63s
Muda wa majibu (jumla) 72.97s 43.20s

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Gemma 4 31B 6.5 10.0 50.0% 0 1.85s 45 0
Mercury 2 6.9 9.9 50.0% 0 1.12s 2,546 2,609
Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Gemma 4 31B 6.8 10.0 50.0% 0 14.84s 726 0
Mercury 2 7.2 6.5 66.7% 1 2.29s 270 8,514
Mchanganyiko Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Mercury 2 10.0 10.0 100.0% 0 3.28s 268 4,887
Uchanganuzi na uchimbaji wa data Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Gemma 4 31B 10.0 10.0 100.0% 0 2.25s 285 0
Mercury 2 7.3 5.9 83.3% 1 1.11s 183 1,656
Mahususi kwa domeni Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Gemma 4 31B 7.7 10.0 66.7% 0 3.22s 27 0
Mercury 2 2.9 7.2 11.1% 1 6.48s 41 30,754
Akili ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Gemma 4 31B 10.0 10.0 100.0% 0 2.09s 117 0
Mercury 2 4.8 10.0 0.0% 0 821ms 137 542
Ufuataji wa maagizo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Gemma 4 31B 6.5 10.0 50.0% 0 2.84s 78 0
Mercury 2 10.0 10.0 100.0% 0 1.07s 14 958
Utatuzi wa mafumbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Gemma 4 31B 6.5 10.0 33.3% 0 4.23s 108 0
Mercury 2 5.4 10.0 33.3% 0 949ms 361 2,781
Mwito wa zana Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Mercury 2 10.0 10.0 100.0% 0 1.89s 180 1,956
Maarifa ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Gemma 4 31B 3.0 10.0 0.0% 0 1.25s 12 0
Mercury 2 3.0 10.0 0.0% 0 2.58s 22 3,748

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

Gemma 4 31BnoneInapatikana burevsKimi K2.5mediumMercury 2mediumvsGPT-5.5noneGemini 3.1 Flash LitenonevsMercury 2mediumMercury 2mediumvsQwen3.5 Plus 2026-02-15noneGemma 4 31BnoneInapatikana burevsQwen3.6 27BmediumGemini 2.5 FlashnonevsMercury 2mediumGemini 3.1 Flash LiteminimalvsMercury 2mediumMercury 2mediumvsGLM 5noneGemma 4 31BnoneInapatikana burevsMiMo-V2-OmnimediumGemma 4 31BnoneInapatikana burevsGrok 4.20mediumDeepSeek V4 ProhighvsGemma 4 31BnoneInapatikana bureDeepSeek V3.2nonevsMercury 2medium