Urambazaji
AI BENCHY
Your ad here

AI BENCHY Compare

Google: Gemma 4 31B vs StepFun: Step 3.5 Flash

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-04-16

Kipimo Gemma 4 31B Gemma 4 31B none Toleo: 2026-04-02 Inapatikana bure Step 3.5 Flash Step 3.5 Flash medium Toleo: 2026-02-01
Alama 6.9 7.9
Nafasi #47 #30
Uthabiti 10.0 9.1
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 55.6% 70.6%
Majaribio yasiyo thabiti 0 2
Jumla ya uendeshaji 54 49
Gharama kwa matokeo 0.024 0.000
Jumla ya gharama $0.003 $0.000
Bei ya ingizo $0.130 / 1M $0.100 / 1M
Bei ya toleo $0.380 / 1M $0.300 / 1M
Tokeni za matokeo 1,359 71,904
Tokeni za hoja 0 155,607
Muda wa majibu (wastani) 4.02s 26.78s
Muda wa majibu (upeo) 26.13s 170.45s
Muda wa majibu (jumla) 64.33s 294.58s

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Gemma 4 31B 6.5 10.0 50.0% 0 1.85s 45 0
Step 3.5 Flash 10.0 10.0 100.0% 0 13.56s 14,376 17,668
Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Gemma 4 31B 10.0 10.0 100.0% 0 26.13s 699 0
Step 3.5 Flash - - - - - - - -
Mchanganyiko Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Step 3.5 Flash 10.0 10.0 100.0% 0 29.57s 1,176 12,984
Uchanganuzi na uchimbaji wa data Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Gemma 4 31B 10.0 10.0 100.0% 0 2.25s 285 0
Step 3.5 Flash 10.0 10.0 100.0% 0 15.01s 600 13,886
Mahususi kwa domeni Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Gemma 4 31B 7.7 10.0 66.7% 0 3.22s 27 0
Step 3.5 Flash 5.3 7.2 44.4% 1 170.45s 45,350 90,436
Akili ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Gemma 4 31B 10.0 10.0 100.0% 0 2.09s 117 0
Step 3.5 Flash 5.5 10.0 0.0% 0 6.54s 2,214 2,584
Ufuataji wa maagizo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Gemma 4 31B 6.5 10.0 50.0% 0 2.84s 78 0
Step 3.5 Flash 8.5 6.8 83.3% 1 4.98s 2,284 3,412
Utatuzi wa mafumbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Gemma 4 31B 5.5 10.0 33.3% 0 2.95s 108 0
Step 3.5 Flash 5.3 10.0 33.3% 0 7.72s 5,629 10,835
Mwito wa zana Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Step 3.5 Flash 10.0 10.0 100.0% 0 11.91s 275 3,802

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

Gemini 3.1 Flash Lite PreviewnonevsStep 3.5 FlashmediumGPT-5.2 ChatnonevsStep 3.5 FlashmediumGemma 4 31BnoneInapatikana burevsGrok 4.20mediumGemma 4 31BnoneInapatikana burevsKimi K2.5mediumGemma 4 31BnoneInapatikana burevsGPT-5 MinimediumGemma 4 31BnoneInapatikana burevsNemotron 3 SupermediumInapatikana bureGemini 3.1 Flash Lite PreviewlowvsStep 3.5 FlashmediumGemma 4 31BnoneInapatikana burevsGrok 4.1 FastmediumGPT-5.3 ChatnonevsStep 3.5 FlashmediumGemini 3 Flash PreviewnonevsStep 3.5 FlashmediumGemma 4 31BnoneInapatikana burevsGPT-5.4 MinimediumGemma 4 31BnoneInapatikana burevsMercury 2medium