Urambazaji
AI BENCHY
Your ad here

AI BENCHY Compare

StepFun: Step 3.5 Flash vs xAI: Grok 4.20 Beta

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-03-12

Kipimo Step 3.5 Flash Step 3.5 Flash medium Toleo: 2026-02-01 Inapatikana bure Grok 4.20 Beta Grok 4.20 Beta none Toleo: 2026-03-12
Nafasi #14 #52
Wastani wa alama 7.4 4.4
Uthabiti 9.1 9.1
Gharama kwa matokeo 0.000 2.214
Jumla ya gharama $0.000 $0.089
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 68.8% 33.3%
Majaribio yasiyo thabiti 2 2
Jumla ya uendeshaji 48 48
Tokeni za matokeo 71,452 1,511
Tokeni za hoja 155,147 0
Muda wa majibu (wastani) 29.10s 1.22s
Muda wa majibu (upeo) 170.45s 6.48s
Muda wa majibu (jumla) 290.96s 19.53s

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Wastani wa alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Wastani wa alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Step 3.5 Flash 10.0 10.0 100.0% 0 18.54s 13,924 17,208
Grok 4.20 Beta 3.3 7.9 22.2% 1 562ms 245 0
Mchanganyiko Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Step 3.5 Flash 10.0 10.0 100.0% 0 29.57s 1,176 12,984
Grok 4.20 Beta 10.0 10.0 0.0% 0 6.48s 282 0
Uchanganuzi na uchimbaji wa data Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Step 3.5 Flash 10.0 10.0 100.0% 0 15.01s 600 13,886
Grok 4.20 Beta 9.9 10.0 100.0% 0 601ms 197 0
Mahususi kwa domeni Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Step 3.5 Flash 4.0 7.2 44.4% 1 170.45s 45,350 90,436
Grok 4.20 Beta 10.0 10.0 0.0% 0 611ms 160 0
Akili ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Step 3.5 Flash 6.0 10.0 0.0% 0 6.54s 2,214 2,584
Grok 4.20 Beta 5.0 10.0 0.0% 0 541ms 87 0
Ufuataji wa maagizo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Step 3.5 Flash 9.0 6.8 83.3% 1 4.98s 2,284 3,412
Grok 4.20 Beta 4.5 10.0 0.0% 0 687ms 60 0
Puzzle Solving Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Step 3.5 Flash 4.0 10.0 33.3% 0 7.72s 5,629 10,835
Grok 4.20 Beta 4.0 7.2 55.6% 1 541ms 291 0
Mwito wa zana Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Step 3.5 Flash 10.0 10.0 100.0% 0 11.91s 275 3,802
Grok 4.20 Beta 10.0 10.0 100.0% 0 4.79s 189 0

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

GPT-5.2 ChatnonevsStep 3.5 FlashmediumInapatikana bureGemini 3.1 Flash Lite PreviewlowvsStep 3.5 FlashmediumInapatikana bureGPT-5.3 ChatnonevsStep 3.5 FlashmediumInapatikana bureGemini 3 Flash PreviewnonevsStep 3.5 FlashmediumInapatikana bureMiniMax M2.5mediumvsGrok 4.20 BetanoneGemini 3.1 Flash Lite PreviewnonevsStep 3.5 FlashmediumInapatikana bureClaude Sonnet 4.6nonevsStep 3.5 FlashmediumInapatikana buregpt-oss-120bmediumInapatikana burevsGrok 4.20 BetanoneGemini 3 Flash PreviewlowvsStep 3.5 FlashmediumInapatikana bureMercury 2mediumvsGrok 4.20 BetanoneQwen3 Coder NextmediumvsGrok 4.20 BetanoneQwen3.5-35B-A3BmediumvsGrok 4.20 Betanone