Urambazaji
AI BENCHY
Your ad here

AI BENCHY Compare

OpenAI: GPT-5.4 Mini vs StepFun: Step 3.5 Flash

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-03-17

Kipimo GPT-5.4 Mini GPT-5.4 Mini none Toleo: 2026-03-17 Step 3.5 Flash Step 3.5 Flash medium Toleo: 2026-02-01 Inapatikana bure
Nafasi #66 #22
Alama 4.8 7.9
Uthabiti 8.6 9.1
Gharama kwa matokeo 0.737 0.000
Jumla ya gharama $0.030 $0.000
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 31.4% 70.6%
Majaribio yasiyo thabiti 3 2
Jumla ya uendeshaji 51 49
Tokeni za matokeo 2,085 71,904
Tokeni za hoja 0 155,607
Muda wa majibu (wastani) 1.17s 26.78s
Muda wa majibu (upeo) 2.52s 170.45s
Muda wa majibu (jumla) 19.82s 294.58s

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
GPT-5.4 Mini 3.1 8.1 8.3% 1 929ms 654 0
Step 3.5 Flash 10.0 10.0 100.0% 0 13.56s 14,376 17,668
Mchanganyiko Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
GPT-5.4 Mini 3.0 10.0 0.0% 0 2.52s 298 0
Step 3.5 Flash 10.0 10.0 100.0% 0 29.57s 1,176 12,984
Uchanganuzi na uchimbaji wa data Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
GPT-5.4 Mini 10.0 10.0 100.0% 0 1.30s 222 0
Step 3.5 Flash 10.0 10.0 100.0% 0 15.01s 600 13,886
Mahususi kwa domeni Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
GPT-5.4 Mini 3.5 4.4 33.3% 2 937ms 88 0
Step 3.5 Flash 5.3 7.2 44.4% 1 170.45s 45,350 90,436
Akili ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
GPT-5.4 Mini 4.8 10.0 0.0% 0 1.82s 174 0
Step 3.5 Flash 5.5 10.0 0.0% 0 6.54s 2,214 2,584
Ufuataji wa maagizo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
GPT-5.4 Mini 6.3 10.0 50.0% 0 728ms 101 0
Step 3.5 Flash 8.5 6.8 83.3% 1 4.98s 2,284 3,412
Puzzle Solving Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
GPT-5.4 Mini 5.4 10.0 33.3% 0 860ms 293 0
Step 3.5 Flash 5.3 10.0 33.3% 0 7.72s 5,629 10,835
Mwito wa zana Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
GPT-5.4 Mini 3.0 10.0 0.0% 0 2.32s 255 0
Step 3.5 Flash 10.0 10.0 100.0% 0 11.91s 275 3,802

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

GPT-5.4 MininonevsQwen3 Coder NextmediumGemini 3.1 Flash Lite PreviewnonevsStep 3.5 FlashmediumInapatikana bureGPT-5.2 ChatnonevsStep 3.5 FlashmediumInapatikana bureGemini 3 Flash PreviewnonevsStep 3.5 FlashmediumInapatikana bureGemini 3.1 Flash Lite PreviewlowvsStep 3.5 FlashmediumInapatikana bureGPT-5.4 MininonevsGLM 4.7 FlashmediumGPT-5.3 ChatnonevsStep 3.5 FlashmediumInapatikana bureGPT-5.4 MininonevsQwen3.5-9BmediumClaude Sonnet 4.6nonevsStep 3.5 FlashmediumInapatikana bureMistral Small 4mediumvsGPT-5.4 MininoneGemini 3 Flash PreviewlowvsStep 3.5 FlashmediumInapatikana bureMiniMax M2.5mediumInapatikana burevsGPT-5.4 Mininone