Urambazaji
AI BENCHY
Your ad here

AI BENCHY Compare

OpenAI: GPT-5.4 Nano vs StepFun: Step 3.5 Flash

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-03-17

Kipimo GPT-5.4 Nano GPT-5.4 Nano none Toleo: 2026-03-17 Step 3.5 Flash Step 3.5 Flash medium Toleo: 2026-02-01 Inapatikana bure
Nafasi #73 #22
Alama 4.3 7.9
Uthabiti 7.3 9.1
Gharama kwa matokeo 0.404 0.000
Jumla ya gharama $0.009 $0.000
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 29.4% 70.6%
Majaribio yasiyo thabiti 6 2
Jumla ya uendeshaji 51 49
Tokeni za matokeo 2,185 71,904
Tokeni za hoja 0 155,607
Muda wa majibu (wastani) 1.39s 26.78s
Muda wa majibu (upeo) 3.84s 170.45s
Muda wa majibu (jumla) 23.70s 294.58s

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
GPT-5.4 Nano 3.5 8.0 16.7% 1 1.18s 800 0
Step 3.5 Flash 10.0 10.0 100.0% 0 13.56s 14,376 17,668
Mchanganyiko Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
GPT-5.4 Nano 3.0 10.0 0.0% 0 3.84s 280 0
Step 3.5 Flash 10.0 10.0 100.0% 0 29.57s 1,176 12,984
Uchanganuzi na uchimbaji wa data Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
GPT-5.4 Nano 6.5 10.0 50.0% 0 1.11s 219 0
Step 3.5 Flash 10.0 10.0 100.0% 0 15.01s 600 13,886
Mahususi kwa domeni Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
GPT-5.4 Nano 2.9 4.4 22.2% 2 926ms 52 0
Step 3.5 Flash 5.3 7.2 44.4% 1 170.45s 45,350 90,436
Akili ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
GPT-5.4 Nano 3.8 2.5 33.3% 1 1.31s 180 0
Step 3.5 Flash 5.5 10.0 0.0% 0 6.54s 2,214 2,584
Ufuataji wa maagizo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
GPT-5.4 Nano 5.0 6.8 33.3% 1 787ms 84 0
Step 3.5 Flash 8.5 6.8 83.3% 1 4.98s 2,284 3,412
Puzzle Solving Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
GPT-5.4 Nano 3.7 7.3 22.2% 1 1.29s 348 0
Step 3.5 Flash 5.3 10.0 33.3% 0 7.72s 5,629 10,835
Mwito wa zana Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
GPT-5.4 Nano 10.0 10.0 100.0% 0 3.40s 222 0
Step 3.5 Flash 10.0 10.0 100.0% 0 11.91s 275 3,802

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho