Urambazaji
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.4 Nano vs StepFun: Step 3.7 Flash

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-05-29

Kipimo GPT-5.4 Nano GPT-5.4 Nano medium Toleo: 2026-03-17 Step 3.7 Flash Step 3.7 Flash high Toleo: 2026-05-29
Alama 7.2 7.1
Nafasi #72 #74
Uaminifu 10.0 10.0
Uthabiti 8.8 8.2
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 63.3% 65.8%
Majaribio yasiyo thabiti 3 4
Jumla ya uendeshaji 60 60
Gharama kwa matokeo 0.900 8.723
Jumla ya gharama $0.099 $0.960
Bei ya ingizo $0.200 / 1M $0.200 / 1M
Bei ya toleo $1.250 / 1M $1.150 / 1M
Tokeni za matokeo 2,993 828,084
Tokeni za hoja 70,928 0
Muda wa majibu (wastani) 11.79s 49.43s
Muda wa majibu (upeo) 94.06s 192.75s
Muda wa majibu (jumla) 235.81s 988.58s

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
GPT-5.4 Nano 8.3 10.0 75.0% 0 4.52s 683 2,254
Step 3.7 Flash 10.0 10.0 100.0% 0 13.40s 42,656 0
Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
GPT-5.4 Nano 6.8 6.2 66.7% 1 21.10s 495 15,186
Step 3.7 Flash 3.6 4.6 25.0% 1 126.82s 164,069 0
Mchanganyiko Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
GPT-5.4 Nano 9.8 10.0 100.0% 0 24.13s 349 5,719
Step 3.7 Flash 10.0 10.0 100.0% 0 13.01s 8,802 0
Uchanganuzi na uchimbaji wa data Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
GPT-5.4 Nano 10.0 10.0 100.0% 0 2.54s 234 516
Step 3.7 Flash 10.0 10.0 100.0% 0 14.72s 23,113 0
Mahususi kwa domeni Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
GPT-5.4 Nano 5.9 7.2 55.6% 1 38.18s 60 43,325
Step 3.7 Flash 4.1 4.4 44.5% 2 149.64s 410,502 0
Akili ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
GPT-5.4 Nano 4.5 10.0 0.0% 0 4.15s 179 443
Step 3.7 Flash 5.5 10.0 0.0% 0 4.17s 2,862 0
Ufuataji wa maagizo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
GPT-5.4 Nano 9.8 10.0 100.0% 0 1.88s 95 521
Step 3.7 Flash 9.8 10.0 100.0% 0 1.52s 2,010 0
Utatuzi wa mafumbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
GPT-5.4 Nano 4.1 7.2 22.2% 1 3.79s 594 1,408
Step 3.7 Flash 5.3 7.2 44.4% 1 10.22s 25,422 0
Mwito wa zana Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
GPT-5.4 Nano 10.0 10.0 100.0% 0 7.71s 234 382
Step 3.7 Flash 10.0 10.0 100.0% 0 2.79s 1,172 0
Maarifa ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
GPT-5.4 Nano 3.0 10.0 0.0% 0 4.81s 70 1,174
Step 3.7 Flash 3.0 10.0 0.0% 0 149.34s 147,476 0

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

GPT-5 MinimediumvsStep 3.7 FlashhighSeed-2.0-MinimediumvsStep 3.7 FlashhighQwen3.6 Max PreviewnonevsStep 3.7 FlashhighRing-2.6-1TnonevsGPT-5.4 NanomediumClaude Opus 4.6mediumvsStep 3.7 FlashhighStep 3.7 FlashhighvsMiMo-V2-FlashmediumGPT-5.4 NanomediumvsQwen3.6 Max PreviewnoneRing-2.6-1TnonevsStep 3.7 FlashhighClaude Opus 4.8nonevsGPT-5.4 NanomediumRing-2.6-1TmediumvsStep 3.7 FlashhighQwen3.5-35B-A3BmediumvsStep 3.7 FlashhighClaude Sonnet 4.6nonevsStep 3.7 Flashhigh