Urambazaji
AI BENCHY
Advertise here

AI BENCHY Compare

Anthropic: Claude Opus 4.8 vs StepFun: Step 3.7 Flash

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-05-29

Kipimo Claude Opus 4.8 Claude Opus 4.8 none Toleo: 2026-05-28 Step 3.7 Flash Step 3.7 Flash medium Toleo: 2026-05-29
Alama 7.3 7.9
Nafasi #65 #32
Uaminifu 10.0 9.9
Uthabiti 9.2 9.2
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 65.0% 71.7%
Majaribio yasiyo thabiti 2 2
Jumla ya uendeshaji 60 58
Gharama kwa matokeo 4.324 2.663
Jumla ya gharama $0.519 $0.347
Bei ya ingizo $5.000 / 1M $0.200 / 1M
Bei ya toleo $25.000 / 1M $1.150 / 1M
Tokeni za matokeo 8,098 294,481
Tokeni za hoja 0 0
Muda wa majibu (wastani) 3.51s 18.32s
Muda wa majibu (upeo) 17.73s 113.98s
Muda wa majibu (jumla) 70.19s 366.45s

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 6.5 10.0 50.0% 0 3.40s 1,472 0
Step 3.7 Flash 8.7 7.9 91.7% 1 9.65s 32,185 0
Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 6.8 10.0 50.0% 0 3.59s 1,323 0
Step 3.7 Flash 8.2 6.7 83.3% 1 10.64s 19,320 0
Mchanganyiko Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 9.5 10.0 100.0% 0 17.73s 3,259 0
Step 3.7 Flash 10.0 10.0 100.0% 0 9.06s 7,106 0
Uchanganuzi na uchimbaji wa data Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 7.3 5.8 83.3% 1 1.77s 308 0
Step 3.7 Flash 10.0 10.0 100.0% 0 2.75s 3,020 0
Mahususi kwa domeni Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 5.3 7.2 44.4% 1 1.66s 61 0
Step 3.7 Flash 7.7 10.0 66.7% 0 48.27s 70,347 0
Akili ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 10.0 10.0 100.0% 0 3.48s 230 0
Step 3.7 Flash 4.0 10.0 0.0% 0 6.85s 3,987 0
Ufuataji wa maagizo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 9.9 10.0 100.0% 0 1.37s 95 0
Step 3.7 Flash 9.8 10.0 100.0% 0 1.83s 2,166 0
Utatuzi wa mafumbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 7.7 10.0 66.7% 0 2.74s 783 0
Step 3.7 Flash 5.7 9.9 33.3% 0 6.19s 15,071 0
Mwito wa zana Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 10.0 10.0 100.0% 0 5.35s 355 0
Step 3.7 Flash 10.0 10.0 100.0% 0 4.16s 2,115 0
Maarifa ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 3.0 10.0 0.0% 0 3.41s 212 0
Step 3.7 Flash 3.0 10.0 0.0% 0 113.98s 139,164 0

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho