Urambazaji
AI BENCHY
Advertise here

AI BENCHY Compare

Anthropic: Claude Opus 4.8 vs StepFun: Step 3.7 Flash

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-05-29

Kipimo Claude Opus 4.8 Claude Opus 4.8 none Toleo: 2026-05-28 Step 3.7 Flash Step 3.7 Flash low Toleo: 2026-05-29
Alama 7.3 7.4
Nafasi #65 #60
Uaminifu 10.0 10.0
Uthabiti 9.2 8.7
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 65.0% 68.3%
Majaribio yasiyo thabiti 2 3
Jumla ya uendeshaji 60 60
Gharama kwa matokeo 4.324 2.796
Jumla ya gharama $0.519 $0.336
Bei ya ingizo $5.000 / 1M $0.200 / 1M
Bei ya toleo $25.000 / 1M $1.150 / 1M
Tokeni za matokeo 8,098 285,209
Tokeni za hoja 0 0
Muda wa majibu (wastani) 3.51s 16.06s
Muda wa majibu (upeo) 17.73s 124.75s
Muda wa majibu (jumla) 70.19s 321.11s

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 6.5 10.0 50.0% 0 3.40s 1,472 0
Step 3.7 Flash 8.7 7.9 91.7% 1 4.02s 10,896 0
Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 6.8 10.0 50.0% 0 3.59s 1,323 0
Step 3.7 Flash 10.0 10.0 100.0% 0 9.43s 14,569 0
Mchanganyiko Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 9.5 10.0 100.0% 0 17.73s 3,259 0
Step 3.7 Flash 10.0 10.0 100.0% 0 7.98s 6,426 0
Uchanganuzi na uchimbaji wa data Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 7.3 5.8 83.3% 1 1.77s 308 0
Step 3.7 Flash 7.3 5.8 83.3% 1 2.29s 2,667 0
Mahususi kwa domeni Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 5.3 7.2 44.4% 1 1.66s 61 0
Step 3.7 Flash 5.3 7.2 44.4% 1 43.31s 104,487 0
Akili ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 10.0 10.0 100.0% 0 3.48s 230 0
Step 3.7 Flash 3.4 9.3 0.0% 0 7.00s 4,604 0
Ufuataji wa maagizo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 9.9 10.0 100.0% 0 1.37s 95 0
Step 3.7 Flash 9.8 10.0 100.0% 0 1.58s 1,857 0
Utatuzi wa mafumbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 7.7 10.0 66.7% 0 2.74s 783 0
Step 3.7 Flash 5.5 9.9 33.3% 0 1.84s 3,564 0
Mwito wa zana Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 10.0 10.0 100.0% 0 5.35s 355 0
Step 3.7 Flash 10.0 10.0 100.0% 0 3.25s 1,360 0
Maarifa ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 3.0 10.0 0.0% 0 3.41s 212 0
Step 3.7 Flash 3.0 10.0 0.0% 0 124.75s 134,779 0

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

Claude Opus 4.8nonevsDeepSeek V3.2mediumKimi K2.6mediumInapatikana burevsStep 3.7 FlashlowStep 3.7 FlashlowvsMiMo-V2.5mediumClaude Opus 4.8nonevsQwen3.5-35B-A3BmediumGPT-5.3 ChatnonevsStep 3.7 FlashlowStep 3.7 FlashlowvsGLM 5V TurbomediumClaude Opus 4.8nonevsRing-2.6-1TmediumStep 3.7 FlashlowvsGLM 5.1mediumClaude Opus 4.8nonevsGPT-5.4 MinimediumClaude Opus 4.8nonevsGPT-5.2mediumGPT-5.2mediumvsStep 3.7 FlashlowGPT-5.4 MinimediumvsStep 3.7 Flashlow