Urambazaji
AI BENCHY
Advertise here

AI BENCHY Compare

Anthropic: Claude Opus 4.8 vs StepFun: Step 3.5 Flash

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-05-28

Kipimo Claude Opus 4.8 Claude Opus 4.8 none Toleo: 2026-05-28 Step 3.5 Flash Step 3.5 Flash medium Toleo: 2026-02-01
Alama 7.3 7.4
Nafasi #63 #59
Uaminifu 10.0 10.0
Uthabiti 9.2 9.1
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 65.0% 62.3%
Majaribio yasiyo thabiti 2 2
Jumla ya uendeshaji 60 57
Gharama kwa matokeo 4.324 0.133
Jumla ya gharama $0.519 $0.062
Bei ya ingizo $5.000 / 1M $0.090 / 1M
Bei ya toleo $25.000 / 1M $0.300 / 1M
Tokeni za matokeo 8,098 90,478
Tokeni za hoja 0 173,544
Muda wa majibu (wastani) 3.51s 43.20s
Muda wa majibu (upeo) 17.73s 170.45s
Muda wa majibu (jumla) 70.19s 561.54s

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 6.5 10.0 50.0% 0 3.40s 1,472 0
Step 3.5 Flash 10.0 10.0 100.0% 0 40.57s 20,391 24,176
Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 6.8 10.0 50.0% 0 3.59s 1,323 0
Step 3.5 Flash 3.0 6.0 50.0% 1 62.83s 12,098 0
Mchanganyiko Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 9.5 10.0 100.0% 0 17.73s 3,259 0
Step 3.5 Flash 10.0 10.0 100.0% 0 29.57s 1,176 12,984
Uchanganuzi na uchimbaji wa data Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 7.3 5.8 83.3% 1 1.77s 308 0
Step 3.5 Flash 10.0 10.0 100.0% 0 15.01s 600 13,886
Mahususi kwa domeni Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 5.3 7.2 44.4% 1 1.66s 61 0
Step 3.5 Flash 5.3 7.2 44.4% 1 170.45s 45,350 90,436
Akili ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 10.0 10.0 100.0% 0 3.48s 230 0
Step 3.5 Flash 5.5 10.0 0.0% 0 22.39s 240 3,506
Ufuataji wa maagizo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 9.9 10.0 100.0% 0 1.37s 95 0
Step 3.5 Flash 8.3 10.0 50.0% 0 4.78s 2,364 3,521
Utatuzi wa mafumbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 7.7 10.0 66.7% 0 2.74s 783 0
Step 3.5 Flash 5.3 10.0 33.3% 0 7.22s 5,630 10,861
Mwito wa zana Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 10.0 10.0 100.0% 0 5.35s 355 0
Step 3.5 Flash 10.0 10.0 100.0% 0 11.91s 275 3,802
Maarifa ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.8 3.0 10.0 0.0% 0 3.41s 212 0
Step 3.5 Flash 3.0 10.0 0.0% 0 108.45s 2,354 10,372

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

Claude Opus 4.8nonevsQwen3.5-35B-A3BmediumGPT-5.3 ChatnonevsStep 3.5 FlashmediumClaude Opus 4.8nonevsRing-2.6-1TmediumClaude Opus 4.8nonevsGPT-5.4 MinimediumGemini 3.1 Flash LitelowvsStep 3.5 FlashmediumClaude Opus 4.8nonevsGPT-5.2mediumGemini 3.1 Flash Lite PreviewnonevsStep 3.5 FlashmediumClaude Opus 4.8nonevsGLM 5V TurbomediumClaude Opus 4.8nonevsGPT-5.4 NanomediumClaude Opus 4.8nonevsGPT-5 MinimediumClaude Opus 4.8nonevsKimi K2.6mediumInapatikana bureClaude Opus 4.8nonevsMiMo-V2.5medium