Urambazaji
AI BENCHY
Your ad here

AI BENCHY Compare

Anthropic: Claude Opus 4.7 vs StepFun: Step 3.5 Flash

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-04-16

Kipimo Claude Opus 4.7 Claude Opus 4.7 none Toleo: 2026-04-16 Step 3.5 Flash Step 3.5 Flash medium Toleo: 2026-02-01
Alama 9.2 7.9
Nafasi #4 #30
Uthabiti 10.0 9.1
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 88.9% 70.6%
Majaribio yasiyo thabiti 0 2
Jumla ya uendeshaji 54 49
Gharama kwa matokeo 3.155 0.000
Jumla ya gharama $0.505 $0.000
Bei ya ingizo $5.000 / 1M $0.100 / 1M
Bei ya toleo $25.000 / 1M $0.300 / 1M
Tokeni za matokeo 6,326 71,904
Tokeni za hoja 0 155,607
Muda wa majibu (wastani) 3.13s 26.78s
Muda wa majibu (upeo) 18.27s 170.45s
Muda wa majibu (jumla) 56.33s 294.58s

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.7 8.3 10.0 75.0% 0 2.12s 522 0
Step 3.5 Flash 10.0 10.0 100.0% 0 13.56s 14,376 17,668
Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.7 10.0 10.0 100.0% 0 2.84s 494 0
Step 3.5 Flash - - - - - - - -
Mchanganyiko Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.7 9.5 10.0 100.0% 0 18.27s 3,504 0
Step 3.5 Flash 10.0 10.0 100.0% 0 29.57s 1,176 12,984
Uchanganuzi na uchimbaji wa data Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.7 10.0 10.0 100.0% 0 2.15s 324 0
Step 3.5 Flash 10.0 10.0 100.0% 0 15.01s 600 13,886
Mahususi kwa domeni Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.7 7.7 10.0 66.7% 0 1.19s 78 0
Step 3.5 Flash 5.3 7.2 44.4% 1 170.45s 45,350 90,436
Akili ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.7 10.0 10.0 100.0% 0 3.47s 257 0
Step 3.5 Flash 5.5 10.0 0.0% 0 6.54s 2,214 2,584
Ufuataji wa maagizo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.7 10.0 10.0 100.0% 0 1.46s 114 0
Step 3.5 Flash 8.5 6.8 83.3% 1 4.98s 2,284 3,412
Utatuzi wa mafumbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.7 10.0 10.0 100.0% 0 2.58s 661 0
Step 3.5 Flash 5.3 10.0 33.3% 0 7.72s 5,629 10,835
Mwito wa zana Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Opus 4.7 10.0 10.0 100.0% 0 4.74s 372 0
Step 3.5 Flash 10.0 10.0 100.0% 0 11.91s 275 3,802

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho