Urambazaji
AI BENCHY
Advertise here

AI BENCHY Compare

Anthropic: Claude Sonnet 4.6 vs StepFun: Step 3.7 Flash

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-05-29

Kipimo Claude Sonnet 4.6 Claude Sonnet 4.6 medium Toleo: 2026-02-17 Step 3.7 Flash Step 3.7 Flash low Toleo: 2026-05-29
Alama 7.6 7.4
Nafasi #53 #60
Uaminifu 10.0 10.0
Uthabiti 9.2 8.7
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 68.3% 68.3%
Majaribio yasiyo thabiti 2 3
Jumla ya uendeshaji 60 60
Gharama kwa matokeo 10.229 2.796
Jumla ya gharama $1.330 $0.336
Bei ya ingizo $3.000 / 1M $0.200 / 1M
Bei ya toleo $15.000 / 1M $1.150 / 1M
Tokeni za matokeo 49,891 285,209
Tokeni za hoja 29,565 0
Muda wa majibu (wastani) 15.81s 16.06s
Muda wa majibu (upeo) 46.35s 124.75s
Muda wa majibu (jumla) 189.71s 321.11s

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 6.5 10.0 50.0% 0 2.98s 1,046 1,093
Step 3.7 Flash 8.7 7.9 91.7% 1 4.02s 10,896 0
Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 6.9 6.0 66.7% 1 33.87s 11,277 3,281
Step 3.7 Flash 10.0 10.0 100.0% 0 9.43s 14,569 0
Mchanganyiko Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 10.0 10.0 100.0% 0 46.35s 5,871 3,962
Step 3.7 Flash 10.0 10.0 100.0% 0 7.98s 6,426 0
Uchanganuzi na uchimbaji wa data Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 10.0 10.0 100.0% 0 13.90s 649 742
Step 3.7 Flash 7.3 5.8 83.3% 1 2.29s 2,667 0
Mahususi kwa domeni Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 2.9 7.2 11.1% 1 0ms 25,790 16,919
Step 3.7 Flash 5.3 7.2 44.4% 1 43.31s 104,487 0
Akili ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 10.0 10.0 100.0% 0 4.94s 256 433
Step 3.7 Flash 3.4 9.3 0.0% 0 7.00s 4,604 0
Ufuataji wa maagizo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 10.0 10.0 100.0% 0 2.61s 318 552
Step 3.7 Flash 9.8 10.0 100.0% 0 1.58s 1,857 0
Utatuzi wa mafumbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 10.0 10.0 100.0% 0 5.31s 592 646
Step 3.7 Flash 5.5 9.9 33.3% 0 1.84s 3,564 0
Mwito wa zana Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 10.0 10.0 100.0% 0 7.48s 655 351
Step 3.7 Flash 10.0 10.0 100.0% 0 3.25s 1,360 0
Maarifa ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 3.0 10.0 0.0% 0 30.09s 3,437 1,586
Step 3.7 Flash 3.0 10.0 0.0% 0 124.75s 134,779 0

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

Kimi K2.6mediumInapatikana burevsStep 3.7 FlashlowStep 3.7 FlashlowvsMiMo-V2.5mediumGPT-5.3 ChatnonevsStep 3.7 FlashlowStep 3.7 FlashlowvsGLM 5V TurbomediumStep 3.7 FlashlowvsGLM 5.1mediumGPT-5.2mediumvsStep 3.7 FlashlowGPT-5.4 MinimediumvsStep 3.7 FlashlowClaude Sonnet 4.6mediumvsGemini 3.1 Flash Lite PreviewlowClaude Sonnet 4.6mediumvsDeepSeek V4 FlashhighInapatikana bureGemini 3.1 Flash Lite PreviewnonevsStep 3.7 FlashlowClaude Sonnet 4.6mediumvsGemini 3 Flash PreviewnoneClaude Sonnet 4.6mediumvsGemini 3.1 Flash Lite Previewnone