Urambazaji
AI BENCHY
Advertise here

AI BENCHY Compare

StepFun: Step 3.7 Flash vs Xiaomi: MiMo-V2.5

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-05-29

Kipimo Step 3.7 Flash Step 3.7 Flash low Toleo: 2026-05-29 MiMo-V2.5 MiMo-V2.5 medium Toleo: 2026-04-22
Alama 7.4 7.4
Nafasi #60 #58
Uaminifu 10.0 10.0
Uthabiti 8.7 8.4
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 68.3% 70.0%
Majaribio yasiyo thabiti 3 4
Jumla ya uendeshaji 60 60
Gharama kwa matokeo 2.796 2.876
Jumla ya gharama $0.336 $0.346
Bei ya ingizo $0.200 / 1M $0.140 / 1M
Bei ya toleo $1.150 / 1M $0.280 / 1M
Tokeni za matokeo 285,209 2,806
Tokeni za hoja 0 161,888
Muda wa majibu (wastani) 16.06s 20.35s
Muda wa majibu (upeo) 124.75s 97.49s
Muda wa majibu (jumla) 321.11s 406.94s

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Step 3.7 Flash 8.7 7.9 91.7% 1 4.02s 10,896 0
MiMo-V2.5 10.0 10.0 100.0% 0 4.14s 281 1,739
Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Step 3.7 Flash 10.0 10.0 100.0% 0 9.43s 14,569 0
MiMo-V2.5 6.9 6.2 66.7% 1 64.48s 536 44,967
Mchanganyiko Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Step 3.7 Flash 10.0 10.0 100.0% 0 7.98s 6,426 0
MiMo-V2.5 10.0 10.0 100.0% 0 16.86s 363 7,609
Uchanganuzi na uchimbaji wa data Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Step 3.7 Flash 7.3 5.8 83.3% 1 2.29s 2,667 0
MiMo-V2.5 2.7 5.7 16.7% 1 6.33s 306 5,714
Mahususi kwa domeni Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Step 3.7 Flash 5.3 7.2 44.4% 1 43.31s 104,487 0
MiMo-V2.5 5.3 10.0 33.3% 0 34.53s 507 49,478
Akili ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Step 3.7 Flash 3.4 9.3 0.0% 0 7.00s 4,604 0
MiMo-V2.5 5.4 2.5 66.7% 1 5.37s 121 418
Ufuataji wa maagizo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Step 3.7 Flash 9.8 10.0 100.0% 0 1.58s 1,857 0
MiMo-V2.5 9.9 10.0 100.0% 0 1.80s 88 801
Utatuzi wa mafumbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Step 3.7 Flash 5.5 9.9 33.3% 0 1.84s 3,564 0
MiMo-V2.5 8.2 7.2 88.9% 1 20.25s 279 33,254
Mwito wa zana Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Step 3.7 Flash 10.0 10.0 100.0% 0 3.25s 1,360 0
MiMo-V2.5 10.0 10.0 100.0% 0 7.29s 303 2,424
Maarifa ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Step 3.7 Flash 3.0 10.0 0.0% 0 124.75s 134,779 0
MiMo-V2.5 3.0 10.0 0.0% 0 51.29s 22 15,484

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho