Urambazaji
AI BENCHY
Your ad here

AI BENCHY Compare

ByteDance Seed: Seed-2.0-Lite vs StepFun: Step 3.5 Flash

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-03-12

Kipimo Seed-2.0-Lite Seed-2.0-Lite none Toleo: 2026-02-14 Step 3.5 Flash Step 3.5 Flash medium Toleo: 2026-02-01 Inapatikana bure
Nafasi #45 #14
Wastani wa alama 4.9 7.4
Uthabiti 7.4 9.1
Gharama kwa matokeo 0.214 0.000
Jumla ya gharama $0.015 $0.000
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 56.3% 68.8%
Majaribio yasiyo thabiti 5 2
Jumla ya uendeshaji 48 48
Tokeni za matokeo 2,743 71,452
Tokeni za hoja 0 155,147
Muda wa majibu (wastani) 2.49s 29.10s
Muda wa majibu (upeo) 6.70s 170.45s
Muda wa majibu (jumla) 39.91s 290.96s

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Wastani wa alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Wastani wa alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Seed-2.0-Lite 10.0 4.6 22.2% 2 2.93s 703 0
Step 3.5 Flash 10.0 10.0 100.0% 0 18.54s 13,924 17,208
Mchanganyiko Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Seed-2.0-Lite 10.0 10.0 0.0% 0 6.59s 498 0
Step 3.5 Flash 10.0 10.0 100.0% 0 29.57s 1,176 12,984
Uchanganuzi na uchimbaji wa data Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Seed-2.0-Lite 9.9 10.0 100.0% 0 1.82s 246 0
Step 3.5 Flash 10.0 10.0 100.0% 0 15.01s 600 13,886
Mahususi kwa domeni Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Seed-2.0-Lite 10.0 7.2 22.2% 1 1.33s 17 0
Step 3.5 Flash 4.0 7.2 44.4% 1 170.45s 45,350 90,436
Akili ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Seed-2.0-Lite 10.0 10.0 100.0% 0 3.45s 294 0
Step 3.5 Flash 6.0 10.0 0.0% 0 6.54s 2,214 2,584
Ufuataji wa maagizo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Seed-2.0-Lite 10.0 10.0 100.0% 0 1.06s 73 0
Step 3.5 Flash 9.0 6.8 83.3% 1 4.98s 2,284 3,412
Puzzle Solving Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Seed-2.0-Lite 4.0 4.4 55.6% 2 2.46s 620 0
Step 3.5 Flash 4.0 10.0 33.3% 0 7.72s 5,629 10,835
Mwito wa zana Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Seed-2.0-Lite 10.0 10.0 100.0% 0 3.94s 292 0
Step 3.5 Flash 10.0 10.0 100.0% 0 11.91s 275 3,802

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

GPT-5.2 ChatnonevsStep 3.5 FlashmediumInapatikana bureSeed-2.0-LitenonevsGrok 4.20 Multi-Agent BetamediumGemini 3.1 Flash Lite PreviewlowvsStep 3.5 FlashmediumInapatikana bureGPT-5.3 ChatnonevsStep 3.5 FlashmediumInapatikana bureSeed-2.0-Litenonevsgpt-oss-120bmediumInapatikana bureSeed-2.0-LitenonevsMiniMax M2.5mediumGemini 3 Flash PreviewnonevsStep 3.5 FlashmediumInapatikana bureGemini 3.1 Flash Lite PreviewnonevsStep 3.5 FlashmediumInapatikana bureSeed-2.0-LitenonevsMercury 2mediumSeed-2.0-LitenonevsQwen3.5-35B-A3BmediumSeed-2.0-LitenonevsGPT-5 NanomediumClaude Sonnet 4.6nonevsStep 3.5 FlashmediumInapatikana bure