Urambazaji
AI BENCHY
Your ad here

AI BENCHY Compare

Nemotron 3 Super 120b A12b vs StepFun: Step 3.5 Flash

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-03-12

Kipimo Nemotron 3 Super 120b A12b Nemotron 3 Super 120b A12b none Toleo: 2026-03-11 Inapatikana bure Step 3.5 Flash Step 3.5 Flash medium Toleo: 2026-02-01 Inapatikana bure
Nafasi #59 #14
Wastani wa alama 3.4 7.4
Uthabiti 8.6 9.1
Gharama kwa matokeo 0.000 0.000
Jumla ya gharama $0.000 $0.000
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 31.3% 68.8%
Majaribio yasiyo thabiti 3 2
Jumla ya uendeshaji 48 48
Tokeni za matokeo 4,222 71,452
Tokeni za hoja 0 155,147
Muda wa majibu (wastani) 8.90s 29.10s
Muda wa majibu (upeo) 24.97s 170.45s
Muda wa majibu (jumla) 142.40s 290.96s

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Wastani wa alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Wastani wa alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Nemotron 3 Super 120b A12b 10.0 10.0 0.0% 0 7.14s 2,171 0
Step 3.5 Flash 10.0 10.0 100.0% 0 18.54s 13,924 17,208
Mchanganyiko Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Nemotron 3 Super 120b A12b 10.0 10.0 0.0% 0 19.98s 124 0
Step 3.5 Flash 10.0 10.0 100.0% 0 29.57s 1,176 12,984
Uchanganuzi na uchimbaji wa data Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Nemotron 3 Super 120b A12b 9.9 10.0 100.0% 0 7.92s 249 0
Step 3.5 Flash 10.0 10.0 100.0% 0 15.01s 600 13,886
Mahususi kwa domeni Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Nemotron 3 Super 120b A12b 10.0 7.2 22.2% 1 6.23s 26 0
Step 3.5 Flash 4.0 7.2 44.4% 1 170.45s 45,350 90,436
Akili ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Nemotron 3 Super 120b A12b 3.0 9.9 0.0% 0 24.97s 170 0
Step 3.5 Flash 6.0 10.0 0.0% 0 6.54s 2,214 2,584
Ufuataji wa maagizo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Nemotron 3 Super 120b A12b 4.5 6.9 33.3% 1 1.50s 66 0
Step 3.5 Flash 9.0 6.8 83.3% 1 4.98s 2,284 3,412
Puzzle Solving Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Nemotron 3 Super 120b A12b 4.7 10.0 33.3% 0 7.50s 1,135 0
Step 3.5 Flash 4.0 10.0 33.3% 0 7.72s 5,629 10,835
Mwito wa zana Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Nemotron 3 Super 120b A12b 10.0 1.6 66.7% 1 16.00s 281 0
Step 3.5 Flash 10.0 10.0 100.0% 0 11.91s 275 3,802

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

GPT-5.2 ChatnonevsStep 3.5 FlashmediumInapatikana bureNemotron 3 Super 120b A12bnoneInapatikana burevsQwen3 Coder NextmediumGemini 3.1 Flash Lite PreviewlowvsStep 3.5 FlashmediumInapatikana bureGPT-5.3 ChatnonevsStep 3.5 FlashmediumInapatikana bureGemini 3 Flash PreviewnonevsStep 3.5 FlashmediumInapatikana bureNemotron 3 Super 120b A12bnoneInapatikana burevsGLM 4.7 FlashmediumGemini 3.1 Flash Lite PreviewnonevsStep 3.5 FlashmediumInapatikana bureClaude Sonnet 4.6nonevsStep 3.5 FlashmediumInapatikana bureGemini 3 Flash PreviewlowvsStep 3.5 FlashmediumInapatikana bureNemotron 3 Super 120b A12bnoneInapatikana burevsQwen3.5-9BmediumQwen3.5 Plus 2026-02-15nonevsStep 3.5 FlashmediumInapatikana bureMiniMax M2.5mediumvsNemotron 3 Super 120b A12bnoneInapatikana bure