Urambazaji
AI BENCHY
Your ad here

AI BENCHY Compare

Anthropic: Claude Sonnet 4.6 vs Nemotron 3 Super 120b A12b

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-03-12

Kipimo Claude Sonnet 4.6 Claude Sonnet 4.6 none Toleo: 2026-02-17 Nemotron 3 Super 120b A12b Nemotron 3 Super 120b A12b medium Toleo: 2026-03-11 Inapatikana bure
Nafasi #27 #36
Wastani wa alama 6.8 5.8
Uthabiti 9.6 8.5
Gharama kwa matokeo 2.504 0.000
Jumla ya gharama $0.251 $0.000
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 66.7% 56.3%
Majaribio yasiyo thabiti 1 3
Jumla ya uendeshaji 48 48
Tokeni za matokeo 6,895 11,925
Tokeni za hoja 0 29,687
Muda wa majibu (wastani) 5.57s 20.24s
Muda wa majibu (upeo) 23.84s 87.80s
Muda wa majibu (jumla) 50.12s 303.60s

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Wastani wa alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Wastani wa alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 4.0 10.0 33.3% 0 4.83s 1,199 0
Nemotron 3 Super 120b A12b 10.0 10.0 100.0% 0 12.96s 1,754 3,264
Mchanganyiko Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 9.0 10.0 100.0% 0 23.84s 3,766 0
Nemotron 3 Super 120b A12b 10.0 10.0 100.0% 0 87.80s 2,021 9,996
Uchanganuzi na uchimbaji wa data Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 9.9 10.0 100.0% 0 3.43s 252 0
Nemotron 3 Super 120b A12b 9.9 10.0 100.0% 0 18.16s 877 2,607
Mahususi kwa domeni Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 7.0 10.0 66.7% 0 3.54s 413 0
Nemotron 3 Super 120b A12b 10.0 4.4 22.2% 2 16.19s 5,255 6,072
Akili ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 5.0 3.1 66.7% 1 2.56s 192 0
Nemotron 3 Super 120b A12b 2.0 9.9 0.0% 0 27.86s 104 1,149
Ufuataji wa maagizo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 5.5 10.0 50.0% 0 1.96s 90 0
Nemotron 3 Super 120b A12b 7.0 6.5 66.7% 1 7.72s 1,042 2,479
Puzzle Solving Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 7.0 10.0 66.7% 0 2.92s 536 0
Nemotron 3 Super 120b A12b 1.3 9.8 0.0% 0 8.39s 602 2,151
Mwito wa zana Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 10.0 10.0 100.0% 0 4.11s 447 0
Nemotron 3 Super 120b A12b 10.0 10.0 100.0% 0 39.75s 270 1,969

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho