Urambazaji
AI BENCHY
Your ad here

AI BENCHY Compare

Anthropic: Claude Sonnet 4.6 vs xAI: Grok 4.20 Beta

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-03-12

Kipimo Claude Sonnet 4.6 Claude Sonnet 4.6 none Toleo: 2026-02-17 Grok 4.20 Beta Grok 4.20 Beta medium Toleo: 2026-03-12
Nafasi #27 #24
Wastani wa alama 6.8 7.0
Uthabiti 9.6 9.0
Gharama kwa matokeo 2.504 5.989
Jumla ya gharama $0.251 $0.599
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 66.7% 70.8%
Majaribio yasiyo thabiti 1 2
Jumla ya uendeshaji 48 48
Tokeni za matokeo 6,895 1,481
Tokeni za hoja 0 86,628
Muda wa majibu (wastani) 5.57s 8.89s
Muda wa majibu (upeo) 23.84s 24.21s
Muda wa majibu (jumla) 50.12s 142.18s

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Wastani wa alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Wastani wa alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 4.0 10.0 33.3% 0 4.83s 1,199 0
Grok 4.20 Beta 7.0 7.2 88.9% 1 3.19s 262 6,289
Mchanganyiko Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 9.0 10.0 100.0% 0 23.84s 3,766 0
Grok 4.20 Beta 10.0 10.0 100.0% 0 20.93s 227 12,212
Uchanganuzi na uchimbaji wa data Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 9.9 10.0 100.0% 0 3.43s 252 0
Grok 4.20 Beta 9.9 10.0 100.0% 0 4.01s 180 5,281
Mahususi kwa domeni Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 7.0 10.0 66.7% 0 3.54s 413 0
Grok 4.20 Beta 4.0 10.0 33.3% 0 21.33s 251 40,255
Akili ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 5.0 3.1 66.7% 1 2.56s 192 0
Grok 4.20 Beta 10.0 10.0 100.0% 0 5.78s 72 3,440
Ufuataji wa maagizo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 5.5 10.0 50.0% 0 1.96s 90 0
Grok 4.20 Beta 9.0 10.0 50.0% 0 4.97s 57 7,107
Puzzle Solving Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 7.0 10.0 66.7% 0 2.92s 536 0
Grok 4.20 Beta 7.0 7.2 88.9% 1 3.85s 249 6,660
Mwito wa zana Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 10.0 10.0 100.0% 0 4.11s 447 0
Grok 4.20 Beta 10.0 10.0 0.0% 0 12.39s 183 5,384

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

Gemini 3.1 Flash Lite PreviewnonevsGrok 4.20 BetamediumClaude Sonnet 4.6nonevsQwen3.5-FlashmediumClaude Sonnet 4.6nonevsSeed-2.0-MinimediumGemini 3 Flash PreviewnonevsGrok 4.20 BetamediumClaude Sonnet 4.6nonevsGPT-5.2mediumGPT-5.3 ChatnonevsGrok 4.20 BetamediumGemini 3.1 Flash Lite PreviewlowvsGrok 4.20 BetamediumClaude Sonnet 4.6nonevsKimi K2.5mediumClaude Sonnet 4.6nonevsMiMo-V2-FlashmediumGPT-5.2 ChatnonevsGrok 4.20 BetamediumClaude Sonnet 4.6nonevsDeepSeek V3.2mediumClaude Sonnet 4.6nonevsGemini 3.1 Flash Lite Previewlow