Urambazaji
AI BENCHY
Your ad here

AI BENCHY Compare

Anthropic: Claude Sonnet 4.6 vs Google: Gemma 4 31B

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-04-02

Kipimo Claude Sonnet 4.6 Claude Sonnet 4.6 none Toleo: 2026-02-17 Gemma 4 31B Gemma 4 31B medium Toleo: 2026-04-02
Alama 7.3 8.6
Nafasi #38 #5
Uthabiti 9.6 9.6
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 62.8% 80.4%
Majaribio yasiyo thabiti 1 1
Jumla ya uendeshaji 51 51
Gharama kwa matokeo 2.512 0.109
Jumla ya gharama $0.252 $0.015
Bei ya ingizo $3.000 / 1M $0.140 / 1M
Bei ya toleo $15.000 / 1M $0.400 / 1M
Tokeni za matokeo 6,910 9,568
Tokeni za hoja 0 22,501
Muda wa majibu (wastani) 5.12s 21.81s
Muda wa majibu (upeo) 23.84s 68.92s
Muda wa majibu (jumla) 51.16s 327.16s

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 4.8 10.0 25.0% 0 2.94s 1,214 0
Gemma 4 31B 10.0 10.0 100.0% 0 12.89s 962 2,046
Mchanganyiko Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 9.5 10.0 100.0% 0 23.84s 3,766 0
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0
Uchanganuzi na uchimbaji wa data Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 10.0 10.0 100.0% 0 3.43s 252 0
Gemma 4 31B 10.0 10.0 100.0% 0 21.11s 1,822 2,951
Mahususi kwa domeni Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 7.7 10.0 66.7% 0 3.54s 413 0
Gemma 4 31B 7.7 10.0 66.7% 0 38.48s 4,349 8,985
Akili ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 6.1 3.1 66.7% 1 2.56s 192 0
Gemma 4 31B 10.0 10.0 100.0% 0 9.57s 105 888
Ufuataji wa maagizo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 6.5 10.0 50.0% 0 1.96s 90 0
Gemma 4 31B 10.0 10.0 100.0% 0 12.76s 533 2,035
Puzzle Solving Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 7.7 10.0 66.7% 0 2.92s 536 0
Gemma 4 31B 8.8 7.9 88.9% 1 27.63s 1,797 5,596
Mwito wa zana Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Claude Sonnet 4.6 10.0 10.0 100.0% 0 4.11s 447 0
Gemma 4 31B 3.0 10.0 0.0% 0 0ms 0 0

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho