Urambazaji
AI BENCHY
Advertise here

Claude Sonnet 5 vs Gemma 4 31B (medium)

average score iko karibu sawa: 6.1 vs 6.2. Gemma 4 31B (medium) ina gharama ya chini ya benchmark: $0.101 vs $0.548. Claude Sonnet 5 ni ya haraka zaidi: 6.05s vs 78.59s, na pass rates 40.9% vs 65.2%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-08-15

Nafasi
#166
Jumla ya tokeni za matokeo
22,508
Muda wa majibu (wastani)
6.05s
Jumla ya gharama
$0.548
Nafasi
#164
Jumla ya tokeni za matokeo
267,421
Muda wa majibu (wastani)
78.59s
Jumla ya gharama
$0.101
Muundo unaopendekezwa Gemma 4 31B (medium)

It has the best score here (6.2), while costing about 5.4x less than Claude Sonnet 5.

Ulinganisho wa kina

Kipimo Claude Sonnet 5 Claude Sonnet 5 none Toleo: 2026-06-30 Gemma 4 31B Gemma 4 31B medium Toleo: 2026-04-02 Inapatikana bure
Alama 6.1 6.2
Nafasi #166 #164
Uaminifu 10.0 10.0
Uthabiti 8.7 8.7
Majaribio 66/66 66/66
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 40.9% 65.2%
Majaribio yasiyo thabiti 4 3
Jumla ya uendeshaji 66 66
Gharama kwa matokeo 7.817 1.152
Jumla ya gharama $0.548 $0.101
Bei ya ingizo $2.000 / 1M $0.100 / 1M
Bei ya toleo $10.000 / 1M $0.340 / 1M
Jumla ya tokeni za ingizo 161,032 94,969
Tokeni za matokeo 22,508 34,399
Tokeni za hoja 0 233,022
Muda wa majibu (wastani) 6.05s 78.59s
Muda wa majibu (upeo) 33.39s 437.40s
Muda wa majibu (jumla) 132.99s 1571.84s
Vigezo ~1T jumla (~100B vinavyotumika) 30.7B
Upatikanaji Imefungwa Chanzo huria

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#166 Claude Sonnet 5

none
Gharama
$0.061
Muda
53.7s
Tokeni
6,172 tok

#164 Gemma 4 31B

medium
Gharama
$0.002
Muda
45.7s
Tokeni
2,696 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Claude Sonnet 5 4.6 7.9 22.2% 1 3.67s 10,590 1,864 0
Gemma 4 31B 4.3 5.8 22.2% 1 219.76s 5,568 11,098 33,212

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

Seed-2.0-LitenonevsGemma 4 31BmediumInapatikana bureGemma 4 31BmediumInapatikana burevsGPT-5.6 LunalowClaude Sonnet 5nonevsGemini 3.1 Flash LiteminimalClaude Sonnet 5nonevsGPT-5.6 LunalowClaude Sonnet 5nonevsQwen3.5-35B-A3BmediumClaude Sonnet 5nonevsgpt-oss-120bmediumClaude Sonnet 5nonevsQwen3.5-FlashmediumClaude Sonnet 5nonevsInklinglowClaude Sonnet 5nonevsTrinity Large ThinkingmediumGemma 4 31BmediumInapatikana burevsQwen3.7 FlashnoneGemma 4 31BmediumInapatikana burevsInklinglowGemma 4 31BmediumInapatikana burevsQwen3.6 Flashnone