Urambazaji
Advertise here

KAT-Coder-Pro V2.5 (high) vs GLM 5.1

average score iko karibu sawa: 6.5 vs 6.5. GLM 5.1 ina gharama ya chini ya benchmark: $0.311 vs $0.506. GLM 5.1 ni ya haraka zaidi: 11.10s vs 21.21s, na pass rates 60.9% vs 47.8%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-10-01

Modeli zilizolinganishwa

Nafasi
#198
Jumla ya tokeni za matokeo
144,359
Muda wa majibu (wastani)
21.21s
Jumla ya gharama
$0.506
Nafasi
#196
Jumla ya tokeni za matokeo
20,076
Muda wa majibu (wastani)
11.10s
Jumla ya gharama
$0.311
Muundo unaopendekezwa GLM 5.1

It has the best score here (6.5), while costing about 1.6x less than KAT-Coder-Pro V2.5 (high).

Ulinganisho wa kina

Kipimo KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 high Toleo: 2026-07-14 GLM 5.1 GLM 5.1 none Toleo: 2026-04-07
Alama 6.5 6.5
Nafasi #198 #196
Uaminifu 10.0 10.0
Uthabiti 7.9 8.2
Majaribio 69/69 69/69
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 60.9% 47.8%
Majaribio yasiyo thabiti 6 5
Jumla ya uendeshaji 69 69
Gharama kwa matokeo 4.599 3.478
Jumla ya gharama $0.506 $0.311
Bei ya ingizo $0.740 / 1M $0.965 / 1M
Bei ya toleo $2.960 / 1M $3.032 / 1M
Jumla ya tokeni za ingizo 106,085 258,956
Tokeni za matokeo 9,071 20,076
Tokeni za hoja 135,288 0
Muda wa majibu (wastani) 21.21s 11.10s
Muda wa majibu (upeo) 199.97s 107.19s
Muda wa majibu (jumla) 487.83s 255.39s
Vigezo ~700B jumla (~72B vinavyotumika) 744B jumla (40B vinavyotumika)
Upatikanaji Imefungwa Chanzo huria

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#198 KAT-Coder-Pro V2.5

high
Gharama
$0.009
Muda
26.4s
Tokeni
3,117 tok

#196 GLM 5.1

none
Reached the allocated time limit (300 seconds) without receiving showcase output.
Gharama
$0.000
Muda
300.0s
Tokeni
0 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
KAT-Coder-Pro V2.5 6.4 7.9 44.4% 1 22.00s 7,893 422 20,461
GLM 5.1 3.9 9.7 0.0% 0 4.96s 7,256 525 0

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho