Urambazaji
Advertise here

KAT-Coder-Pro V2.5 (high) vs Qwen3.6 35B A3B (medium)

average score iko karibu sawa: 6.5 vs 6.5. KAT-Coder-Pro V2.5 (high) ina gharama ya chini ya benchmark: $0.506 vs $0.812. KAT-Coder-Pro V2.5 (high) ni ya haraka zaidi: 21.21s vs 59.92s, na pass rates 60.9% vs 58.0%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-10-01

Modeli zilizolinganishwa

Nafasi
#198
Jumla ya tokeni za matokeo
144,359
Muda wa majibu (wastani)
21.21s
Jumla ya gharama
$0.506
Nafasi
#193
Jumla ya tokeni za matokeo
776,174
Muda wa majibu (wastani)
59.92s
Jumla ya gharama
$0.812
Muundo unaopendekezwa KAT-Coder-Pro V2.5 (high)

It has the best score here (6.5), while costing about 1.6x less than Qwen3.6 35B A3B (medium).

Ulinganisho wa kina

Kipimo KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 high Toleo: 2026-07-14 Qwen3.6 35B A3B Qwen3.6 35B A3B medium Toleo: 2026-04-20
Alama 6.5 6.5
Nafasi #198 #193
Uaminifu 10.0 10.0
Uthabiti 7.9 9.0
Majaribio 69/69 69/69
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 60.9% 58.0%
Majaribio yasiyo thabiti 6 3
Jumla ya uendeshaji 69 69
Gharama kwa matokeo 4.599 6.732
Jumla ya gharama $0.506 $0.812
Bei ya ingizo $0.740 / 1M $0.150 / 1M
Bei ya toleo $2.960 / 1M $1.000 / 1M
Jumla ya tokeni za ingizo 106,085 282,192
Tokeni za matokeo 9,071 75,306
Tokeni za hoja 135,288 700,868
Muda wa majibu (wastani) 21.21s 59.92s
Muda wa majibu (upeo) 199.97s 817.57s
Muda wa majibu (jumla) 487.83s 1258.32s
Vigezo ~700B jumla (~72B vinavyotumika) 35B jumla (3B vinavyotumika)
Upatikanaji Imefungwa Chanzo huria

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#198 KAT-Coder-Pro V2.5

high
Gharama
$0.009
Muda
26.4s
Tokeni
3,117 tok

#193 Qwen3.6 35B A3B

medium
Reached the allocated time limit (300 seconds) without receiving showcase output.
Gharama
$0.000
Muda
300.0s
Tokeni
0 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
KAT-Coder-Pro V2.5 6.4 7.9 44.4% 1 22.00s 7,893 422 20,461
Qwen3.6 35B A3B 7.7 10.0 66.7% 0 50.55s 5,051 7,929 37,223

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho