Urambazaji
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

KAT-Coder-Pro V2.5 (low) vs Qwen3.7 Flash (medium)

Qwen3.7 Flash (medium) inaongoza kwa average score: 6.6 vs 6.5. Qwen3.7 Flash (medium) ina gharama ya chini ya benchmark: $0.076 vs $0.568. KAT-Coder-Pro V2.5 (low) ni ya haraka zaidi: 19.40s vs 51.80s, na pass rates 65.2% vs 62.3%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-11-16

Modeli zilizolinganishwa

Nafasi
#271
Jumla ya tokeni za matokeo
113,193
Muda wa majibu (wastani)
19.40s
Jumla ya gharama
$0.568
Nafasi
#266
Jumla ya tokeni za matokeo
514,925
Muda wa majibu (wastani)
51.80s
Jumla ya gharama
$0.076
Muundo unaopendekezwa Qwen3.7 Flash (medium)

It has the best score here (6.6), while costing about 7.5x less than KAT-Coder-Pro V2.5 (low).

Ulinganisho wa kina

Kipimo KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 low Toleo: 2026-07-14 Qwen3.7 Flash Qwen3.7 Flash medium Toleo: 2026-07-28
Alama 6.5 6.6
Nafasi #271 #266
Uaminifu 10.0 10.0
Uthabiti 7.1 7.3
Majaribio 69/69 69/69
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 65.2% 62.3%
Majaribio yasiyo thabiti 8 8
Jumla ya uendeshaji 69 69
Gharama kwa matokeo 3.636 0.760
Jumla ya gharama $0.568 $0.076
Bei ya ingizo $0.740 / 1M $0.030 / 1M
Bei ya toleo $2.960 / 1M $0.130 / 1M
Bei ya kusoma akiba $0.150 / 1M $0.006 / 1M
Bei ya kuandika akiba Haipo $0.039 / 1M
Jumla ya tokeni za ingizo 87,682 300,394
Tokeni za matokeo 7,166 14,081
Tokeni za hoja 106,027 500,844
Muda wa majibu (wastani) 19.40s 51.80s
Muda wa majibu (upeo) 209.15s 593.64s
Muda wa majibu (jumla) 446.11s 1191.42s
Vigezo ~700B jumla (~72B vinavyotumika) ~35B jumla (~3B vinavyotumika)
Upatikanaji Imefungwa Imefungwa

Bei za akiba zinahusu tokeni za ingizo. Kusoma hutumia tena maelekezo yaliyohifadhiwa; kuandika huyahifadhi na kunaweza kuongeza gharama. Tokeni za matokeo hutumia bei ya matokeo.

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#271 KAT-Coder-Pro V2.5

low
Gharama
$0.016
Muda
47.6s
Tokeni
5,182 tok

#266 Qwen3.7 Flash

medium
Reached the allocated time limit (600 seconds) without receiving showcase output.
Gharama
$0.000
Muda
600.0s
Tokeni
0 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
KAT-Coder-Pro V2.5 7.8 10.0 66.7% 0 24.87s 7,893 402 24,945
Qwen3.7 Flash 6.2 6.9 55.6% 1 46.78s 7,893 563 61,902

Badilisha jozi ya ulinganisho