Urambazaji
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

KAT Coder AIR V2.5 (default) vs Nemotron 3.5 Lightning (low)

Nemotron 3.5 Lightning (low) inaongoza kwa average score: 4.6 vs 4.4. KAT Coder AIR V2.5 (default) ina gharama ya chini ya benchmark: $0.070 vs $0.175. KAT Coder AIR V2.5 (default) ni ya haraka zaidi: 11.96s vs 83.19s, na pass rates 34.8% vs 40.6%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-11-22

Modeli zilizolinganishwa

Nafasi
#465
Jumla ya tokeni za matokeo
97,752
Muda wa majibu (wastani)
11.96s
Jumla ya gharama
$0.070
Nafasi
#456
Jumla ya tokeni za matokeo
647,336
Muda wa majibu (wastani)
83.19s
Jumla ya gharama
$0.175
Muundo unaopendekezwa KAT Coder AIR V2.5 (default)

Its score stays close to the best score here (4.4 vs 4.6), while costing about 2.5x less than Nemotron 3.5 Lightning (low).

Ulinganisho wa kina

Kipimo KAT Coder AIR V2.5 KAT Coder AIR V2.5 default Toleo: 2026-07-14 Nemotron 3.5 Lightning Nemotron 3.5 Lightning low Toleo: 2026-08-11 Inapatikana bure
Alama 4.4 4.6
Nafasi #465 #456
Uaminifu 10.0 9.5
Uthabiti 7.4 6.8
Majaribio 69/69 69/69
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 34.8% 40.6%
Majaribio yasiyo thabiti 7 9
Jumla ya uendeshaji 69 69
Gharama kwa matokeo 1.382 0.000
Jumla ya gharama $0.070 $0.175
Bei ya ingizo $0.150 / 1M $0.060 / 1M
Bei ya toleo $0.600 / 1M $0.160 / 1M
Bei ya kusoma akiba Haipo $0.030 / 1M
Bei ya kuandika akiba Haipo Haipo
Jumla ya tokeni za ingizo 69,376 207,883
Tokeni za matokeo 7,792 144,718
Tokeni za hoja 89,960 525,897
Muda wa majibu (wastani) 11.96s 83.19s
Muda wa majibu (upeo) 121.05s 597.61s
Muda wa majibu (jumla) 275.18s 1913.41s
Vigezo ~35B jumla (~3B vinavyotumika) 30B jumla (3B vinavyotumika)
Upatikanaji Imefungwa Uzani unapatikana

Bei za akiba zinahusu tokeni za ingizo. Kusoma hutumia tena maelekezo yaliyohifadhiwa; kuandika huyahifadhi na kunaweza kuongeza gharama. Tokeni za matokeo hutumia bei ya matokeo.

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#465 KAT Coder AIR V2.5

default
Gharama
$0.002
Muda
14.5s
Tokeni
2,619 tok

#456 Nemotron 3.5 Lightning

low
Gharama
$0.000
Muda
32.2s
Tokeni
6,089 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
KAT Coder AIR V2.5 3.3 9.6 0.0% 0 14.31s 6,472 2,032 14,886
Nemotron 3.5 Lightning 4.0 7.8 11.1% 1 224.42s 7,522 72,614 262,558

Badilisha jozi ya ulinganisho