AI BENCHY Compare

Kwaipilot: KAT-Coder-Air V2.5 vs Nemotron 3 Ultra 550b A55b

Muhtasari

Nemotron 3 Ultra 550b A55b inaongoza kwa average score: 6.1 vs 6.0. Nemotron 3 Ultra 550b A55b ina gharama ya chini ya benchmark: $0.027 vs $0.030. Nemotron 3 Ultra 550b A55b ni ya haraka zaidi: 2.27s vs 6.47s, na pass rates 46.0% vs 44.4%.

Muundo unaopendekezwaNemotron 3 Ultra 550b A55bIt has the best score here (6.1), while responding about 2.8x faster than KAT-Coder-Air V2.5 (low).

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-07-14

Kipimo	KAT-Coder-Air V2.5 KAT-Coder-Air V2.5 low Toleo: 2026-07-14	Nemotron 3 Ultra 550b A55b Nemotron 3 Ultra 550b A55b none Toleo: 2026-06-04 Inapatikana bure

Kipimo	KAT-Coder-Air V2.5 KAT-Coder-Air V2.5 low Toleo: 2026-07-14	Nemotron 3 Ultra 550b A55b Nemotron 3 Ultra 550b A55b none Toleo: 2026-06-04 Inapatikana bure
Alama	6.0	6.1
Nafasi	#124	#121
Uaminifu	9.7	10.0
Uthabiti	7.6	9.2
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio	46.0%	44.4%
Majaribio yasiyo thabiti	6	2
Jumla ya uendeshaji	63	63
Gharama kwa matokeo	0.427	0.000
Jumla ya gharama	$0.030	$0.027
Bei ya ingizo	$0.150 / 1M	$0.500 / 1M
Bei ya toleo	$0.600 / 1M	$2.200 / 1M
Jumla ya tokeni za ingizo	42,464	43,326
Tokeni za matokeo	4,227	2,138
Tokeni za hoja	34,864	0
Muda wa majibu (wastani)	6.47s	2.27s
Muda wa majibu (upeo)	25.49s	13.49s
Muda wa majibu (jumla)	135.80s	47.65s

Onyesho la kizazi

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#124 KAT-Coder-Air V2.5

low

Gharama: $0.004
Muda: 29.9s
Tokeni: 6,008 tok

#121 Nemotron 3 Ultra 550b A55b

none

Gharama: $0.000
Muda: 149.6s
Tokeni: 3,405 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Kategoria:

Mbinu za kupinga AI	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Air V2.5	7.3	5.8	83.3%	2		3.50s	672	422	1,548
Nemotron 3 Ultra 550b A55b	3.5	8.0	16.7%	1		2.35s	696	239	0

Uandishi wa msimbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Air V2.5	3.5	7.3	11.1%	1		11.06s	7,893	2,001	13,623
Nemotron 3 Ultra 550b A55b	5.5	10.0	33.3%	0		1.02s	7,623	369	0

Mchanganyiko	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Air V2.5	10.0	10.0	100.0%	0		25.49s	15,132	368	5,707
Nemotron 3 Ultra 550b A55b	3.0	10.0	0.0%	0		4.79s	15,558	357	0

Uchanganuzi na uchimbaji wa data	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Air V2.5	6.5	10.0	50.0%	0		2.82s	7,776	261	1,069
Nemotron 3 Ultra 550b A55b	10.0	10.0	100.0%	0		1.94s	7,944	249	0

Mahususi kwa domeni	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Air V2.5	2.9	7.2	11.1%	1		4.99s	553	310	3,332
Nemotron 3 Ultra 550b A55b	5.3	10.0	33.3%	0		698ms	789	27	0

Akili ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Air V2.5	5.0	10.0	0.0%	0		10.11s	516	142	596
Nemotron 3 Ultra 550b A55b	5.0	10.0	0.0%	0		13.49s	516	101	0

Ufuataji wa maagizo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Air V2.5	9.8	10.0	100.0%	0		1.64s	699	89	640
Nemotron 3 Ultra 550b A55b	10.0	10.0	100.0%	0		1.46s	723	69	0

Utatuzi wa mafumbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Air V2.5	3.1	4.6	22.2%	2		1.57s	696	294	796
Nemotron 3 Ultra 550b A55b	5.9	7.2	55.6%	1		1.06s	726	352	0

Mwito wa zana	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Air V2.5	10.0	10.0	100.0%	0		4.47s	8,391	330	1,065
Nemotron 3 Ultra 550b A55b	10.0	10.0	100.0%	0		2.99s	8,544	264	0

Maarifa ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
KAT-Coder-Air V2.5	3.0	10.0	0.0%	0		19.98s	136	10	6,488
Nemotron 3 Ultra 550b A55b	3.0	10.0	0.0%	0		1.83s	207	111	0

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho