- Nafasi
- #223
- Jumla ya tokeni za matokeo
- 60,414
- Muda wa majibu (wastani)
- 10.63s
- Jumla ya gharama
- $0.046
KAT-Coder-Air V2.5 (low) vs Nemotron 3.5 Lightning (high)
Nemotron 3.5 Lightning (high) inaongoza kwa average score: 5.6 vs 5.4. KAT-Coder-Air V2.5 (low) ina gharama ya chini ya benchmark: $0.046 vs $0.134. KAT-Coder-Air V2.5 (low) ni ya haraka zaidi: 10.63s vs 58.26s, na pass rates 43.9% vs 50.0%.
- Nafasi
- #216
- Jumla ya tokeni za matokeo
- 654,597
- Muda wa majibu (wastani)
- 58.26s
- Jumla ya gharama
- $0.134
Muundo unaopendekezwa
KAT-Coder-Air V2.5 (low)
Its score stays close to the best score here (5.4 vs 5.6), while costing about 2.9x less than Nemotron 3.5 Lightning (high).
Ulinganisho wa kina
| Kipimo | KAT-Coder-Air V2.5 KAT-Coder-Air V2.5 low | Nemotron 3.5 Lightning Nemotron 3.5 Lightning high Inapatikana bure |
|---|---|---|
| Alama | 5.4 | 5.6 |
| Nafasi | #223 | #216 |
| Uaminifu | 9.9 | 9.9 |
| Uthabiti | 7.8 | 5.6 |
| Majaribio | 66/66 | 66/66 |
| Majaribio sahihi | ||
| Kiwango cha kupita kwa kila jaribio | 43.9% | 50.0% |
| Majaribio yasiyo thabiti | 6 | 12 |
| Jumla ya uendeshaji | 66 | 66 |
| Gharama kwa matokeo | 0.649 | 0.000 |
| Jumla ya gharama | $0.046 | $0.134 |
| Bei ya ingizo | $0.150 / 1M | $0.080 / 1M |
| Bei ya toleo | $0.600 / 1M | $0.200 / 1M |
| Jumla ya tokeni za ingizo | 61,094 | 118,016 |
| Tokeni za matokeo | 6,532 | 148,344 |
| Tokeni za hoja | 53,882 | 506,253 |
| Muda wa majibu (wastani) | 10.63s | 58.26s |
| Muda wa majibu (upeo) | 86.23s | 285.26s |
| Muda wa majibu (jumla) | 233.77s | 1281.79s |
| Vigezo | ~35B jumla (~3B vinavyotumika) | 30B jumla (3B vinavyotumika) |
| Upatikanaji | Imefungwa | Uzani unapatikana |
Onyesho la kizazi cha modeli
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#223 KAT-Coder-Air V2.5
low- Gharama
- $0.004
- Muda
- 29.9s
- Tokeni
- 6,008 tok
#216 Nemotron 3.5 Lightning
high- Gharama
- $0.000
- Muda
- 92.8s
- Tokeni
- 11,343 tok
Modeli bora kwa alama
Alama dhidi ya gharama ya jumla
Muda wa majibu (wastani)
Alama vs Muda wa majibu (wastani)
Jumla ya tokeni za matokeo
Alama vs Jumla ya tokeni za matokeo
Mgawanyo wa kategoria
| Mbinu za kupinga AI | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Air V2.5 | 7.3 | 5.8 | 83.3% | 2 | 3.50s | 672 | 422 | 1,548 | |
| Nemotron 3.5 Lightning | 5.5 | 3.7 | 66.7% | 3 | 10.29s | 696 | 2,432 | 15,948 |
| Uandishi wa msimbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Air V2.5 | 3.5 | 7.3 | 11.1% | 1 | 11.06s | 7,893 | 2,001 | 13,623 | |
| Nemotron 3.5 Lightning | 4.4 | 5.1 | 33.3% | 2 | 168.41s | 7,623 | 68,533 | 242,319 |
| Mchanganyiko | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Air V2.5 | 6.4 | 5.8 | 66.7% | 1 | 55.86s | 33,753 | 2,046 | 17,833 | |
| Nemotron 3.5 Lightning | 6.4 | 10.0 | 50.0% | 0 | 160.45s | 90,257 | 17,550 | 119,725 |
| Uchanganuzi na uchimbaji wa data | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Air V2.5 | 6.5 | 10.0 | 50.0% | 0 | 2.82s | 7,776 | 261 | 1,069 | |
| Nemotron 3.5 Lightning | 7.3 | 5.9 | 83.3% | 1 | 13.99s | 7,944 | 3,210 | 16,835 |
| Mahususi kwa domeni | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Air V2.5 | 3.0 | 10.0 | 0.0% | 0 | 8.91s | 562 | 937 | 10,224 | |
| Nemotron 3.5 Lightning | 2.9 | 4.4 | 22.2% | 2 | 88.61s | 798 | 45,616 | 72,496 |
| Akili ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Air V2.5 | 5.0 | 10.0 | 0.0% | 0 | 10.11s | 516 | 142 | 596 | |
| Nemotron 3.5 Lightning | 3.7 | 9.5 | 0.0% | 0 | 7.58s | 516 | 4,331 | 4,408 |
| Ufuataji wa maagizo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Air V2.5 | 9.8 | 10.0 | 100.0% | 0 | 1.64s | 699 | 89 | 640 | |
| Nemotron 3.5 Lightning | 8.5 | 6.8 | 83.3% | 1 | 4.98s | 723 | 502 | 3,779 |
| Utatuzi wa mafumbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Air V2.5 | 3.1 | 4.6 | 22.2% | 2 | 1.57s | 696 | 294 | 796 | |
| Nemotron 3.5 Lightning | 3.6 | 1.8 | 44.4% | 3 | 6.09s | 726 | 1,236 | 9,851 |
| Mwito wa zana | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Air V2.5 | 10.0 | 10.0 | 100.0% | 0 | 4.47s | 8,391 | 330 | 1,065 | |
| Nemotron 3.5 Lightning | 10.0 | 10.0 | 100.0% | 0 | 6.92s | 8,526 | 3,745 | 3,781 |
| Maarifa ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Air V2.5 | 3.0 | 10.0 | 0.0% | 0 | 19.98s | 136 | 10 | 6,488 | |
| Nemotron 3.5 Lightning | 3.0 | 10.0 | 0.0% | 0 | 77.98s | 207 | 1,189 | 17,111 |
Ulinganisho wa haraka
Badilisha jozi ya ulinganisho
KAT-Coder-Air V2.5lowvsGPT-5.6 LunanoneKAT-Coder-Air V2.5lowvsLaguna S 2.1mediumInapatikana bureKAT-Coder-Air V2.5mediumvsNemotron 3.5 LightninghighInapatikana bureKAT-Coder-Air V2.5lowvsMiMo-V2.5-PrononeNemotron 3.5 LightninghighInapatikana burevsQwen3.6 27BnoneKAT-Coder-Air V2.5lowvsKimi K2.5noneGemma 4 26B A4BnoneInapatikana burevsNemotron 3.5 LightninghighInapatikana bureNemotron 3.5 LightninghighInapatikana burevsQwen3.8 27BnoneDeepSeek V4 Flash 0731nonevsKAT-Coder-Air V2.5lowKAT-Coder-Air V2.5lowvsLaguna S 2.1highInapatikana bureDeepSeek V4 Flash 0423nonevsKAT-Coder-Air V2.5lowKAT-Coder-Air V2.5lowvsInkling Smallnone