- Nafasi
- #378
- Jumla ya tokeni za matokeo
- 66,576
- Muda wa majibu (wastani)
- 8.32s
- Jumla ya gharama
- $0.048
KAT Coder AIR V2.5 (medium) vs Nemotron 3.5 Lightning (high)
Nemotron 3.5 Lightning (high) inaongoza kwa average score: 5.2 vs 5.1. KAT Coder AIR V2.5 (medium) ina gharama ya chini ya benchmark: $0.048 vs $0.168. KAT Coder AIR V2.5 (medium) ni ya haraka zaidi: 8.32s vs 77.08s, na pass rates 43.5% vs 47.8%.
Modeli zilizolinganishwa
- Nafasi
- #371
- Jumla ya tokeni za matokeo
- 626,081
- Muda wa majibu (wastani)
- 77.08s
- Jumla ya gharama
- $0.168
Muundo unaopendekezwa
KAT Coder AIR V2.5 (medium)
Its score stays close to the best score here (5.1 vs 5.2), while costing about 3.5x less than Nemotron 3.5 Lightning (high).
Ulinganisho wa kina
| Kipimo | KAT Coder AIR V2.5 KAT Coder AIR V2.5 medium | Nemotron 3.5 Lightning Nemotron 3.5 Lightning high Inapatikana bure |
|---|---|---|
| Alama | 5.1 | 5.2 |
| Nafasi | #378 | #371 |
| Uaminifu | 9.6 | 9.6 |
| Uthabiti | 8.9 | 5.7 |
| Majaribio | 69/69 | 69/69 |
| Majaribio sahihi | ||
| Kiwango cha kupita kwa kila jaribio | 43.5% | 47.8% |
| Majaribio yasiyo thabiti | 3 | 12 |
| Jumla ya uendeshaji | 69 | 69 |
| Gharama kwa matokeo | 0.596 | 0.000 |
| Jumla ya gharama | $0.048 | $0.168 |
| Bei ya ingizo | $0.150 / 1M | $0.060 / 1M |
| Bei ya toleo | $0.600 / 1M | $0.160 / 1M |
| Bei ya kusoma akiba | Haipo | $0.030 / 1M |
| Bei ya kuandika akiba | Haipo | Haipo |
| Jumla ya tokeni za ingizo | 51,369 | 170,517 |
| Tokeni za matokeo | 8,008 | 149,968 |
| Tokeni za hoja | 58,568 | 509,725 |
| Muda wa majibu (wastani) | 8.32s | 77.08s |
| Muda wa majibu (upeo) | 48.19s | 490.99s |
| Muda wa majibu (jumla) | 191.40s | 1772.78s |
| Vigezo | ~35B jumla (~3B vinavyotumika) | 30B jumla (3B vinavyotumika) |
| Upatikanaji | Imefungwa | Uzani unapatikana |
Bei za akiba zinahusu tokeni za ingizo. Kusoma hutumia tena maelekezo yaliyohifadhiwa; kuandika huyahifadhi na kunaweza kuongeza gharama. Tokeni za matokeo hutumia bei ya matokeo.
Onyesho la kizazi cha modeli
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#378 KAT Coder AIR V2.5
medium- Gharama
- $0.003
- Muda
- 23.7s
- Tokeni
- 4,924 tok
#371 Nemotron 3.5 Lightning
high- Gharama
- $0.000
- Muda
- 92.8s
- Tokeni
- 11,343 tok
Mgawanyo wa kategoria
| Kazi za mawakala | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 3.0 | 10.0 | 0.0% | 0 | 1.05s | 0 | 0 | 0 | |
| Nemotron 3.5 Lightning | 3.5 | 8.3 | 0.0% | 0 | 490.99s | 52,501 | 1,624 | 3,472 |
| Mbinu za kupinga AI | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 8.7 | 8.0 | 91.7% | 1 | 3.79s | 672 | 549 | 4,194 | |
| Nemotron 3.5 Lightning | 5.5 | 3.7 | 66.7% | 3 | 10.29s | 696 | 2,432 | 15,948 |
| Uandishi wa msimbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 3.6 | 7.0 | 22.2% | 1 | 23.37s | 7,893 | 5,199 | 29,973 | |
| Nemotron 3.5 Lightning | 4.4 | 5.1 | 33.3% | 2 | 168.41s | 7,623 | 68,533 | 242,319 |
| Mchanganyiko | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 6.5 | 10.0 | 50.0% | 0 | 19.56s | 23,854 | 435 | 6,811 | |
| Nemotron 3.5 Lightning | 6.4 | 10.0 | 50.0% | 0 | 160.45s | 90,257 | 17,550 | 119,725 |
| Uchanganuzi na uchimbaji wa data | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 6.5 | 10.0 | 50.0% | 0 | 3.65s | 7,776 | 268 | 1,881 | |
| Nemotron 3.5 Lightning | 7.3 | 5.9 | 83.3% | 1 | 13.99s | 7,944 | 3,210 | 16,835 |
| Mahususi kwa domeni | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 3.0 | 10.0 | 0.0% | 0 | 6.58s | 668 | 673 | 4,670 | |
| Nemotron 3.5 Lightning | 2.9 | 4.4 | 22.2% | 2 | 88.61s | 798 | 45,616 | 72,496 |
| Akili ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 5.0 | 10.0 | 0.0% | 0 | 9.81s | 516 | 189 | 557 | |
| Nemotron 3.5 Lightning | 3.7 | 9.5 | 0.0% | 0 | 7.58s | 516 | 4,331 | 4,408 |
| Ufuataji wa maagizo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 10.0 | 10.0 | 100.0% | 0 | 1.50s | 699 | 93 | 730 | |
| Nemotron 3.5 Lightning | 8.5 | 6.8 | 83.3% | 1 | 4.98s | 723 | 502 | 3,779 |
| Utatuzi wa mafumbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 3.6 | 7.2 | 22.2% | 1 | 1.87s | 696 | 265 | 1,184 | |
| Nemotron 3.5 Lightning | 3.6 | 1.8 | 44.4% | 3 | 6.09s | 726 | 1,236 | 9,851 |
| Mwito wa zana | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 10.0 | 10.0 | 100.0% | 0 | 4.77s | 8,391 | 317 | 906 | |
| Nemotron 3.5 Lightning | 10.0 | 10.0 | 100.0% | 0 | 6.92s | 8,526 | 3,745 | 3,781 |
| Maarifa ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 3.0 | 10.0 | 0.0% | 0 | 15.74s | 204 | 20 | 7,662 | |
| Nemotron 3.5 Lightning | 3.0 | 10.0 | 0.0% | 0 | 77.98s | 207 | 1,189 | 17,111 |
Ulinganisho wa haraka
Badilisha jozi ya ulinganisho
Mercury 2.5lowvsKAT Coder AIR V2.5mediumKAT Coder AIR V2.5mediumvsMiMo-V2.5-PrononeLing 3.0 FlashnonevsNemotron 3.5 LightninghighInapatikana bureKAT Coder AIR V2.5mediumvsMistral Small 4noneNemotron 3.5 LightninghighInapatikana burevsInkling SmalllowInapatikana bureApodex 1.1 MinidefaultInapatikana burevsKAT Coder AIR V2.5mediumMistral Small 4mediumvsNemotron 3.5 LightninghighInapatikana bureMistral Small 4nonevsNemotron 3.5 LightninghighInapatikana bureNemotron 3.5 LightninghighInapatikana burevsQwen3.6 35B A3BnoneMercury 2.5lowvsNemotron 3.5 LightninghighInapatikana bureNemotron 3.5 LightninghighInapatikana burevsLaguna XS 2.1noneInapatikana bureMercury 2.5 PreviewlowvsKAT Coder AIR V2.5medium