- Nafasi
- #348
- Jumla ya tokeni za matokeo
- 97,752
- Muda wa majibu (wastani)
- 11.96s
- Jumla ya gharama
- $0.070
KAT Coder AIR V2.5 (default) vs Nemotron 3 Super
average score iko karibu sawa: 4.4 vs 4.5. Nemotron 3 Super ina gharama ya chini ya benchmark: $0.016 vs $0.070. Nemotron 3 Super ni ya haraka zaidi: 7.11s vs 11.96s, na pass rates 34.8% vs 27.5%.
Modeli zilizolinganishwa
- Nafasi
- #347
- Jumla ya tokeni za matokeo
- 9,074
- Muda wa majibu (wastani)
- 7.11s
- Jumla ya gharama
- $0.016
Muundo unaopendekezwa
Nemotron 3 Super
It has the best score here (4.5), while costing about 4.4x less than KAT Coder AIR V2.5 (default).
Ulinganisho wa kina
| Kipimo | KAT Coder AIR V2.5 KAT Coder AIR V2.5 default | Nemotron 3 Super Nemotron 3 Super none Inapatikana bure |
|---|---|---|
| Alama | 4.4 | 4.5 |
| Nafasi | #348 | #347 |
| Uaminifu | 10.0 | 9.5 |
| Uthabiti | 7.4 | 8.9 |
| Majaribio | 69/69 | 69/69 |
| Majaribio sahihi | ||
| Kiwango cha kupita kwa kila jaribio | 34.8% | 27.5% |
| Majaribio yasiyo thabiti | 7 | 3 |
| Jumla ya uendeshaji | 69 | 69 |
| Gharama kwa matokeo | 1.382 | 0.034 |
| Jumla ya gharama | $0.070 | $0.016 |
| Bei ya ingizo | $0.150 / 1M | $0.080 / 1M |
| Bei ya toleo | $0.600 / 1M | $0.450 / 1M |
| Bei ya kusoma akiba | Haipo | Haipo |
| Bei ya kuandika akiba | Haipo | Haipo |
| Jumla ya tokeni za ingizo | 69,376 | 146,361 |
| Tokeni za matokeo | 7,792 | 9,073 |
| Tokeni za hoja | 89,960 | 1 |
| Muda wa majibu (wastani) | 11.96s | 7.11s |
| Muda wa majibu (upeo) | 121.05s | 30.51s |
| Muda wa majibu (jumla) | 275.18s | 163.46s |
| Vigezo | ~35B jumla (~3B vinavyotumika) | 120B jumla (12B vinavyotumika) |
| Upatikanaji | Imefungwa | Uzani unapatikana |
Bei za akiba zinahusu tokeni za ingizo. Kusoma hutumia tena maelekezo yaliyohifadhiwa; kuandika huyahifadhi na kunaweza kuongeza gharama. Tokeni za matokeo hutumia bei ya matokeo.
Onyesho la kizazi cha modeli
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#348 KAT Coder AIR V2.5
default- Gharama
- $0.002
- Muda
- 14.5s
- Tokeni
- 2,619 tok
#347 Nemotron 3 Super
none- Gharama
- $0.000
- Muda
- 137.8s
- Tokeni
- 2,447 tok
Modeli bora kwa alama
Alama dhidi ya gharama ya jumla
Muda wa majibu (wastani)
Alama vs Muda wa majibu (wastani)
Jumla ya tokeni za matokeo
Alama vs Jumla ya tokeni za matokeo
Mgawanyo wa kategoria
| Kazi za mawakala | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 3.0 | 10.0 | 0.0% | 0 | 1.07s | 0 | 0 | 0 | |
| Nemotron 3 Super | 2.8 | 1.6 | 33.3% | 1 | 30.51s | 82,833 | 2,642 | 0 |
| Mbinu za kupinga AI | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 5.3 | 5.6 | 50.0% | 2 | 2.68s | 672 | 686 | 2,358 | |
| Nemotron 3 Super | 4.8 | 10.0 | 25.0% | 0 | 4.46s | 671 | 2,322 | 0 |
| Uandishi wa msimbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 3.3 | 9.6 | 0.0% | 0 | 14.31s | 6,472 | 2,032 | 14,886 | |
| Nemotron 3 Super | 3.3 | 7.2 | 11.1% | 1 | 2.64s | 7,627 | 571 | 0 |
| Mchanganyiko | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 3.8 | 1.6 | 50.0% | 2 | 73.00s | 43,170 | 2,531 | 48,237 | |
| Nemotron 3 Super | 3.0 | 10.0 | 0.0% | 0 | 18.22s | 35,803 | 855 | 1 |
| Uchanganuzi na uchimbaji wa data | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 6.3 | 5.8 | 66.7% | 1 | 2.66s | 7,776 | 280 | 988 | |
| Nemotron 3 Super | 10.0 | 10.0 | 100.0% | 0 | 7.92s | 7,944 | 249 | 0 |
| Mahususi kwa domeni | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 3.0 | 10.0 | 0.0% | 0 | 8.33s | 780 | 1,399 | 10,258 | |
| Nemotron 3 Super | 3.0 | 10.0 | 0.0% | 0 | 6.78s | 798 | 24 | 0 |
| Akili ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 5.0 | 10.0 | 0.0% | 0 | 12.02s | 516 | 141 | 515 | |
| Nemotron 3 Super | 4.6 | 10.0 | 0.0% | 0 | 950ms | 500 | 134 | 0 |
| Ufuataji wa maagizo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 9.9 | 10.0 | 100.0% | 0 | 1.75s | 699 | 90 | 768 | |
| Nemotron 3 Super | 6.3 | 10.0 | 50.0% | 0 | 804ms | 723 | 66 | 0 |
| Utatuzi wa mafumbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 2.9 | 4.4 | 22.2% | 2 | 1.84s | 696 | 284 | 971 | |
| Nemotron 3 Super | 5.5 | 10.0 | 33.3% | 0 | 2.36s | 714 | 1,125 | 0 |
| Mwito wa zana | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 10.0 | 10.0 | 100.0% | 0 | 5.13s | 8,391 | 330 | 1,230 | |
| Nemotron 3 Super | 4.7 | 1.6 | 66.7% | 1 | 16.00s | 8,541 | 281 | 0 |
| Maarifa ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 3.0 | 10.0 | 0.0% | 0 | 17.96s | 204 | 19 | 9,749 | |
| Nemotron 3 Super | 3.0 | 10.0 | 0.0% | 0 | 8.94s | 207 | 804 | 0 |
Ulinganisho wa haraka
Badilisha jozi ya ulinganisho
Granite 4.2 8BnonevsKAT Coder AIR V2.5defaultTrinity Large PreviewdefaultInapatikana burevsNemotron 3 SupernoneInapatikana bureRing 2.6 1tdefaultvsNemotron 3 SupernoneInapatikana bureLing 2.6 FlashdefaultvsNemotron 3 SupernoneInapatikana bureCobuddymediumInapatikana burevsKAT Coder AIR V2.5defaultMercury 2nonevsKAT Coder AIR V2.5defaultCobuddymediumInapatikana burevsNemotron 3 SupernoneInapatikana bureNemotron 3 SupernoneInapatikana burevsLaguna S 2.1lowInapatikana bureKAT Coder AIR V2.5defaultvsNemotron 3.5 LightninglowInapatikana bureKAT Coder AIR V2.5defaultvsMiniMax M2.5mediumKAT Coder AIR V2.5defaultvsLaguna S 2.1lowInapatikana bureMiniMax M2.5mediumvsNemotron 3 SupernoneInapatikana bure