- Peringkat
- #309
- Total token output
- 114,654
- Waktu respons (rata-rata)
- 15.23s
- Total Biaya
- $0.077
KAT Coder AIR V2.5 (high) vs Nemotron 3.5 Lightning (high)
Skor rata-rata hampir imbang di 5.2 vs 5.2. KAT Coder AIR V2.5 (high) memiliki biaya benchmark lebih rendah di $0.077 vs $0.168. KAT Coder AIR V2.5 (high) lebih cepat di 15.23s vs 77.08s, dengan tingkat keberhasilan 40.6% vs 47.8%.
Model yang Dibandingkan
- Peringkat
- #308
- Total token output
- 626,081
- Waktu respons (rata-rata)
- 77.08s
- Total Biaya
- $0.168
Model yang direkomendasikan
KAT Coder AIR V2.5 (high)
It has the best score here (5.2), while costing about 2.2x less than Nemotron 3.5 Lightning (high).
Perbandingan terperinci
| Metrik | KAT Coder AIR V2.5 KAT Coder AIR V2.5 high | Nemotron 3.5 Lightning Nemotron 3.5 Lightning high Tersedia gratis |
|---|---|---|
| Skor | 5.2 | 5.2 |
| Peringkat | #309 | #308 |
| Keandalan | 9.8 | 9.6 |
| Konsistensi | 8.2 | 5.7 |
| Percobaan | 69/69 | 69/69 |
| Tes benar | ||
| Tingkat lulus per percobaan | 40.6% | 47.8% |
| Tes tidak stabil | 5 | 12 |
| Total Run | 69 | 69 |
| Biaya per hasil | 1.091 | 0.000 |
| Total Biaya | $0.077 | $0.168 |
| Harga input | $0.150 / 1M | $0.060 / 1M |
| Harga output | $0.600 / 1M | $0.160 / 1M |
| Harga baca cache | T/A | $0.030 / 1M |
| Harga tulis cache | T/A | T/A |
| Total token input | 50,423 | 170,517 |
| Token output | 4,144 | 149,968 |
| Token penalaran | 110,510 | 509,725 |
| Waktu respons (rata-rata) | 15.23s | 77.08s |
| Waktu respons (maks) | 118.35s | 490.99s |
| Waktu respons (total) | 350.26s | 1772.78s |
| Parameter | ~35B total (~3B aktif) | 30B total (3B aktif) |
| Ketersediaan | Tertutup | Bobot tersedia |
Harga cache berlaku untuk token input. Pembacaan memakai kembali prompt tersimpan; penulisan menyimpannya dan dapat menambah biaya. Token output menggunakan harga output.
Showcase generasi model
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#309 KAT Coder AIR V2.5
high
Reached the allocated time limit (300 seconds) without receiving showcase output.
- Biaya
- $0.000
- Waktu
- 300.0s
- Token
- 0 tok
#308 Nemotron 3.5 Lightning
high- Biaya
- $0.000
- Waktu
- 92.8s
- Token
- 11,343 tok
Rincian Kategori
| Tugas agen | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 3.0 | 10.0 | 0.0% | 0 | 1.10s | 0 | 0 | 0 | |
| Nemotron 3.5 Lightning | 3.5 | 8.3 | 0.0% | 0 | 490.99s | 52,501 | 1,624 | 3,472 |
| Trik anti-AI | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 6.9 | 5.8 | 75.0% | 2 | 2.49s | 615 | 204 | 1,290 | |
| Nemotron 3.5 Lightning | 5.5 | 3.7 | 66.7% | 3 | 10.29s | 696 | 2,432 | 15,948 |
| Pemrograman | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 4.3 | 7.3 | 11.1% | 1 | 39.07s | 6,948 | 1,166 | 55,883 | |
| Nemotron 3.5 Lightning | 4.4 | 5.1 | 33.3% | 2 | 168.41s | 7,623 | 68,533 | 242,319 |
| Gabungan | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 6.5 | 10.0 | 50.0% | 0 | 74.48s | 23,854 | 485 | 28,559 | |
| Nemotron 3.5 Lightning | 6.4 | 10.0 | 50.0% | 0 | 160.45s | 90,257 | 17,550 | 119,725 |
| Parsing dan ekstraksi data | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 6.5 | 10.0 | 50.0% | 0 | 3.59s | 7,776 | 284 | 2,140 | |
| Nemotron 3.5 Lightning | 7.3 | 5.9 | 83.3% | 1 | 13.99s | 7,944 | 3,210 | 16,835 |
| Spesifik domain | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 3.0 | 10.0 | 0.0% | 0 | 7.28s | 724 | 1,101 | 7,738 | |
| Nemotron 3.5 Lightning | 2.9 | 4.4 | 22.2% | 2 | 88.61s | 798 | 45,616 | 72,496 |
| Kecerdasan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 5.1 | 10.0 | 0.0% | 0 | 7.10s | 516 | 179 | 539 | |
| Nemotron 3.5 Lightning | 3.7 | 9.5 | 0.0% | 0 | 7.58s | 516 | 4,331 | 4,408 |
| Kepatuhan instruksi | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 9.8 | 10.0 | 100.0% | 0 | 1.51s | 699 | 90 | 675 | |
| Nemotron 3.5 Lightning | 8.5 | 6.8 | 83.3% | 1 | 4.98s | 723 | 502 | 3,779 |
| Pemecahan teka-teki | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 3.5 | 4.4 | 33.3% | 2 | 2.47s | 696 | 285 | 1,576 | |
| Nemotron 3.5 Lightning | 3.6 | 1.8 | 44.4% | 3 | 6.09s | 726 | 1,236 | 9,851 |
| Pemanggilan alat | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 10.0 | 10.0 | 100.0% | 0 | 4.77s | 8,391 | 330 | 1,082 | |
| Nemotron 3.5 Lightning | 10.0 | 10.0 | 100.0% | 0 | 6.92s | 8,526 | 3,745 | 3,781 |
| Pengetahuan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 3.0 | 10.0 | 0.0% | 0 | 21.72s | 204 | 20 | 11,028 | |
| Nemotron 3.5 Lightning | 3.0 | 10.0 | 0.0% | 0 | 77.98s | 207 | 1,189 | 17,111 |
Perbandingan Cepat
Ganti Pasangan Perbandingan
Ling 3.0 FlashnonevsNemotron 3.5 LightninghighTersedia gratisLing 3.0 FlashnonevsKAT Coder AIR V2.5highNemotron 3.5 LightninghighTersedia gratisvsInkling SmalllowTersedia gratisKAT Coder AIR V2.5highvsInkling SmalllowTersedia gratisKAT Coder AIR V2.5highvsMistral Small 4mediumKAT Coder AIR V2.5highvsMistral Small 4noneMistral Small 4mediumvsNemotron 3.5 LightninghighTersedia gratisMistral Small 4nonevsNemotron 3.5 LightninghighTersedia gratisMercury 2.5lowvsKAT Coder AIR V2.5highKAT Coder AIR V2.5highvsMiMo-V2.5-PrononeNemotron 3.5 LightninghighTersedia gratisvsQwen3.6 35B A3BnoneMercury 2.5lowvsNemotron 3.5 LightninghighTersedia gratis