- Peringkat
- #277
- Total token output
- 11,832
- Waktu respons (rata-rata)
- 22.65s
- Total Biaya
- $0.786
Ember-1 vs Laguna XS 2.1
Ember-1 unggul dalam skor rata-rata dengan 5.4 vs 5.3. Laguna XS 2.1 memiliki biaya benchmark lebih rendah di $0.019 vs $0.786. Laguna XS 2.1 lebih cepat di 4.56s vs 22.65s, dengan tingkat keberhasilan 43.5% vs 29.0%.
Model yang Dibandingkan
- Peringkat
- #283
- Total token output
- 23,173
- Waktu respons (rata-rata)
- 4.56s
- Total Biaya
- $0.019
Model yang direkomendasikan
Laguna XS 2.1
Its score stays close to the best score here (5.3 vs 5.4), while costing about 41.4x less than Ember-1.
Perbandingan terperinci
| Metrik | Ember-1 Ember-1 none | Laguna XS 2.1 Laguna XS 2.1 none Tersedia gratis |
|---|---|---|
| Skor | 5.4 | 5.3 |
| Peringkat | #277 | #283 |
| Keandalan | 8.8 | 10.0 |
| Konsistensi | 8.6 | 9.1 |
| Percobaan | 69/69 | 69/69 |
| Tes benar | ||
| Tingkat lulus per percobaan | 43.5% | 29.0% |
| Tes tidak stabil | 4 | 3 |
| Total Run | 69 | 69 |
| Biaya per hasil | 9.817 | 0.380 |
| Total Biaya | $0.786 | $0.019 |
| Harga input | $3.000 / 1M | $0.060 / 1M |
| Harga output | $15.000 / 1M | $0.120 / 1M |
| Total token input | 202,617 | 270,072 |
| Token output | 11,832 | 23,173 |
| Token penalaran | 0 | 0 |
| Waktu respons (rata-rata) | 22.65s | 4.56s |
| Waktu respons (maks) | 93.12s | 70.79s |
| Waktu respons (total) | 520.91s | 104.80s |
| Parameter | ~2.8T total (~104B aktif) | 33B total (3B aktif) |
| Ketersediaan | Tertutup | Bobot tersedia |
Showcase generasi model
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#277 Ember-1
none- Biaya
- $0.156
- Waktu
- 224.6s
- Token
- 10,555 tok
#283 Laguna XS 2.1
none- Biaya
- $0.001
- Waktu
- 27.6s
- Token
- 4,344 tok
Model teratas berdasarkan skor
Skor vs Total Biaya
Waktu respons (rata-rata)
Skor vs Waktu respons (rata-rata)
Total token output
Skor vs Total token output
Rincian Kategori
| Tugas agen | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Ember-1 | 6.1 | 3.1 | 66.7% | 1 | 92.87s | 175,191 | 9,168 | 0 | |
| Laguna XS 2.1 | 5.0 | 10.0 | 0.0% | 0 | 70.79s | 178,465 | 9,796 | 0 |
| Trik anti-AI | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Ember-1 | 5.2 | 7.9 | 41.7% | 1 | 22.37s | 796 | 867 | 0 | |
| Laguna XS 2.1 | 5.3 | 8.3 | 33.3% | 1 | 755ms | 774 | 1,015 | 0 |
| Pemrograman | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Ember-1 | 5.5 | 10.0 | 33.3% | 0 | 1.94s | 7,485 | 393 | 0 | |
| Laguna XS 2.1 | 4.3 | 7.8 | 22.2% | 1 | 623ms | 7,995 | 562 | 0 |
| Gabungan | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Ember-1 | 3.0 | 10.0 | 0.0% | 0 | 49.01s | 12,162 | 327 | 0 | |
| Laguna XS 2.1 | 3.0 | 10.0 | 0.0% | 0 | 10.39s | 64,647 | 10,328 | 0 |
| Parsing dan ekstraksi data | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Ember-1 | 6.4 | 5.9 | 66.7% | 1 | 35.25s | 4,017 | 161 | 0 | |
| Laguna XS 2.1 | 10.0 | 10.0 | 100.0% | 0 | 768ms | 7,734 | 240 | 0 |
| Spesifik domain | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Ember-1 | 5.3 | 10.0 | 33.3% | 0 | 21.61s | 804 | 68 | 0 | |
| Laguna XS 2.1 | 5.3 | 10.0 | 33.3% | 0 | 303ms | 843 | 14 | 0 |
| Kecerdasan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Ember-1 | 5.0 | 10.0 | 0.0% | 0 | 2.28s | 540 | 160 | 0 | |
| Laguna XS 2.1 | 5.0 | 10.0 | 0.0% | 0 | 529ms | 537 | 128 | 0 |
| Kepatuhan instruksi | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Ember-1 | 6.4 | 5.8 | 66.7% | 1 | 31.00s | 509 | 81 | 0 | |
| Laguna XS 2.1 | 3.8 | 5.8 | 33.3% | 1 | 364ms | 638 | 50 | 0 |
| Pemecahan teka-teki | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Ember-1 | 10.0 | 10.0 | 100.0% | 0 | 2.54s | 840 | 569 | 0 | |
| Laguna XS 2.1 | 3.0 | 10.0 | 0.0% | 0 | 1.01s | 771 | 730 | 0 |
| Pemanggilan alat | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Ember-1 | 3.0 | 10.0 | 0.0% | 0 | 26.44s | 0 | 0 | 0 | |
| Laguna XS 2.1 | 10.0 | 10.0 | 100.0% | 0 | 1.36s | 7,413 | 300 | 0 |
| Pengetahuan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Ember-1 | 3.0 | 10.0 | 0.0% | 0 | 1.05s | 273 | 38 | 0 | |
| Laguna XS 2.1 | 3.0 | 10.0 | 0.0% | 0 | 254ms | 255 | 10 | 0 |
Perbandingan Cepat
Ganti Pasangan Perbandingan
Ember-1nonevsStep 3.5 FlashmediumEmber-1nonevsHy4 previewlowNorth Mini CodemediumTersedia gratisvsEmber-1noneEmber-1nonevsGranite 4.2 8BlowGranite 4.2 8BlowvsLaguna XS 2.1noneTersedia gratisLaguna XS 2.1noneTersedia gratisvsInkling SmalllowTersedia gratisNemotron 3.5 LightninghighTersedia gratisvsLaguna XS 2.1noneTersedia gratisLaguna XS 2.1noneTersedia gratisvsStep 3.5 FlashmediumKAT Coder AIR V2.5highvsLaguna XS 2.1noneTersedia gratisLaguna XS 2.1noneTersedia gratisvsHy4 previewlowNorth Mini CodemediumTersedia gratisvsLaguna XS 2.1noneTersedia gratisMistral Small 4mediumvsLaguna XS 2.1noneTersedia gratis