- Peringkat
- #222
- Total token output
- 37,748
- Waktu respons (rata-rata)
- 8.03s
- Total Biaya
- $1.100
Claude Sonnet 5.5 (medium) vs Beam 1.0 501B A23B (xhigh)
Skor rata-rata hampir imbang di 6.5 vs 6.5. Beam 1.0 501B A23B (xhigh) memiliki biaya benchmark lebih rendah di $0.688 vs $1.100. Claude Sonnet 5.5 (medium) lebih cepat di 8.03s vs 9.18s, dengan tingkat keberhasilan 40.6% vs 63.8%.
Model yang Dibandingkan
- Peringkat
- #226
- Total token output
- 158,497
- Waktu respons (rata-rata)
- 9.18s
- Total Biaya
- $0.688
Model yang direkomendasikan
Beam 1.0 501B A23B (xhigh)
It has the best score here (6.5), while costing about 1.6x less than Claude Sonnet 5.5 (medium).
Perbandingan terperinci
| Metrik | Claude Sonnet 5.5 Claude Sonnet 5.5 medium | Beam 1.0 501B A23B Beam 1.0 501B A23B xhigh |
|---|---|---|
| Skor | 6.5 | 6.5 |
| Peringkat | #222 | #226 |
| Keandalan | 10.0 | 10.0 |
| Konsistensi | 9.7 | 8.3 |
| Percobaan | 69/69 | 69/69 |
| Tes benar | ||
| Tingkat lulus per percobaan | 40.6% | 63.8% |
| Tes tidak stabil | 1 | 5 |
| Total Run | 69 | 69 |
| Biaya per hasil | 12.221 | 5.730 |
| Total Biaya | $1.100 | $0.688 |
| Harga input | $2.000 / 1M | $1.000 / 1M |
| Harga output | $10.000 / 1M | $3.000 / 1M |
| Harga baca cache | $0.200 / 1M | $0.100 / 1M |
| Harga tulis cache | $2.500 / 1M | T/A |
| Total token input | 361,183 | 212,065 |
| Token output | 26,609 | 4,428 |
| Token penalaran | 11,139 | 154,069 |
| Waktu respons (rata-rata) | 8.03s | 9.18s |
| Waktu respons (maks) | 51.18s | 44.64s |
| Waktu respons (total) | 184.80s | 211.12s |
| Parameter | ~1T total (~100B aktif) | 501B total (23B aktif) |
| Ketersediaan | Tertutup | Sumber terbuka |
Harga cache berlaku untuk token input. Pembacaan memakai kembali prompt tersimpan; penulisan menyimpannya dan dapat menambah biaya. Token output menggunakan harga output.
Showcase generasi model
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#222 Claude Sonnet 5.5
medium- Biaya
- $0.024
- Waktu
- 17.4s
- Token
- 2,525 tok
#226 Beam 1.0 501B A23B
xhigh- Biaya
- $0.009
- Waktu
- 16.5s
- Token
- 6,827 tok
Rincian Kategori
| Tugas agen | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 10.0 | 10.0 | 100.0% | 0 | 51.18s | 190,412 | 3,424 | 1,344 | |
| Beam 1.0 501B A23B | 3.0 | 10.0 | 0.0% | 0 | 44.64s | 181,898 | 2,416 | 18,550 |
| Trik anti-AI | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 6.5 | 10.0 | 50.0% | 0 | 2.54s | 858 | 1,697 | 0 | |
| Beam 1.0 501B A23B | 9.2 | 8.4 | 91.7% | 1 | 1.52s | 1,125 | 355 | 3,764 |
| Pemrograman | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 3.4 | 9.7 | 0.0% | 0 | 6.07s | 10,608 | 6,767 | 0 | |
| Beam 1.0 501B A23B | 10.0 | 10.0 | 100.0% | 0 | 20.68s | 7,801 | 585 | 46,192 |
| Gabungan | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 8.5 | 10.0 | 50.0% | 0 | 23.58s | 133,232 | 7,780 | 5,241 | |
| Beam 1.0 501B A23B | 3.0 | 10.0 | 0.0% | 0 | 2.68s | 7,671 | 132 | 2,097 |
| Parsing dan ekstraksi data | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 6.5 | 10.0 | 50.0% | 0 | 2.56s | 10,515 | 696 | 0 | |
| Beam 1.0 501B A23B | 10.0 | 10.0 | 100.0% | 0 | 1.60s | 7,998 | 271 | 2,047 |
| Spesifik domain | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 3.0 | 10.0 | 0.0% | 0 | 8.78s | 990 | 4,137 | 2,729 | |
| Beam 1.0 501B A23B | 5.9 | 7.2 | 55.6% | 1 | 20.22s | 1,122 | 72 | 59,707 |
| Kecerdasan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 5.1 | 3.4 | 33.3% | 1 | 2.27s | 714 | 324 | 0 | |
| Beam 1.0 501B A23B | 5.1 | 3.4 | 33.3% | 1 | 2.50s | 618 | 87 | 2,749 |
| Kepatuhan instruksi | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 6.3 | 10.0 | 50.0% | 0 | 1.88s | 921 | 346 | 0 | |
| Beam 1.0 501B A23B | 9.8 | 10.0 | 100.0% | 0 | 1.15s | 925 | 90 | 1,631 |
| Pemecahan teka-teki | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 7.7 | 10.0 | 66.7% | 0 | 2.43s | 912 | 876 | 0 | |
| Beam 1.0 501B A23B | 5.8 | 4.4 | 66.7% | 2 | 4.46s | 1,038 | 309 | 9,948 |
| Pemanggilan alat | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 10.0 | 10.0 | 100.0% | 0 | 4.75s | 11,757 | 354 | 0 | |
| Beam 1.0 501B A23B | 3.0 | 10.0 | 0.0% | 0 | 1.84s | 1,533 | 72 | 465 |
| Pengetahuan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 3.0 | 10.0 | 0.0% | 0 | 8.57s | 264 | 208 | 1,825 | |
| Beam 1.0 501B A23B | 3.0 | 10.0 | 0.0% | 0 | 9.10s | 336 | 39 | 6,919 |
Perbandingan Cepat
Ganti Pasangan Perbandingan
Mercury 2.5highvsBeam 1.0 501B A23BxhighBeam 1.0 501B A23BxhighvsGLM 5.3lowMercury 2.5 PreviewhighvsBeam 1.0 501B A23BxhighBeam 1.0 501B A23BxhighvsGLM 5.1noneClaude Sonnet 5.5mediumvsMercury 2.5 PreviewhighQwen3.6 35B A3BmediumvsBeam 1.0 501B A23BxhighKAT-Coder-Pro V2.5highvsBeam 1.0 501B A23BxhighBeam 1.0 501B A23BxhighvsGrok 4.3mediumClaude Sonnet 5.5mediumvsMercury 2.5highClaude Sonnet 5.5mediumvsKAT-Coder-Pro V2.5lowLaguna XS 2.1mediumTersedia gratisvsBeam 1.0 501B A23BxhighClaude Sonnet 5.5mediumvsGLM 5.3low