- Peringkat
- #97
- Total token output
- 194,474
- Waktu respons (rata-rata)
- 25.66s
- Total Biaya
- $1.027
ERNIE-Light-DT-1.0 (high) vs GPT-6.1 Terra
Skor rata-rata hampir imbang di 8.6 vs 8.6. GPT-6.1 Terra memiliki biaya benchmark lebih rendah di $0.184 vs $1.027. GPT-6.1 Terra lebih cepat di 4.08s vs 25.66s, dengan tingkat keberhasilan 75.4% vs 84.1%.
Model yang Dibandingkan
- Peringkat
- #99
- Total token output
- 4,906
- Waktu respons (rata-rata)
- 4.08s
- Total Biaya
- $0.184
Model yang direkomendasikan
GPT-6.1 Terra
It has the best score here (8.6), while costing about 5.6x less than ERNIE-Light-DT-1.0 (high).
Perbandingan terperinci
| Metrik | ERNIE-Light-DT-1.0 ERNIE-Light-DT-1.0 high | GPT-6.1 Terra GPT-6.1 Terra none |
|---|---|---|
| Skor | 8.6 | 8.6 |
| Peringkat | #97 | #99 |
| Keandalan | 9.3 | 10.0 |
| Konsistensi | 9.3 | 9.3 |
| Percobaan | 69/69 | 69/69 |
| Tes benar | ||
| Tingkat lulus per percobaan | 75.4% | 84.1% |
| Tes tidak stabil | 2 | 2 |
| Total Run | 69 | 69 |
| Biaya per hasil | 6.418 | 1.021 |
| Total Biaya | $1.027 | $0.184 |
| Harga input | $1.130 / 1M | $1.000 / 1M |
| Harga output | $3.941 / 1M | $5.000 / 1M |
| Harga baca cache | $0.113 / 1M | $0.050 / 1M |
| Harga tulis cache | T/A | $1.250 / 1M |
| Total token input | 230,563 | 159,129 |
| Token output | 6,576 | 4,906 |
| Token penalaran | 187,898 | 0 |
| Waktu respons (rata-rata) | 25.66s | 4.08s |
| Waktu respons (maks) | 200.80s | 40.32s |
| Waktu respons (total) | 590.18s | 93.75s |
| Parameter | ~320B total (~18B aktif) | ~1T total (~60B aktif) |
| Ketersediaan | Tertutup | Tertutup |
Harga cache berlaku untuk token input. Pembacaan memakai kembali prompt tersimpan; penulisan menyimpannya dan dapat menambah biaya. Token output menggunakan harga output.
Showcase generasi model
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#97 ERNIE-Light-DT-1.0
high- Biaya
- $0.067
- Waktu
- 129.8s
- Token
- 16,960 tok
#99 GPT-6.1 Terra
none- Biaya
- $0.017
- Waktu
- 36.8s
- Token
- 3,297 tok
Rincian Kategori
| Tugas agen | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| ERNIE-Light-DT-1.0 | 10.0 | 10.0 | 100.0% | 0 | 52.84s | 128,875 | 1,210 | 3,884 | |
| GPT-6.1 Terra | 10.0 | 10.0 | 100.0% | 0 | 40.32s | 81,063 | 875 | 0 |
| Trik anti-AI | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| ERNIE-Light-DT-1.0 | 10.0 | 10.0 | 100.0% | 0 | 1.89s | 639 | 266 | 486 | |
| GPT-6.1 Terra | 10.0 | 10.0 | 100.0% | 0 | 1.45s | 606 | 150 | 0 |
| Pemrograman | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| ERNIE-Light-DT-1.0 | 10.0 | 10.0 | 100.0% | 0 | 14.96s | 7,317 | 419 | 16,035 | |
| GPT-6.1 Terra | 8.2 | 7.2 | 88.9% | 1 | 1.86s | 7,302 | 387 | 0 |
| Gabungan | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| ERNIE-Light-DT-1.0 | 6.5 | 10.0 | 50.0% | 0 | 27.93s | 76,694 | 3,454 | 16,156 | |
| GPT-6.1 Terra | 6.5 | 10.0 | 50.0% | 0 | 9.01s | 54,858 | 2,628 | 0 |
| Parsing dan ekstraksi data | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| ERNIE-Light-DT-1.0 | 10.0 | 10.0 | 100.0% | 0 | 1.72s | 7,149 | 210 | 246 | |
| GPT-6.1 Terra | 10.0 | 10.0 | 100.0% | 0 | 1.85s | 7,140 | 222 | 0 |
| Spesifik domain | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| ERNIE-Light-DT-1.0 | 3.6 | 7.2 | 22.2% | 1 | 134.82s | 759 | 220 | 149,271 | |
| GPT-6.1 Terra | 5.9 | 7.2 | 55.6% | 1 | 1.53s | 732 | 59 | 0 |
| Kecerdasan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| ERNIE-Light-DT-1.0 | 6.5 | 3.4 | 66.7% | 1 | 2.02s | 498 | 185 | 309 | |
| GPT-6.1 Terra | 10.0 | 10.0 | 100.0% | 0 | 1.39s | 477 | 73 | 0 |
| Kepatuhan instruksi | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| ERNIE-Light-DT-1.0 | 10.0 | 10.0 | 100.0% | 0 | 2.04s | 678 | 72 | 166 | |
| GPT-6.1 Terra | 10.0 | 10.0 | 100.0% | 0 | 1.43s | 660 | 84 | 0 |
| Pemecahan teka-teki | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| ERNIE-Light-DT-1.0 | 7.7 | 10.0 | 66.7% | 0 | 2.16s | 672 | 291 | 311 | |
| GPT-6.1 Terra | 10.0 | 10.0 | 100.0% | 0 | 1.51s | 642 | 161 | 0 |
| Pemanggilan alat | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| ERNIE-Light-DT-1.0 | 10.0 | 10.0 | 100.0% | 0 | 4.33s | 7,075 | 231 | 149 | |
| GPT-6.1 Terra | 10.0 | 10.0 | 100.0% | 0 | 4.91s | 5,454 | 242 | 0 |
| Pengetahuan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token input | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|---|
| ERNIE-Light-DT-1.0 | 3.0 | 10.0 | 0.0% | 0 | 4.23s | 207 | 18 | 885 | |
| GPT-6.1 Terra | 3.0 | 10.0 | 0.0% | 0 | 2.06s | 195 | 25 | 0 |
Perbandingan Cepat
Ganti Pasangan Perbandingan
Muse Spark 1.1lowvsGPT-6.1 TerranoneClaude Fable 5.2lowvsGPT-6.1 TerranoneClaude Sonnet 5.5highvsGPT-6.1 TerranoneERNIE-Light-DT-1.0highvsMuse EmbermaxERNIE-Light-DT-1.0highvsMuse EmberlowERNIE-Light-DT-1.0highvsDeepSeek V4.1 FlashmaxDeepSeek V4.1 FlashmaxvsGPT-6.1 TerranoneERNIE-Light-DT-1.0highvsGPT-6 SollowClaude Haiku 5.5lowvsGPT-6.1 TerranoneERNIE-Light-DT-1.0highvsMuse Spark 1.1lowClaude Fable 5.2lowvsERNIE-Light-DT-1.0highERNIE-Light-DT-1.0highvsSeed 2.1 Turbomedium