AI BENCHY Compare
Model yang Dibandingkan
Benchmark dihasilkan dari suite pengujian AI BENCHY pada: 2026-04-07
| Metrik | GLM 5 GLM 5 medium | GLM 5.1 GLM 5.1 medium | GLM 5 GLM 5 none | GLM 5.1 GLM 5.1 none |
|---|---|---|---|---|
| Skor | 8.3 | 8.0 | 6.7 | 5.6 |
| Peringkat | #15 | #23 | #50 | #67 |
| Konsistensi | 8.1 | 9.0 | 10.0 | 8.2 |
| Tes benar | ||||
| Tingkat lulus per percobaan | 84.3% | 76.5% | 52.9% | 39.2% |
| Tes tidak stabil | 4 | 2 | 0 | 4 |
| Total Run | 51 | 51 | 51 | 51 |
| Biaya per hasil | 0.896 | 1.270 | 0.201 | 1.000 |
| Total Biaya | $0.108 | $0.153 | $0.019 | $0.050 |
| Harga input | $0.720 / 1M | $1.000 / 1M | $0.720 / 1M | $1.000 / 1M |
| Harga output | $2.300 / 1M | $3.200 / 1M | $2.300 / 1M | $3.200 / 1M |
| Token output | 19,833 | 6,666 | 1,551 | 3,219 |
| Token penalaran | 38,523 | 35,313 | 0 | 0 |
| Waktu respons (rata-rata) | 17.15s | 18.23s | 3.77s | 4.01s |
| Waktu respons (maks) | 28.96s | 43.11s | 11.07s | 32.57s |
| Waktu respons (total) | 154.32s | 291.73s | 37.66s | 68.23s |
Skor vs Total Biaya
Waktu respons (rata-rata)
Skor vs Waktu respons (rata-rata)
Total token output
Skor vs Total token output
Rincian Kategori
| Parsing dan ekstraksi data | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|
| GLM 5 | 7.1 | 5.6 | 83.3% | 1 | 8.90s | 567 | 3,734 | |
| GLM 5.1 | 10.0 | 10.0 | 100.0% | 0 | 9.33s | 991 | 4,552 | |
| GLM 5 | 10.0 | 10.0 | 100.0% | 0 | 5.78s | 203 | 0 | |
| GLM 5.1 | 10.0 | 10.0 | 100.0% | 0 | 1.08s | 204 | 0 |
| Kecerdasan umum | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|
| GLM 5 | 6.1 | 3.1 | 66.7% | 1 | 14.69s | 2,020 | 2,248 | |
| GLM 5.1 | 10.0 | 10.0 | 100.0% | 0 | 20.95s | 2,875 | 2,875 | |
| GLM 5 | 10.0 | 10.0 | 100.0% | 0 | 3.27s | 103 | 0 | |
| GLM 5.1 | 5.0 | 10.0 | 0.0% | 0 | 790ms | 39 | 0 |
| Kepatuhan instruksi | Skor | Konsistensi | Tingkat lulus per percobaan | Tes tidak stabil | Tes benar | Waktu respons (rata-rata) | Token output | Token penalaran |
|---|---|---|---|---|---|---|---|---|
| GLM 5 | 10.0 | 10.0 | 100.0% | 0 | 7.25s | 1,001 | 2,129 | |
| GLM 5.1 | 6.4 | 5.8 | 66.7% | 1 | 7.47s | 204 | 1,617 | |
| GLM 5 | 10.0 | 10.0 | 100.0% | 0 | 1.48s | 61 | 0 | |
| GLM 5.1 | 8.3 | 10.0 | 50.0% | 0 | 1.58s | 66 | 0 |
Perbandingan Cepat
Ganti Pasangan Perbandingan
Gemini 3 Flash PreviewnonevsGLM 5.1mediumGemini 3.1 Flash Lite PreviewlowvsGLM 5.1mediumMistral Small 4mediumvsGLM 5.1noneGPT-5 MinimediumvsGLM 5noneGemini 3.1 Flash Lite PreviewnonevsGLM 5.1mediumNemotron 3 SupermediumTersedia gratisvsGLM 5noneGPT-5.2 ChatnonevsGLM 5.1mediumGrok 4.1 FastmediumvsGLM 5noneMiniMax M2.5mediumTersedia gratisvsGLM 5.1noneHunter AlphamediumvsGLM 5noneGemini 3.1 Flash Lite PreviewlowvsGLM 5mediumGemini 3 Flash PreviewnonevsGLM 5medium