Kazi za mawakala: Hitilafu ya API
Kazi za mawakala
Hitilafu ya API
Ona ni modeli gani za AI zina uwezekano mkubwa wa kupata Hitilafu ya API katika Kazi za mawakala, ili uone udhaifu haraka.
Sababu za kushindwa
36/36
Chuja miundo
Hakuna miundo inayolingana na utafutaji na vichujio vya sasa.
| Nafasi | Modeli | Kampuni | Idadi ya Hitilafu ya API | Alama ya kategoria | Jumla ya gharama | Majaribio sahihi | Muda wa majibu (wastani) |
|---|---|---|---|---|---|---|---|
| #154 | Claude Fable 5.1 high | Anthropic | 1 | 0.3 | $3.471 | 0/1 | 6.93s |
| #162 | Muse Wonder max | Meta | 1 | 0.3 | $4.766 | 0/1 | 381ms |
| #172 | Muse Wonder high | Meta | 1 | 0.3 | $3.426 | 0/1 | 461ms |
| #180 | Muse Wonder xhigh | Meta | 1 | 0.3 | $4.012 | 0/1 | 525ms |
| #195 | Inkling Small high | Thinkingmachines | 1 | 0.3 | $0.398 | 0/1 | 23ms |
| #200 | Claude Fable 5.1 medium | Anthropic | 1 | 0.3 | $3.197 | 0/1 | 16.2s |
| #223 | GPT-5.2 Chat default | OpenAI | 1 | 0.3 | $0.594 | 0/1 | 955ms |
| #255 | GPT 5.3 Chat default | OpenAI | 1 | 0.3 | $0.533 | 0/1 | 955ms |
| #266 | KAT-Coder-Pro V2.5 low | Kwaipilot | 1 | 0.3 | $0.568 | 0/1 | 1.75s |
| #275 | KAT-Coder-Pro V2.5 high | Kwaipilot | 1 | 0.3 | $0.506 | 0/1 | 1.52s |
| #309 | KAT-Coder-Pro V2.5 medium | Kwaipilot | 1 | 0.3 | $0.669 | 0/1 | 3.38s |
| #313 | Claude Fable 5.1 low | Anthropic | 1 | 0.3 | $3.395 | 0/1 | 34.8s |
| #322 | KAT-Coder-Pro V2.5 default | Kwaipilot | 1 | 0.3 | $0.742 | 0/1 | 1.90s |
| #328 | Inkling Small medium | Thinkingmachines | 1 | 0.3 | $0.113 | 0/1 | 49ms |
| #343 | Ling 3.0 Flash high | Inclusionai | 1 | 0.3 | $0.021 | 0/1 | 42ms |