AI BENCHY Category Failures
Domain specific: API error
Domain specific
API error
See which AI models are most likely to hit API error on Domain specific, so you can spot weak points faster.
Failure Reasons
| Rank | Model | Company | API error Count | Category Score | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|
| #73 | Mistral Small 4 medium | Mistral | 1 | 5.3 | 1/3 | 6.11s |
| #98 | LFM2-24B-A2B none | Liquid | 1 | 5.9 | 1/3 | 287ms |