AI BENCHY Failures
API error Failures
See which AI models run into API error most often, so you can spot reliability risks before choosing one. Sort by: Failure Count ↑.
| Rank | Model | Company | API error Count | Score | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|
| #73 | Mistral Small 4 medium | Mistral | 2 | 5.7 | 5/18 | 5.64s |
| #84 | gpt-oss-120b none | OpenAI | 3 | 5.2 | 4/18 | 12.0s |
| #98 | LFM2-24B-A2B none | Liquid | 4 | 4.1 | 1/16 | 811ms |