AI BENCHY Failures
Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↑.
Categories
169/169
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #144 | Ring-2.6-1T none | Inclusionai | 5 | 4.8 | $0.026 | 9/21 | 55.1s |
| #101 | GLM 5 none | Z.ai | 12 | 6.0 | $0.027 | 9/21 | 4.03s |
| #23 | DeepSeek V4 Flash high | DeepSeek | 6 | 8.3 | $0.027 | 13/21 | 45.8s |
| #99 | Nemotron 3 Ultra 550b A55b none | NVIDIA | 12 | 6.1 | $0.027 | 8/21 | 2.27s |
| #118 | Kimi K2.5 none | Moonshot AI | 15 | 5.5 | $0.027 | 6/21 | 13.2s |
| #85 | Gemini 3.1 Flash Lite low | 9 | 6.4 | $0.028 | 12/21 | 1.89s | |
| #120 | Qwen3.6 27B none | Qwen | 11 | 5.5 | $0.028 | 7/21 | 3.72s |
| #128 | Qwen3.6 35B A3B none | Qwen | 13 | 5.2 | $0.031 | 4/21 | 3.73s |
| #122 | Qwen3.5 Plus 2026-04-20 none | Qwen | 12 | 5.5 | $0.032 | 7/21 | 4.39s |
| #88 | Gemma 4 31B medium | 2 | 6.3 | $0.033 | 14/21 | 56.5s | |
| #72 | Ring-2.6-1T medium | Inclusionai | 6 | 6.8 | $0.033 | 11/21 | 61.3s |
| #58 | DeepSeek V4 Pro none | DeepSeek | 8 | 7.2 | $0.034 | 10/21 | 6.41s |
| #165 | Qwen3.5-9B medium | Qwen | 2 | 3.8 | $0.036 | 3/21 | 82.2s |
| #124 | GPT-5.4 Mini none | OpenAI | 13 | 5.3 | $0.038 | 5/21 | 1.13s |
| #62 | MiMo-V2-Flash medium | Xiaomi | 5 | 7.1 | $0.043 | 12/21 | 20.1s |