Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one.
Categories
313/313
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #196 | Gemma 4 31B none | 10 | 6.1 | $0.016 | 9/22 | 5.41s | |
| #204 | GPT-5 Nano medium | OpenAI | 10 | 6.0 | $0.118 | 8/22 | 54.2s |
| #227 | Owl Alpha medium | Openrouter | 10 | 5.6 | $0.000 | 8/21 | 11.9s |
| #230 | Owl Alpha none | Openrouter | 10 | 5.6 | $0.000 | 7/21 | 9.88s |
| #231 | KAT-Coder-Air V2.5 medium | Kwaipilot | 10 | 5.6 | $0.048 | 8/22 | 8.65s |
| #237 | Mimo V2 Omni none | Xiaomi | 10 | 5.5 | $0.021 | 8/21 | 2.44s |
| #258 | Granite 4.2 8B low | IBM Granite | 10 | 5.1 | $0.012 | 7/22 | 54.4s |
| #277 | Trinity Large Thinking high | Arcee AI | 10 | 4.8 | $0.592 | 5/22 | 75.9s |
| #291 | Grok 4.20 Beta none | X AI | 10 | 4.4 | $0.087 | 6/18 | 1.19s |
| #292 | Laguna M.1 none | Poolside | 10 | 4.4 | $0.009 | 4/19 | 2.89s |
| #298 | Grok 4.20 none | X AI | 10 | 4.1 | $0.057 | 6/18 | 1.11s |
| #108 | GPT-5.6 Luna medium | OpenAI | 9 | 7.4 | $0.072 | 13/22 | 7.43s |
| #118 | Qwen3.7 Plus none | Qwen | 9 | 7.3 | $0.106 | 12/22 | 12.1s |
| #126 | Muse Glimmer 30B medium | Meta | 9 | 7.2 | $0.211 | 11/22 | 30.6s |
| #129 | Step 3.7 Flash low | Stepfun | 9 | 7.1 | $0.390 | 11/22 | 17.9s |