Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Score ↑.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #180 | Qwen3.6 27B medium | Qwen | 5 | 0.7 | $1.021 | 11/23 | 107.8s |
| #179 | Step 3.7 Flash low | Stepfun | 9 | 0.7 | $0.449 | 11/23 | 20.7s |
| #178 | GLM 5 medium | Z.ai | 4 | 0.7 | $0.479 | 15/22 | 39.0s |
| #177 | LongCat 2.0 medium | Meituan | 8 | 0.7 | $0.767 | 12/23 | 144.9s |
| #176 | Qwen3.7 Flash high | Qwen | 8 | 0.7 | $0.063 | 13/23 | 45.5s |
| #175 | Claude Opus 4.8 low | Anthropic | 5 | 0.7 | $3.787 | 16/23 | 17.1s |
| #174 | Gemini 3.8 Flash low | 6 | 0.7 | $0.323 | 16/23 | 7.54s | |
| #173 | Qwen3.8 27B medium | Qwen | 4 | 0.7 | ~$0.073 | 14/23 | 40.1s |
| #172 | Qwen3.5 Plus 2026-02-15 medium | Qwen | 6 | 0.7 | $0.567 | 14/23 | 97.7s |
| #171 | Qwen3.5-27B none | Qwen | 11 | 0.7 | $0.116 | 10/23 | 9.98s |
| #170 | Gemini 3.5 Flash Lite medium | 6 | 0.7 | $0.440 | 14/23 | 8.68s | |
| #169 | Qwen3.6 Plus medium | Qwen | 6 | 0.7 | $0.554 | 15/23 | 57.4s |
| #167 | Gemini 2.5 Flash medium | 6 | 0.7 | $0.680 | 15/23 | 20.5s | |
| #168 | LongCat 2.0 high | Meituan | 7 | 0.7 | $0.778 | 10/23 | 151.7s |
| #166 | Grok 4.7 medium | X AI | 5 | 0.7 | $2.938 | 15/23 | 117.7s |