Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Failure Count ↑.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #190 | Kimi K2.7 Code medium | Moonshot AI | 8 | 0.7 | $1.136 | 11/23 | 81.2s |
| #194 | Grok 4.6 low | X AI | 8 | 0.7 | $0.781 | 15/23 | 16.4s |
| #197 | Minimax M3.1 Flash max | Minimax | 8 | 0.7 | $0.000 | 11/23 | 40.9s |
| #198 | Gemini 3.1 Flash Lite medium | 8 | 0.7 | $0.153 | 13/23 | 6.27s | |
| #206 | Inkling low | Thinkingmachines | 8 | 0.7 | $0.293 | 11/23 | 6.81s |
| #221 | GLM 5.3 Flash low | Z.ai | 8 | 0.7 | $0.038 | 11/23 | 11.8s |
| #223 | GLM 5.2 none | Z.ai | 8 | 0.7 | $0.250 | 13/23 | 11.3s |
| #224 | Qwen3.7 Flash medium | Qwen | 8 | 0.7 | $0.076 | 10/23 | 51.8s |
| #225 | LongCat 2.0 low | Meituan | 8 | 0.7 | $0.630 | 10/23 | 115.0s |
| #227 | Step 3.7 Flash high | Stepfun | 8 | 0.7 | $1.478 | 11/23 | 72.7s |
| #231 | Minimax M3.1 Flash high | Minimax | 8 | 0.7 | $0.000 | 9/23 | 34.0s |
| #235 | Beam 1.0 501B A23B xhigh | Reflection | 8 | 0.6 | $0.688 | 12/23 | 9.18s |
| #236 | GLM 5.3 low | Z.ai | 8 | 0.6 | $0.215 | 12/23 | 15.2s |
| #253 | Dots 3 Note Preview low | Dots Studio | 8 | 0.6 | $0.000 | 10/23 | 66.1s |
| #274 | Gemini 3.1 Flash Lite Preview none | 8 | 0.6 | $0.090 | 12/23 | 3.60s |