Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↑.
Categories
291/291
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #93 | Kimi K2.7 Code medium | Moonshot AI | 6 | 7.4 | $0.688 | 11/22 | 80.1s |
| #1 | Gemini 3.6 Flash high | 1 | 9.9 | $0.699 | 21/22 | 16.8s | |
| #36 | Qwen3.8 Max low | Qwen | 5 | 8.6 | $0.702 | 16/22 | 21.8s |
| #117 | Grok 4.3 medium | X AI | 6 | 7.0 | $0.741 | 12/22 | 44.2s |
| #130 | Qwen3.6 Flash medium | Qwen | 8 | 6.8 | $0.741 | 12/22 | 45.0s |
| #152 | Qwen3.6 35B A3B medium | Qwen | 5 | 6.6 | $0.749 | 12/22 | 58.5s |
| #185 | Grok 4.20 Beta medium | X AI | 3 | 6.0 | $0.750 | 14/18 | 9.75s |
| #5 | Gemini 3 Flash Preview medium | 2 | 9.5 | $0.763 | 20/22 | 19.9s | |
| #74 | Seed-2.0-Code low | Bytedance Seed | 6 | 7.7 | $0.767 | 13/22 | 72.2s |
| #20 | Qwen3.8 Max medium | Qwen | 4 | 9.0 | $0.771 | 17/22 | 23.3s |
| #81 | Nemotron 3 Ultra medium | NVIDIA | 7 | 7.6 | $0.780 | 13/22 | 33.6s |
| #89 | GPT-5.4 Mini medium | OpenAI | 6 | 7.5 | $0.786 | 12/22 | 26.7s |
| #178 | Trinity Large Thinking medium | Arcee AI | 8 | 6.1 | $0.798 | 8/22 | 85.4s |
| #123 | Grok 4.20 medium | X AI | 6 | 7.0 | $0.805 | 11/22 | 32.6s |
| #58 | GPT-5.6 Terra high | OpenAI | 7 | 8.0 | $0.836 | 14/22 | 11.2s |