Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↑.
Categories
291/291
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #216 | Nemotron 3.5 Lightning high | NVIDIA | 11 | 5.6 | $0.134 | 5/22 | 58.3s |
| #194 | Hy3 preview high | Tencent | 3 | 5.9 | $0.135 | 11/21 | 56.6s |
| #147 | Gemini 3.5 Flash Lite low | 8 | 6.6 | $0.138 | 12/22 | 2.56s | |
| #253 | Nemotron 3.5 Lightning low | NVIDIA | 14 | 4.8 | $0.140 | 5/22 | 59.8s |
| #176 | Qwen3.5-Flash medium | Qwen | 5 | 6.1 | $0.142 | 11/22 | 84.4s |
| #83 | GPT-5.4 Nano medium | OpenAI | 8 | 7.5 | $0.142 | 12/22 | 13.3s |
| #236 | Inkling none | Thinkingmachines | 13 | 5.2 | $0.142 | 6/22 | 3.47s |
| #190 | Qwen3.5-35B-A3B none | Qwen | 13 | 5.9 | $0.142 | 6/22 | 12.7s |
| #231 | Seed-2.0-Code none | Bytedance Seed | 11 | 5.3 | $0.151 | 6/22 | 14.7s |
| #7 | Gemini 3.7 Flash medium | 2 | 9.4 | $0.155 | 20/22 | 5.87s | |
| #237 | Nemotron 3.5 Lightning medium | NVIDIA | 13 | 5.1 | $0.156 | 5/22 | 70.1s |
| #271 | GLM 4.7 Flash medium | Z.ai | 9 | 4.3 | $0.168 | 4/22 | 134.3s |
| #79 | GPT-5.6 Luna high | OpenAI | 8 | 7.6 | $0.179 | 14/22 | 16.5s |
| #177 | Inkling low | Thinkingmachines | 8 | 6.1 | $0.181 | 10/22 | 5.11s |
| #98 | Gemini 3 Flash Preview low | 6 | 7.4 | $0.185 | 16/22 | 6.51s |