Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↓.
Categories
291/291
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #83 | GPT-5.4 Nano medium | OpenAI | 8 | 7.5 | $0.142 | 12/22 | 13.3s |
| #176 | Qwen3.5-Flash medium | Qwen | 5 | 6.1 | $0.142 | 11/22 | 84.4s |
| #253 | Nemotron 3.5 Lightning low | NVIDIA | 14 | 4.8 | $0.140 | 5/22 | 59.8s |
| #147 | Gemini 3.5 Flash Lite low | 8 | 6.6 | $0.138 | 12/22 | 2.56s | |
| #194 | Hy3 preview high | Tencent | 3 | 5.9 | $0.135 | 11/21 | 56.6s |
| #216 | Nemotron 3.5 Lightning high | NVIDIA | 11 | 5.6 | $0.134 | 5/22 | 58.3s |
| #226 | Kimi K2.5 none | Moonshot AI | 16 | 5.4 | $0.134 | 5/22 | 18.0s |
| #191 | Step 3.5 Flash medium | Stepfun | 5 | 5.9 | $0.132 | 10/21 | 191.6s |
| #181 | Qwen3.5 Plus 2026-04-20 none | Qwen | 12 | 6.1 | $0.122 | 8/22 | 13.1s |
| #103 | Gemini 3.1 Flash Lite medium | 7 | 7.3 | $0.120 | 13/22 | 4.38s | |
| #188 | GPT-5 Nano medium | OpenAI | 10 | 6.0 | $0.118 | 8/22 | 54.2s |
| #91 | Gemini 3.1 Flash Lite Preview medium | 6 | 7.4 | $0.117 | 14/22 | 4.59s | |
| #124 | Seed-2.0-Mini medium | Bytedance Seed | 5 | 7.0 | $0.116 | 11/22 | 93.1s |
| #228 | Laguna S 2.1 high | Poolside | 11 | 5.4 | $0.114 | 4/22 | 111.6s |
| #150 | Inkling Small medium | Thinkingmachines | 6 | 6.6 | $0.113 | 10/22 | 6.30s |