Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Response Time (avg) ↑.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #400 | Mercury 2.5 none | Inception | 15 | 0.4 | $0.026 | 2/23 | 5.10s |
| #280 | Inkling none | Thinkingmachines | 13 | 0.6 | $0.292 | 7/23 | 5.30s |
| #355 | Dots 3 Note Preview default | Dots Studio | 16 | 0.5 | $0.000 | 3/23 | 5.36s |
| #440 | Kev 4B default | Jaredpalmer | 9 | 0.2 | $0.002 | 3/12 | 5.63s |
| #298 | Qwen3.8 Flash Next none | Qwen | 14 | 0.6 | ~$0.011 | 8/23 | 5.71s |
| #101 | Gemini 4 Argon low | 5 | 0.8 | $0.438 | 15/23 | 5.72s | |
| #321 | Gemini 2.5 Flash none | 13 | 0.5 | $0.017 | 8/23 | 6.00s | |
| #452 | Solar Decide default | Upstage | 5 | 0.1 | $0.009 | 2/7 | 6.01s |
| #289 | Inkling Small medium | Thinkingmachines | 6 | 0.6 | $0.113 | 10/23 | 6.03s |
| #242 | Gemini 3 Flash Preview none | 9 | 0.6 | $0.155 | 13/23 | 6.05s | |
| #330 | MiMo-V2.6-Flash none | Xiaomi | 15 | 0.5 | $0.060 | 6/23 | 6.20s |
| #350 | MiMo-V2.5-Pro none | Xiaomi | 12 | 0.5 | $0.135 | 5/23 | 6.21s |
| #26 | Gemini 3.7 Flash low | 2 | 0.9 | $0.183 | 21/23 | 6.24s | |
| #198 | Gemini 3.1 Flash Lite medium | 8 | 0.7 | $0.153 | 13/23 | 6.27s | |
| #228 | Beam 1.0 501B A23B medium | Reflection | 6 | 0.7 | $0.499 | 14/23 | 6.27s |