Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Response Time (avg) ↓.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #389 | Nemotron 3 Super none | NVIDIA | 16 | 0.4 | $0.016 | 5/23 | 7.11s |
| #370 | Mercury 2.5 Preview default | Inception | 16 | 0.5 | $0.023 | 4/23 | 7.05s |
| #14 | GPT-6 Astra low | OpenAI | 2 | 1.0 | $2.160 | 21/23 | 7.01s |
| #201 | GPT-5.6 Luna low | OpenAI | 10 | 0.7 | $0.049 | 11/23 | 6.96s |
| #52 | Gemini 3.6 Flash low | 4 | 0.9 | $0.363 | 19/23 | 6.82s | |
| #206 | Inkling low | Thinkingmachines | 8 | 0.7 | $0.293 | 11/23 | 6.81s |
| #189 | Gemini 3.1 Flash Lite Preview medium | 7 | 0.7 | $0.158 | 14/23 | 6.78s | |
| #296 | Nemotron 3 Ultra none | NVIDIA | 12 | 0.6 | $0.164 | 8/23 | 6.76s |
| #421 | Laguna Xs.2 medium | Poolside | 6 | 0.3 | $0.015 | 6/19 | 6.73s |
| #207 | Mercury 2.5 Preview medium | Inception | 4 | 0.7 | $0.039 | 15/23 | 6.66s |
| #50 | Gemini 4 Argon medium | 4 | 0.9 | $0.674 | 19/23 | 6.63s | |
| #218 | GPT 5.3 Chat default | OpenAI | 6 | 0.7 | $0.533 | 13/23 | 6.31s |
| #228 | Beam 1.0 501B A23B medium | Reflection | 6 | 0.7 | $0.499 | 14/23 | 6.27s |
| #198 | Gemini 3.1 Flash Lite medium | 8 | 0.7 | $0.153 | 13/23 | 6.27s | |
| #26 | Gemini 3.7 Flash low | 2 | 0.9 | $0.183 | 21/23 | 6.24s |