Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Response Time (avg) ↓.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #257 | Gemini 3.5 Flash Lite low | 9 | 0.6 | $0.183 | 12/23 | 4.79s | |
| #222 | GPT-5.5 none | OpenAI | 11 | 0.7 | $1.212 | 12/23 | 4.75s |
| #418 | Hunter Alpha default | OpenRouter | 9 | 0.3 | $0.000 | 6/18 | 4.70s |
| #250 | Gemini 3.5 Flash minimal | 7 | 0.6 | $0.508 | 13/23 | 4.67s | |
| #219 | GPT-5.6 Sol none | OpenAI | 10 | 0.7 | $0.795 | 12/23 | 4.61s |
| #443 | Classify-1 default | Scaledown | 8 | 0.2 | $0.008 | 3/12 | 4.58s |
| #338 | Laguna XS 2.1 none | Poolside | 14 | 0.5 | $0.020 | 5/23 | 4.56s |
| #377 | GPT-5.4 Nano none | OpenAI | 16 | 0.5 | $0.068 | 4/23 | 4.42s |
| #226 | Mercury 2 medium | Inception | 9 | 0.7 | $0.121 | 10/23 | 4.40s |
| #356 | GPT-4o-mini default | OpenAI | 16 | 0.5 | $0.024 | 5/23 | 4.16s |
| #300 | GPT-5.6 Terra none | OpenAI | 12 | 0.6 | $0.377 | 8/23 | 4.11s |
| #291 | Gemini 3.1 Flash Lite minimal | 9 | 0.6 | $0.080 | 10/23 | 3.95s | |
| #312 | GPT-5.4 none | OpenAI | 15 | 0.6 | $0.690 | 7/23 | 3.89s |
| #334 | GPT-5.6 Luna none | OpenAI | 15 | 0.5 | $0.042 | 6/23 | 3.78s |
| #274 | Gemini 3.1 Flash Lite Preview none | 8 | 0.6 | $0.090 | 12/23 | 3.60s |