Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Score ↑.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #14 | GPT-6 Astra low | OpenAI | 2 | 1.0 | $2.160 | 21/23 | 7.01s |
| #13 | GPT-5.6 Sol low | OpenAI | 4 | 1.0 | $1.244 | 19/23 | 11.1s |
| #11 | GPT-6.1 Sol medium | OpenAI | 2 | 1.0 | $0.530 | 21/23 | 8.90s |
| #12 | GPT-6.1 Sol high | OpenAI | 2 | 1.0 | $0.755 | 21/23 | 15.5s |
| #453 | Tev1 4B Experimental default | Togethercomputer | 4 | 1.0 | $0.002 | 3/7 | 498ms |
| #9 | Gemini 3.7 Flash high | 2 | 1.0 | $0.528 | 21/23 | 15.1s | |
| #10 | Gemini 3.6 Flash medium | 2 | 1.0 | $0.577 | 21/23 | 14.0s | |
| #6 | GPT-6.1 Sol xhigh | OpenAI | 1 | 1.0 | $1.377 | 22/23 | 33.1s |
| #7 | GPT-6 Astra high | OpenAI | 1 | 1.0 | $4.458 | 22/23 | 20.2s |
| #8 | GPT-6 Astra xhigh | OpenAI | 1 | 1.0 | $6.213 | 22/23 | 29.7s |
| #3 | GPT-6 Sol high | OpenAI | 1 | 1.0 | $0.921 | 22/23 | 23.6s |
| #1 | Gemini 3.6 Flash high | 1 | 1.0 | $0.900 | 22/23 | 18.9s |