Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Failure Count ↑.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #165 | Claude Fable 5.1 medium | Anthropic | 3 | 0.7 | $3.197 | 15/23 | 11.9s |
| #191 | Ember-1 low | Fireworks | 3 | 0.7 | $1.488 | 13/23 | 34.9s |
| #192 | Step 5 Preview high | Stepfun | 3 | 0.7 | $4.513 | 10/23 | 154.4s |
| #211 | Grok 4.7 xhigh | X AI | 3 | 0.7 | $3.398 | 14/23 | 124.0s |
| #217 | Ember-1 max | Fireworks | 3 | 0.7 | $3.264 | 11/23 | 97.3s |
| #255 | Qwen3.5-35B-A3B medium | Qwen | 3 | 0.6 | $0.716 | 11/23 | 111.5s |
| #282 | Step 5 Preview medium | Stepfun | 3 | 0.6 | $4.136 | 10/23 | 136.1s |
| #326 | Claude Opus 4.7 none | Anthropic | 3 | 0.5 | $0.505 | 16/19 | 3.02s |
| #333 | Hy3 preview medium | Tencent | 3 | 0.5 | $0.049 | 14/21 | 16.3s |
| #358 | Grok 4.20 Beta medium | X AI | 3 | 0.5 | $0.750 | 14/18 | 9.75s |
| #362 | Gemini 3 PRO Preview medium | 3 | 0.5 | $0.385 | 14/21 | 9.05s | |
| #368 | Hy3 preview high | Tencent | 3 | 0.5 | $0.135 | 11/21 | 56.6s |
| #13 | GPT-5.6 Sol low | OpenAI | 4 | 1.0 | $1.244 | 19/23 | 11.1s |
| #20 | GPT-5.6 Sol medium | OpenAI | 4 | 0.9 | $1.700 | 19/23 | 14.6s |
| #22 | GPT-5.6 Sol high | OpenAI | 4 | 0.9 | $1.595 | 19/23 | 13.6s |