Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #282 | Step 5 Preview medium | Stepfun | 3 | 0.6 | $4.136 | 10/23 | 136.1s |
| #326 | Claude Opus 4.7 none | Anthropic | 3 | 0.5 | $0.505 | 16/19 | 3.02s |
| #333 | Hy3 preview medium | Tencent | 3 | 0.5 | $0.049 | 14/21 | 16.3s |
| #358 | Grok 4.20 Beta medium | X AI | 3 | 0.5 | $0.750 | 14/18 | 9.75s |
| #362 | Gemini 3 PRO Preview medium | 3 | 0.5 | $0.385 | 14/21 | 9.05s | |
| #368 | Hy3 preview high | Tencent | 3 | 0.5 | $0.135 | 11/21 | 56.6s |
| #9 | Gemini 3.7 Flash high | 2 | 1.0 | $0.528 | 21/23 | 15.1s | |
| #10 | Gemini 3.6 Flash medium | 2 | 1.0 | $0.577 | 21/23 | 14.0s | |
| #11 | GPT-6.1 Sol medium | OpenAI | 2 | 1.0 | $0.530 | 21/23 | 8.90s |
| #12 | GPT-6.1 Sol high | OpenAI | 2 | 1.0 | $0.755 | 21/23 | 15.5s |
| #14 | GPT-6 Astra low | OpenAI | 2 | 1.0 | $2.160 | 21/23 | 7.01s |
| #15 | Gemini 3 Flash Preview medium | 2 | 1.0 | $0.876 | 21/23 | 21.6s | |
| #16 | GPT-6.1 Sol low | OpenAI | 2 | 1.0 | $0.460 | 21/23 | 7.15s |
| #18 | Gemini 3.7 Flash medium | 2 | 1.0 | $0.278 | 21/23 | 8.16s | |
| #19 | GPT-6 Sol medium | OpenAI | 2 | 0.9 | $0.703 | 21/23 | 12.1s |