Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Score ↓.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #199 | Ember-1 high | Fireworks | 2 | 0.7 | $2.405 | 12/23 | 58.1s |
| #200 | Gemma 4 31B medium | 4 | 0.7 | $0.144 | 14/23 | 78.8s | |
| #201 | GPT-5.6 Luna low | OpenAI | 10 | 0.7 | $0.049 | 11/23 | 6.96s |
| #202 | Claude Sonnet 5.5 low | Anthropic | 1 | 0.7 | $0.909 | 10/23 | 7.46s |
| #203 | Claude Opus 4.8 none | Anthropic | 5 | 0.7 | $2.334 | 13/23 | 7.54s |
| #204 | Kimi K2.6 medium | Moonshot AI | 4 | 0.7 | $1.594 | 12/23 | 121.3s |
| #205 | Qwen3.5-Flash medium | Qwen | 5 | 0.7 | $0.184 | 12/23 | 83.7s |
| #206 | Inkling low | Thinkingmachines | 8 | 0.7 | $0.293 | 11/23 | 6.81s |
| #207 | Mercury 2.5 Preview medium | Inception | 4 | 0.7 | $0.039 | 15/23 | 6.66s |
| #208 | GPT-6 Sol none | OpenAI | 10 | 0.7 | $0.551 | 13/23 | 9.02s |
| #209 | Space Bunny Alpha max | Stealth | 10 | 0.7 | $0.000 | 11/23 | 36.2s |
| #210 | Solar Pro 4 xhigh | Upstage | 5 | 0.7 | $0.067 | 12/23 | 142.8s |
| #211 | Grok 4.7 xhigh | X AI | 3 | 0.7 | $3.398 | 14/23 | 124.0s |
| #212 | Grok Build 0.1 medium | X AI | 6 | 0.7 | $1.419 | 13/23 | 55.1s |
| #213 | Qwen3.5-Flash none | Qwen | 14 | 0.7 | $0.089 | 8/23 | 26.5s |