Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↑.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #153 | Seed-2.0-Code high | Bytedance Seed | 6 | 0.7 | $1.448 | 12/23 | 124.9s |
| #177 | LongCat 2.0 medium | Meituan | 8 | 0.7 | $0.767 | 12/23 | 144.9s |
| #181 | Claude Opus 5 none | Anthropic | 7 | 0.7 | $2.766 | 12/23 | 10.8s |
| #183 | GLM 5.3 FlashX medium | Z.ai | 8 | 0.7 | $0.114 | 12/23 | 7.37s |
| #184 | Minimax M3.1 Flash low | Minimax | 9 | 0.7 | $0.000 | 12/23 | 14.8s |
| #185 | MiMo-V2.6-Flash low | Xiaomi | 5 | 0.7 | $0.200 | 12/23 | 54.6s |
| #186 | MiMo-V2.5 medium | Xiaomi | 5 | 0.7 | $0.130 | 12/23 | 49.2s |
| #199 | Ember-1 high | Fireworks | 2 | 0.7 | $2.405 | 12/23 | 58.1s |
| #204 | Kimi K2.6 medium | Moonshot AI | 4 | 0.7 | $1.594 | 12/23 | 121.3s |
| #205 | Qwen3.5-Flash medium | Qwen | 5 | 0.7 | $0.184 | 12/23 | 83.7s |
| #210 | Solar Pro 4 xhigh | Upstage | 5 | 0.7 | $0.067 | 12/23 | 142.8s |
| #219 | GPT-5.6 Sol none | OpenAI | 10 | 0.7 | $0.795 | 12/23 | 4.61s |
| #222 | GPT-5.5 none | OpenAI | 11 | 0.7 | $1.212 | 12/23 | 4.75s |
| #232 | Qwen3.6 35B A3B medium | Qwen | 6 | 0.7 | $0.834 | 12/23 | 59.9s |
| #233 | Mercury 2.5 Preview high | Inception | 6 | 0.6 | $0.040 | 12/23 | 7.61s |