Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Response Time (avg) ↑.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #211 | Grok 4.7 xhigh | X AI | 3 | 0.7 | $3.398 | 14/23 | 124.0s |
| #153 | Seed-2.0-Code high | Bytedance Seed | 6 | 0.7 | $1.448 | 12/23 | 124.9s |
| #247 | Kimi K2.5 medium | Moonshot AI | 5 | 0.6 | $0.841 | 10/23 | 125.8s |
| #261 | Solar Pro 4 high | Upstage | 6 | 0.6 | $0.077 | 11/23 | 128.9s |
| #244 | Solar Pro 4 medium | Upstage | 6 | 0.6 | $0.098 | 12/23 | 133.9s |
| #282 | Step 5 Preview medium | Stepfun | 3 | 0.6 | $4.136 | 10/23 | 136.1s |
| #314 | Step 5 Preview low | Stepfun | 2 | 0.6 | $4.110 | 10/23 | 138.3s |
| #328 | North Mini Code medium | Cohere | 10 | 0.5 | $0.000 | 8/23 | 140.4s |
| #210 | Solar Pro 4 xhigh | Upstage | 5 | 0.7 | $0.067 | 12/23 | 142.8s |
| #177 | LongCat 2.0 medium | Meituan | 8 | 0.7 | $0.767 | 12/23 | 144.9s |
| #214 | Solar Pro 4 low | Upstage | 7 | 0.7 | $0.101 | 11/23 | 145.2s |
| #70 | MiMo-V2.6-Pro medium | Xiaomi | 3 | 0.9 | $0.586 | 14/23 | 148.1s |
| #397 | GLM 4.7 Flash medium | Z.ai | 10 | 0.4 | $0.193 | 4/23 | 150.9s |
| #168 | LongCat 2.0 high | Meituan | 7 | 0.7 | $0.778 | 10/23 | 151.7s |
| #30 | Muse Spark Open high | Meta | 2 | 0.9 | $1.782 | 17/23 | 152.0s |