Domain specific: Wrong answer
Domain specific
Wrong answer
See which AI models are most likely to hit Wrong answer on Domain specific, so you can spot weak points faster.
Failure Reasons
414/414
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #224 | Mercury 2.5 Preview high | Inception | 3 | 0.3 | $0.040 | 0/3 | 5.68s |
| #225 | Mercury 2.5 high | Inception | 3 | 0.3 | $0.044 | 0/3 | 4.86s |
| #229 | KAT-Coder-Pro V2.5 high | Kwaipilot | 3 | 0.3 | $0.506 | 0/3 | 44.7s |
| #230 | Grok 4.3 medium | X AI | 3 | 0.3 | $0.989 | 0/3 | 158.0s |
| #234 | Beam 1.0 501B A23B max | Reflection | 3 | 0.3 | $0.799 | 0/3 | 31.9s |
| #235 | Solar Pro 4 medium | Upstage | 3 | 0.3 | $0.098 | 0/3 | 201.8s |
| #238 | Beam 1.0 501B A23B low | Reflection | 3 | 0.3 | $0.432 | 0/3 | 8.45s |
| #239 | Mercury 2.5 medium | Inception | 3 | 0.4 | $0.034 | 0/3 | 4.39s |
| #243 | Dots 3 Note Preview low | Dots Studio | 3 | 0.4 | $0.000 | 0/3 | 49.5s |
| #250 | Solar Pro 4 high | Upstage | 3 | 0.4 | $0.077 | 0/3 | 280.8s |
| #257 | DeepSeek V4 Flash 0423 none | DeepSeek | 3 | 0.3 | $0.149 | 0/3 | 15.3s |
| #260 | KAT-Coder-Pro V2.5 medium | Kwaipilot | 3 | 0.3 | $0.669 | 0/3 | 35.1s |
| #264 | Claude Fable 5.1 low | Anthropic | 3 | 0.4 | $3.395 | 0/3 | 19.3s |
| #266 | Beam 1.0 501B A23B high | Reflection | 3 | 0.4 | $0.674 | 0/3 | 20.7s |
| #268 | Apodex 1.1 Mini low | Apodex | 3 | 0.4 | $0.000 | 0/3 | 50.2s |