Domain specific: Wrong answer
Domain specific
Wrong answer
See which AI models are most likely to hit Wrong answer on Domain specific, so you can spot weak points faster. Sort by: Total Cost ↓.
Failure Reasons
423/423
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #258 | Solar Pro 4 high | Upstage | 3 | 0.4 | $0.077 | 0/3 | 280.8s |
| #340 | KAT Coder AIR V2.5 high | Kwaipilot | 1 | 0.3 | $0.077 | 0/3 | 7.28s |
| #221 | Qwen3.7 Flash medium | Qwen | 3 | 0.3 | $0.076 | 0/3 | 38.0s |
| #135 | GPT-6 Luna high | OpenAI | 2 | 0.6 | $0.074 | 1/3 | 51.1s |
| #170 | Qwen3.8 27B medium | Qwen | 2 | 0.5 | ~$0.073 | 1/3 | 77.0s |
| #140 | Qwen3.7 Flash low | Qwen | 3 | 0.4 | $0.071 | 0/3 | 37.6s |
| #372 | Qwen3 Coder Next medium | Qwen | 3 | 0.4 | $0.071 | 0/3 | 570ms |
| #387 | KAT Coder AIR V2.5 default | Kwaipilot | 3 | 0.3 | $0.070 | 0/3 | 8.33s |
| #290 | Gemini 3.1 Flash Lite none | 3 | 0.3 | $0.069 | 0/3 | 701ms | |
| #402 | Grok 4.1 Fast medium | X AI | 1 | 0.6 | $0.069 | 1/3 | 121.8s |
| #374 | GPT-5.4 Nano none | OpenAI | 3 | 0.3 | $0.068 | 0/3 | 880ms |
| #207 | Solar Pro 4 xhigh | Upstage | 3 | 0.3 | $0.067 | 0/3 | 287.7s |
| #357 | Qwen3 Coder Next default | Qwen | 2 | 0.5 | $0.067 | 1/3 | 871ms |
| #151 | GPT-5.6 Luna medium | OpenAI | 3 | 0.3 | $0.065 | 0/3 | 18.5s |
| #138 | Claude Haiku 5.5 medium | Anthropic | 1 | 0.3 | $0.063 | 0/3 | 7.96s |