Domain specific: Wrong answer
Domain specific
Wrong answer
See which AI models are most likely to hit Wrong answer on Domain specific, so you can spot weak points faster. Sort by: Total Cost ↑.
Failure Reasons
414/414
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #202 | Solar Pro 4 xhigh | Upstage | 3 | 0.3 | $0.067 | 0/3 | 287.7s |
| #365 | GPT-5.4 Nano none | OpenAI | 3 | 0.3 | $0.068 | 0/3 | 880ms |
| #393 | Grok 4.1 Fast medium | X AI | 1 | 0.6 | $0.069 | 1/3 | 121.8s |
| #282 | Gemini 3.1 Flash Lite none | 3 | 0.3 | $0.069 | 0/3 | 701ms | |
| #378 | KAT Coder AIR V2.5 default | Kwaipilot | 3 | 0.3 | $0.070 | 0/3 | 8.33s |
| #363 | Qwen3 Coder Next medium | Qwen | 3 | 0.4 | $0.071 | 0/3 | 570ms |
| #137 | Qwen3.7 Flash low | Qwen | 3 | 0.4 | $0.071 | 0/3 | 37.6s |
| #167 | Qwen3.8 27B medium | Qwen | 2 | 0.5 | ~$0.073 | 1/3 | 77.0s |
| #132 | GPT-6 Luna high | OpenAI | 2 | 0.6 | $0.074 | 1/3 | 51.1s |
| #216 | Qwen3.7 Flash medium | Qwen | 3 | 0.3 | $0.076 | 0/3 | 38.0s |
| #331 | KAT Coder AIR V2.5 high | Kwaipilot | 1 | 0.3 | $0.077 | 0/3 | 7.28s |
| #250 | Solar Pro 4 high | Upstage | 3 | 0.4 | $0.077 | 0/3 | 280.8s |
| #280 | Gemini 3.1 Flash Lite minimal | 3 | 0.3 | $0.080 | 0/3 | 972ms | |
| #306 | Nemotron 3 Super medium | NVIDIA | 2 | 0.3 | $0.081 | 0/3 | 19.4s |
| #155 | DeepSeek V4 Pro 0423 none | DeepSeek | 3 | 0.3 | $0.083 | 0/3 | 4.91s |