Domain specific: Wrong answer
Domain specific
Wrong answer
See which AI models are most likely to hit Wrong answer on Domain specific, so you can spot weak points faster. Sort by: Total Cost ↓.
Failure Reasons
414/414
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #162 | LongCat 2.0 high | Meituan | 2 | 0.4 | $0.778 | 0/3 | 433.7s |
| #111 | Gemini 3.8 Flash medium | 1 | 0.8 | $0.769 | 2/3 | 31.8s | |
| #171 | LongCat 2.0 medium | Meituan | 2 | 0.3 | $0.767 | 0/3 | 390.6s |
| #12 | GPT-6.1 Sol high | OpenAI | 1 | 0.8 | $0.755 | 2/3 | 59.0s |
| #45 | Gemini 3.5 Flash low | 2 | 0.5 | $0.752 | 1/3 | 4.89s | |
| #346 | Grok 4.20 Beta medium | X AI | 2 | 0.5 | $0.750 | 1/3 | 21.3s |
| #273 | KAT-Coder-Pro V2.5 default | Kwaipilot | 3 | 0.4 | $0.742 | 0/3 | 24.9s |
| #248 | Gemini 3.1 Flash Lite Preview low | 1 | 0.8 | $0.736 | 2/3 | 2.10s | |
| #249 | Gemini 3.1 Flash Lite low | 1 | 0.8 | $0.717 | 2/3 | 1.44s | |
| #245 | Qwen3.5-35B-A3B medium | Qwen | 1 | 0.3 | $0.716 | 0/3 | 76.4s |
| #19 | GPT-6 Sol medium | OpenAI | 1 | 0.8 | $0.703 | 2/3 | 36.4s |
| #90 | GPT-5.6 Terra high | OpenAI | 2 | 0.5 | $0.698 | 1/3 | 42.6s |
| #300 | GPT-5.4 none | OpenAI | 2 | 0.5 | $0.690 | 1/3 | 1.15s |
| #226 | Beam 1.0 501B A23B xhigh | Reflection | 2 | 0.6 | $0.688 | 1/3 | 20.2s |
| #355 | Mimo V2 Omni medium | Xiaomi | 1 | 0.3 | $0.683 | 0/3 | 47.9s |