Agentic: Wrong answer
Agentic
Wrong answer
See which AI models are most likely to hit Wrong answer on Agentic, so you can spot weak points faster. Sort by: Response Time (avg) ↓.
Failure Reasons
139/139
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #317 | Gemini 3.1 Flash Lite Preview none | 1 | 0.5 | $0.090 | 0/1 | 48.6s | |
| #239 | Gemini 3.1 Flash Lite medium | 1 | 0.5 | $0.153 | 0/1 | 47.8s | |
| #375 | Qwen3.8 27B none | Qwen | 1 | 0.5 | ~$0.010 | 0/1 | 47.4s |
| #265 | GLM 5.2 none | Z.ai | 1 | 0.6 | $0.250 | 0/1 | 46.9s |
| #404 | Dots 3 Note Preview default | Dots Studio | 1 | 0.4 | $0.000 | 0/1 | 45.7s |
| #396 | Mistral Small 4 none | Mistral | 1 | 0.5 | $0.047 | 0/1 | 45.5s |
| #426 | GPT-5.4 Nano none | OpenAI | 1 | 0.4 | $0.068 | 0/1 | 45.4s |
| #357 | Gemma 4 31B none | 1 | 0.4 | $0.031 | 0/1 | 44.7s | |
| #277 | Beam 1.0 501B A23B xhigh | Reflection | 1 | 0.3 | $0.688 | 0/1 | 44.6s |
| #344 | DeepSeek V4.1 Flash 1017 none | DeepSeek | 1 | 0.5 | $0.055 | 0/1 | 43.9s |
| #337 | Gemini 3.1 Flash Lite none | 1 | 0.5 | $0.069 | 0/1 | 43.8s | |
| #359 | GPT-5.4 none | OpenAI | 1 | 0.5 | $0.690 | 0/1 | 43.7s |
| #352 | GPT-5.4 Mini none | OpenAI | 1 | 0.5 | $0.170 | 0/1 | 42.0s |
| #405 | GPT-4o-mini default | OpenAI | 1 | 0.5 | $0.024 | 0/1 | 40.0s |
| #268 | Mercury 2 medium | Inception | 1 | 0.5 | $0.121 | 0/1 | 34.9s |