Agentic: Wrong answer
Agentic
Wrong answer
See which AI models are most likely to hit Wrong answer on Agentic, so you can spot weak points faster. Sort by: Response Time (avg) ↑.
Failure Reasons
136/136
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #415 | North Mini Code default | Cohere | 1 | 0.3 | $0.000 | 0/1 | 18.9s |
| #432 | Nemotron 3 Super none | NVIDIA | 1 | 0.3 | $0.016 | 0/1 | 30.5s |
| #265 | Beam 1.0 501B A23B medium | Reflection | 1 | 0.3 | $0.499 | 0/1 | 31.6s |
| #315 | Beam 1.0 501B A23B high | Reflection | 1 | 0.3 | $0.674 | 0/1 | 33.5s |
| #263 | Mercury 2 medium | Inception | 1 | 0.5 | $0.121 | 0/1 | 34.9s |
| #399 | GPT-4o-mini default | OpenAI | 1 | 0.5 | $0.024 | 0/1 | 40.0s |
| #347 | GPT-5.4 Mini none | OpenAI | 1 | 0.5 | $0.170 | 0/1 | 42.0s |
| #354 | GPT-5.4 none | OpenAI | 1 | 0.5 | $0.690 | 0/1 | 43.7s |
| #332 | Gemini 3.1 Flash Lite none | 1 | 0.5 | $0.069 | 0/1 | 43.8s | |
| #339 | DeepSeek V4.1 Flash 1017 none | DeepSeek | 1 | 0.5 | $0.055 | 0/1 | 43.9s |
| #272 | Beam 1.0 501B A23B xhigh | Reflection | 1 | 0.3 | $0.688 | 0/1 | 44.6s |
| #352 | Gemma 4 31B none | 1 | 0.4 | $0.031 | 0/1 | 44.7s | |
| #420 | GPT-5.4 Nano none | OpenAI | 1 | 0.4 | $0.068 | 0/1 | 45.4s |
| #390 | Mistral Small 4 none | Mistral | 1 | 0.5 | $0.047 | 0/1 | 45.5s |
| #398 | Dots 3 Note Preview default | Dots Studio | 1 | 0.4 | $0.000 | 0/1 | 45.7s |