Agentic: Wrong answer
Agentic
Wrong answer
See which AI models are most likely to hit Wrong answer on Agentic, so you can spot weak points faster. Sort by: Response Time (avg) ↓.
Failure Reasons
108/108
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #160 | Gemini 3 Flash Preview low | 1 | 5.0 | $0.254 | 0/1 | 52.6s | |
| #233 | Trinity Large Thinking medium | Arcee AI | 1 | 6.1 | $0.820 | 0/1 | 52.5s |
| #242 | Gemini 3.1 Flash Lite minimal | 1 | 5.0 | $0.080 | 0/1 | 50.0s | |
| #208 | Gemini 3.5 Flash minimal | 1 | 5.0 | $0.508 | 0/1 | 49.2s | |
| #230 | Gemini 3.1 Flash Lite Preview none | 1 | 5.0 | $0.090 | 0/1 | 48.6s | |
| #163 | Gemini 3.1 Flash Lite medium | 1 | 5.0 | $0.153 | 0/1 | 47.8s | |
| #272 | Qwen3.8 27B none | Qwen | 1 | 5.0 | ~$0.010 | 0/1 | 47.4s |
| #299 | Dots 3 Note Preview none | Dots Studio | 1 | 3.9 | $0.000 | 0/1 | 45.7s |
| #292 | Mistral Small 4 none | Mistral | 1 | 5.0 | $0.047 | 0/1 | 45.5s |
| #321 | GPT-5.4 Nano none | OpenAI | 1 | 3.9 | $0.068 | 0/1 | 45.4s |
| #258 | Gemma 4 31B none | 1 | 3.9 | $0.030 | 0/1 | 44.7s | |
| #244 | Gemini 3.1 Flash Lite none | 1 | 5.0 | $0.069 | 0/1 | 43.8s | |
| #260 | GPT-5.4 none | OpenAI | 1 | 5.0 | $0.690 | 0/1 | 43.7s |
| #255 | GPT-5.4 Mini none | OpenAI | 1 | 5.0 | $0.170 | 0/1 | 42.0s |
| #300 | GPT-4o-mini none | OpenAI | 1 | 5.0 | $0.024 | 0/1 | 40.0s |