Agentic: Wrong answer
Agentic
Wrong answer
See which AI models are most likely to hit Wrong answer on Agentic, so you can spot weak points faster. Sort by: Total Cost ↑.
Failure Reasons
139/139
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #258 | MiniMax M3 medium | Minimax | 1 | 0.3 | $0.422 | 0/1 | 116.5s |
| #217 | GLM 5 medium | Z.ai | 1 | 0.5 | $0.479 | 0/1 | 110.7s |
| #367 | Kimi K2.6 none | Moonshot AI | 1 | 0.5 | $0.486 | 0/1 | 175.2s |
| #148 | DeepSeek V4.1 Flash low | DeepSeek | 1 | 0.6 | $0.494 | 0/1 | 56.0s |
| #270 | Beam 1.0 501B A23B medium | Reflection | 1 | 0.3 | $0.499 | 0/1 | 31.6s |
| #292 | Gemini 3.5 Flash minimal | 1 | 0.5 | $0.508 | 0/1 | 49.2s | |
| #114 | Claude Haiku 5.5 max | Anthropic | 1 | 0.5 | $0.509 | 0/1 | 93.3s |
| #362 | ERNIE-Light-DT-1.0 none | Baidu | 1 | 0.5 | $0.524 | 0/1 | 49.9s |
| #249 | GPT-6 Sol none | OpenAI | 1 | 0.5 | $0.551 | 0/1 | 57.0s |
| #207 | Qwen3.6 Plus medium | Qwen | 1 | 0.5 | $0.554 | 0/1 | 307.1s |
| #211 | Qwen3.5 Plus 2026-02-15 medium | Qwen | 1 | 0.6 | $0.567 | 0/1 | 186.4s |
| #267 | LongCat 2.0 low | Meituan | 1 | 0.6 | $0.630 | 0/1 | 145.6s |
| #320 | Beam 1.0 501B A23B high | Reflection | 1 | 0.3 | $0.674 | 0/1 | 33.5s |
| #277 | Beam 1.0 501B A23B xhigh | Reflection | 1 | 0.3 | $0.688 | 0/1 | 44.6s |
| #359 | GPT-5.4 none | OpenAI | 1 | 0.5 | $0.690 | 0/1 | 43.7s |