Agentic: Wrong answer
Agentic
Wrong answer
See which AI models are most likely to hit Wrong answer on Agentic, so you can spot weak points faster. Sort by: Response Time (avg) ↓.
Failure Reasons
110/110
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #313 | GLM 4.7 Flash none | Z.ai | 1 | 5.0 | $0.027 | 0/1 | 80.7s |
| #195 | Mercury 2.5 high | Inception | 1 | 3.9 | $0.044 | 0/1 | 80.3s |
| #216 | Gemini 3.1 Flash Lite low | 1 | 5.0 | $0.717 | 0/1 | 80.0s | |
| #270 | Seed-2.0-Code none | Bytedance Seed | 1 | 6.1 | $0.257 | 0/1 | 80.0s |
| #149 | Claude Opus 5 none | Anthropic | 1 | 5.4 | $2.766 | 0/1 | 79.6s |
| #238 | GLM 5.3 FlashX low | Z.ai | 1 | 4.7 | $0.157 | 0/1 | 78.0s |
| #82 | Grok 4.5 high | X AI | 1 | 5.0 | $2.571 | 0/1 | 77.0s |
| #241 | Seed-2.0-Lite none | Bytedance Seed | 1 | 5.0 | $0.114 | 0/1 | 76.0s |
| #268 | Gemma 4 26B A4B none | 1 | 5.0 | $0.026 | 0/1 | 75.8s | |
| #262 | GLM 5 none | Z.ai | 1 | 5.0 | $0.126 | 0/1 | 74.8s |
| #256 | Seed 2.1 Turbo none | Bytedance Seed | 1 | 5.0 | $0.182 | 0/1 | 71.4s |
| #215 | Gemini 3.1 Flash Lite Preview low | 1 | 5.0 | $0.736 | 0/1 | 71.3s | |
| #247 | Nemotron 3 Ultra none | NVIDIA | 1 | 5.0 | $0.193 | 0/1 | 70.2s |
| #142 | Gemini 3.8 Flash low | 1 | 6.1 | $0.323 | 0/1 | 67.2s | |
| #104 | Grok 4.5 medium | X AI | 1 | 5.0 | $2.454 | 0/1 | 65.2s |