Agentic: Wrong answer
Agentic
Wrong answer
See which AI models are most likely to hit Wrong answer on Agentic, so you can spot weak points faster. Sort by: Total Cost ↓.
Failure Reasons
108/108
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #248 | Qwen3.7 Flash none | Qwen | 1 | 4.7 | $0.028 | 0/1 | 117.0s |
| #313 | GLM 4.7 Flash none | Z.ai | 1 | 5.0 | $0.027 | 0/1 | 80.7s |
| #344 | Mercury 2.5 none | Inception | 1 | 5.0 | $0.026 | 0/1 | 63.4s |
| #268 | Gemma 4 26B A4B none | 1 | 5.0 | $0.026 | 0/1 | 75.8s | |
| #300 | GPT-4o-mini none | OpenAI | 1 | 5.0 | $0.024 | 0/1 | 40.0s |
| #333 | Nemotron 3 Super none | NVIDIA | 1 | 2.8 | $0.016 | 0/1 | 30.5s |
| #342 | gpt-oss-120b none | OpenAI | 1 | 6.1 | $0.016 | 0/1 | 140.9s |
| #297 | Mercury 2.5 Preview low | Inception | 1 | 5.0 | $0.015 | 0/1 | 84.5s |
| #272 | Qwen3.8 27B none | Qwen | 1 | 5.0 | ~$0.010 | 0/1 | 47.4s |
| #173 | Space Bunny Alpha max | Stealth | 1 | 6.1 | $0.000 | 0/1 | 90.6s |
| #210 | Dots 3 Note Preview high | Dots Studio | 1 | 6.1 | $0.000 | 0/1 | 129.1s |
| #211 | Dots 3 Note Preview low | Dots Studio | 1 | 6.1 | $0.000 | 0/1 | 161.2s |
| #221 | Space Bunny Alpha medium | Stealth | 1 | 6.1 | $0.000 | 0/1 | 153.1s |
| #257 | Dots 3 Note Preview medium | Dots Studio | 1 | 4.7 | $0.000 | 0/1 | 140.5s |
| #259 | Space Bunny Alpha low | Stealth | 1 | 4.7 | $0.000 | 0/1 | 89.0s |