AI BENCHY Category Failures
Anti-AI Tricks: Wrong answer
Anti-AI Tricks
Wrong answer
See which AI models are most likely to hit Wrong answer on Anti-AI Tricks, so you can spot weak points faster. Sort by: Response Time (avg) ↓.
Failure Reasons
| Rank | Model | Company | Wrong answer Count | Category Score | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|
| #128 | Qwen3.6 Flash none | Qwen | 4 | 3.1 | 0/4 | 1.63s |
| #131 | Qwen3.5-122B-A10B none | Qwen | 3 | 4.8 | 1/4 | 1.59s |
| #117 | Qwen3.5-35B-A3B none | Qwen | 4 | 3.4 | 0/4 | 1.43s |
| #124 | Kimi K2.6 none | Moonshot AI | 3 | 4.6 | 1/4 | 1.39s |
| #88 | Qwen3.7 Plus none | Qwen | 2 | 6.5 | 2/4 | 1.38s |
| #147 | GPT-4o-mini none | OpenAI | 3 | 4.8 | 1/4 | 1.34s |
| #108 | Qwen3.5-Flash none | Qwen | 4 | 3.5 | 0/4 | 1.32s |
| #91 | GPT-5.5 none | OpenAI | 2 | 6.9 | 2/4 | 1.31s |
| #102 | Gemma 4 26B A4B none | 1 | 8.3 | 3/4 | 1.28s | |
| #48 | Gemini 3 Flash Preview none | 1 | 8.3 | 3/4 | 1.25s | |
| #125 | GPT-5.4 none | OpenAI | 4 | 3.2 | 0/4 | 1.21s |
| #149 | Nemotron 3 Nano Omni 30b A3b Reasoning medium | NVIDIA | 1 | 6.4 | 2/4 | 1.20s |
| #152 | MiMo-V2-Flash none | Xiaomi | 4 | 3.2 | 0/4 | 1.19s |
| #136 | Elephant Alpha medium | Openrouter | 2 | 6.6 | 2/4 | 1.19s |
| #148 | GPT-5.4 Nano none | OpenAI | 4 | 3.5 | 0/4 | 1.18s |