AI BENCHY Category Failures
Combined: Wrong answer
Combined
Wrong answer
See which AI models are most likely to hit Wrong answer on Combined, so you can spot weak points faster. Sort by: Response Time (avg) ↑.
Failure Reasons
| Rank | Model | Company | Wrong answer Count | Category Score | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|
| #136 | Elephant Alpha medium | Openrouter | 1 | 3.0 | 0/1 | 3.70s |
| #137 | Elephant Alpha none | Openrouter | 1 | 3.0 | 0/1 | 3.81s |
| #148 | GPT-5.4 Nano none | OpenAI | 1 | 3.0 | 0/1 | 3.84s |
| #150 | Qwen3 Coder Next medium | Qwen | 1 | 3.0 | 0/1 | 4.28s |
| #97 | Gemini 2.5 Flash none | 1 | 3.0 | 0/1 | 4.39s | |
| #61 | Gemini 3.1 Flash Lite low | 1 | 3.0 | 0/1 | 4.48s | |
| #104 | Nemotron 3 Ultra 550b A55b none | NVIDIA | 1 | 3.0 | 0/1 | 4.79s |
| #134 | GLM 5 Turbo none | Z.ai | 1 | 3.0 | 0/1 | 4.89s |
| #98 | GLM 5 none | Z.ai | 1 | 3.0 | 0/1 | 4.98s |
| #91 | GPT-5.5 none | OpenAI | 1 | 3.0 | 0/1 | 5.56s |
| #101 | Mimo V2 Omni none | Xiaomi | 1 | 3.0 | 0/1 | 5.96s |
| #108 | Qwen3.5-Flash none | Qwen | 1 | 3.0 | 0/1 | 6.22s |
| #109 | GLM 5V Turbo none | Z.ai | 1 | 3.0 | 0/1 | 6.51s |
| #120 | Mimo V2 PRO none | Xiaomi | 1 | 3.0 | 0/1 | 6.58s |
| #110 | Seed-2.0-Lite none | Bytedance Seed | 1 | 3.0 | 0/1 | 6.59s |