AI BENCHY Category Failures
Combined: Wrong answer
Combined
Wrong answer
See which AI models are most likely to hit Wrong answer on Combined, so you can spot weak points faster. Sort by: Response Time (avg) ↓.
Failure Reasons
| Rank | Model | Company | Wrong answer Count | Category Score | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|
| #104 | Nemotron 3 Ultra 550b A55b none | NVIDIA | 1 | 3.0 | 0/1 | 4.79s |
| #61 | Gemini 3.1 Flash Lite low | 1 | 3.0 | 0/1 | 4.48s | |
| #97 | Gemini 2.5 Flash none | 1 | 3.0 | 0/1 | 4.39s | |
| #150 | Qwen3 Coder Next medium | Qwen | 1 | 3.0 | 0/1 | 4.28s |
| #148 | GPT-5.4 Nano none | OpenAI | 1 | 3.0 | 0/1 | 3.84s |
| #137 | Elephant Alpha none | Openrouter | 1 | 3.0 | 0/1 | 3.81s |
| #136 | Elephant Alpha medium | Openrouter | 1 | 3.0 | 0/1 | 3.70s |
| #48 | Gemini 3 Flash Preview none | 1 | 4.7 | 0/1 | 3.56s | |
| #124 | Kimi K2.6 none | Moonshot AI | 1 | 3.0 | 0/1 | 3.38s |
| #157 | Grok 4.1 Fast none | X AI | 1 | 3.0 | 0/1 | 3.33s |
| #16 | Gemini 3 Flash Preview low | 1 | 3.0 | 0/1 | 3.27s | |
| #58 | Gemini 3.1 Flash Lite Preview none | 1 | 3.0 | 0/1 | 3.20s | |
| #125 | GPT-5.4 none | OpenAI | 1 | 3.0 | 0/1 | 2.89s |
| #152 | MiMo-V2-Flash none | Xiaomi | 1 | 3.0 | 0/1 | 2.87s |
| #90 | Gemini 3.1 Flash Lite none | 1 | 3.0 | 0/1 | 2.73s |