AI BENCHY Category Failures
Trivia: Wrong answer
Trivia
Wrong answer
See which AI models are most likely to hit Wrong answer on Trivia, so you can spot weak points faster. Sort by: Response Time (avg) ↑.
Failure Reasons
| Rank | Model | Company | Wrong answer Count | Category Score | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|
| #80 | Mercury 2 medium | Inception | 1 | 3.0 | 0/1 | 2.58s |
| #23 | Gemini 3.1 Flash Lite Preview medium | 1 | 3.0 | 0/1 | 2.68s | |
| #133 | HY3 Preview none | Tencent | 1 | 3.0 | 0/1 | 2.71s |
| #25 | Gemini 2.5 Flash medium | 1 | 3.0 | 0/1 | 2.76s | |
| #120 | DeepSeek V4 Flash none | DeepSeek | 1 | 3.0 | 0/1 | 3.07s |
| #27 | Gemini 3.1 Flash Lite medium | 1 | 3.0 | 0/1 | 3.08s | |
| #78 | GLM 5 none | Z.ai | 1 | 3.0 | 0/1 | 3.62s |
| #128 | MiMo-V2.5 none | Xiaomi | 1 | 3.0 | 0/1 | 3.89s |
| #112 | Kimi K2.5 none | Moonshot AI | 1 | 3.0 | 0/1 | 3.90s |
| #94 | Qwen3.6 27B none | Qwen | 1 | 3.0 | 0/1 | 4.03s |
| #46 | GPT-5.3 Chat none | OpenAI | 1 | 3.0 | 0/1 | 4.38s |
| #61 | Claude Sonnet 4.6 none | Anthropic | 1 | 3.0 | 0/1 | 4.67s |
| #53 | GPT-5.4 Nano medium | OpenAI | 1 | 3.0 | 0/1 | 4.81s |
| #72 | GPT-5.5 none | OpenAI | 1 | 3.0 | 0/1 | 5.01s |
| #107 | Mistral Small 4 medium | Mistral | 1 | 3.0 | 0/1 | 5.92s |