AI BENCHY Category Failures
Coding: Wrong answer
Coding
Wrong answer
See which AI models are most likely to hit Wrong answer on Coding, so you can spot weak points faster. Sort by: Tests Correct ↓.
Failure Reasons
| Rank | Model | Company | Wrong answer Count | Category Score | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|
| #78 | Gemini 3.1 Flash Lite minimal | 1 | 6.8 | 1/2 | 951ms | |
| #85 | Gemini 3.1 Flash Lite none | 1 | 6.8 | 1/2 | 1.13s | |
| #86 | GPT-5.5 none | OpenAI | 1 | 6.8 | 1/2 | 1.52s |
| #90 | Mercury 2 medium | Inception | 1 | 7.2 | 1/2 | 2.29s |
| #92 | Gemini 2.5 Flash none | 1 | 6.8 | 1/2 | 810ms | |
| #97 | Qwen3.5-Flash none | Qwen | 1 | 6.8 | 1/2 | 993ms |
| #98 | GLM 5V Turbo none | Z.ai | 1 | 6.8 | 1/2 | 3.77s |
| #99 | Seed-2.0-Lite none | Bytedance Seed | 1 | 6.8 | 1/2 | 2.95s |
| #102 | Qwen3.5-35B-A3B none | Qwen | 1 | 6.8 | 1/2 | 1.72s |
| #103 | Qwen3.5-27B none | Qwen | 1 | 7.3 | 1/2 | 1.98s |
| #104 | Qwen3.6 27B none | Qwen | 1 | 6.8 | 1/2 | 5.75s |
| #107 | MiMo-V2-Pro none | Xiaomi | 1 | 6.8 | 1/2 | 2.65s |
| #112 | GPT-5.4 none | OpenAI | 1 | 6.8 | 1/2 | 1.99s |
| #116 | Qwen3.6 Flash none | Qwen | 1 | 6.6 | 1/2 | 2.34s |
| #126 | Kimi K2.5 none | Moonshot AI | 1 | 6.8 | 1/2 | 36.0s |