AI BENCHY Category Failures
Coding: Wrong answer
Coding
Wrong answer
See which AI models are most likely to hit Wrong answer on Coding, so you can spot weak points faster. Sort by: Response Time (avg) ↑.
Failure Reasons
| Rank | Model | Company | Wrong answer Count | Category Score | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|
| #39 | Gemini 3 Flash Preview none | 1 | 6.8 | 1/2 | 2.19s | |
| #90 | Mercury 2 medium | Inception | 1 | 7.2 | 1/2 | 2.29s |
| #116 | Qwen3.6 Flash none | Qwen | 1 | 6.6 | 1/2 | 2.34s |
| #88 | Qwen3.5 Plus 2026-02-15 none | Qwen | 2 | 4.9 | 0/2 | 2.54s |
| #125 | GLM 5 Turbo none | Z.ai | 2 | 4.4 | 0/2 | 2.58s |
| #107 | MiMo-V2-Pro none | Xiaomi | 1 | 6.8 | 1/2 | 2.65s |
| #93 | MiMo-V2-Omni none | Xiaomi | 1 | 5.1 | 0/2 | 2.75s |
| #123 | Laguna M.1 none | Poolside | 1 | 7.5 | 0/1 | 2.93s |
| #99 | Seed-2.0-Lite none | Bytedance Seed | 1 | 6.8 | 1/2 | 2.95s |
| #134 | Nemotron 3 Super none | NVIDIA | 2 | 3.4 | 0/2 | 3.02s |
| #66 | Qwen3.6 Max Preview none | Qwen | 2 | 4.2 | 0/2 | 3.06s |
| #109 | GLM 4.7 Flash none | Z.ai | 2 | 5.0 | 0/2 | 3.35s |
| #35 | Gemini 3.1 Flash Lite medium | 1 | 6.8 | 1/2 | 3.59s | |
| #139 | MiMo-V2.5 none | Xiaomi | 1 | 6.8 | 1/2 | 3.74s |
| #98 | GLM 5V Turbo none | Z.ai | 1 | 6.8 | 1/2 | 3.77s |