AI BENCHY Category Failures
Coding: Wrong answer
Coding
Wrong answer
See which AI models are most likely to hit Wrong answer on Coding, so you can spot weak points faster. Sort by: Response Time (avg) ↓.
Failure Reasons
134/134
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #108 | GPT-5.6 Luna low | OpenAI | 2 | 5.5 | $0.141 | 1/3 | 4.61s |
| #178 | Hy3 preview none | Tencent | 1 | 2.7 | $0.003 | 0/3 | 4.56s |
| #138 | Qwen3.6 27B none | Qwen | 2 | 5.5 | $0.025 | 1/3 | 4.16s |
| #139 | Gemma 4 26B A4B none | 2 | 3.7 | $0.004 | 0/3 | 4.16s | |
| #41 | Gemini 3.1 Flash Lite Preview medium | 2 | 5.5 | $0.068 | 1/3 | 4.09s | |
| #43 | Gemini 3.1 Flash Lite medium | 2 | 5.5 | $0.071 | 1/3 | 3.81s | |
| #132 | Claude Sonnet 5 none | Anthropic | 3 | 4.6 | $0.287 | 0/3 | 3.67s |
| #70 | Claude Opus 4.8 none | Anthropic | 1 | 5.5 | $0.539 | 1/3 | 3.29s |
| #154 | MiMo-V2.5 none | Xiaomi | 2 | 5.5 | $0.006 | 1/3 | 3.24s |
| #122 | GLM 5V Turbo none | Z.ai | 2 | 5.5 | $0.052 | 1/3 | 3.13s |
| #116 | Qwen3.6 Max Preview none | Qwen | 3 | 3.8 | $0.075 | 0/3 | 3.12s |
| #170 | Laguna M.1 none | Poolside | 1 | 2.5 | $0.009 | 0/1 | 2.93s |
| #107 | Seed-2.0-Lite none | Bytedance Seed | 2 | 5.6 | $0.019 | 1/3 | 2.83s |
| #145 | Qwen3.5-122B-A10B none | Qwen | 3 | 3.7 | $0.020 | 0/3 | 2.77s |
| #85 | Gemini 3.5 Flash minimal | 1 | 5.6 | $0.108 | 1/3 | 2.75s |