AI BENCHY Category Failures
Coding: Wrong answer
Coding
Wrong answer
See which AI models are most likely to hit Wrong answer on Coding, so you can spot weak points faster. Sort by: Tests Correct ↓.
Failure Reasons
| Rank | Model | Company | Wrong answer Count | Category Score | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|
| #120 | Grok 4.20 none | X AI | 1 | 3.4 | 0/1 | 1.22s |
| #121 | Mistral Small 4 medium | Mistral | 2 | 5.1 | 0/2 | 44.8s |
| #122 | Elephant Alpha medium | Openrouter | 1 | 4.0 | 0/2 | 1.30s |
| #123 | Laguna M.1 none | Poolside | 1 | 7.5 | 0/1 | 2.93s |
| #124 | Qwen3.5-122B-A10B none | Qwen | 2 | 4.0 | 0/2 | 2.14s |
| #125 | GLM 5 Turbo none | Z.ai | 2 | 4.4 | 0/2 | 2.58s |
| #127 | Laguna Xs.2 none | Poolside | 1 | 2.5 | 0/1 | 1.96s |
| #129 | gpt-oss-120b none | OpenAI | 1 | 4.3 | 0/1 | 9.57s |
| #130 | Elephant Alpha none | Openrouter | 1 | 4.7 | 0/2 | 1.39s |
| #131 | DeepSeek V4 Flash none | DeepSeek | 2 | 4.8 | 0/2 | 24.5s |
| #132 | Qwen3 Coder Next none | Qwen | 2 | 5.4 | 0/2 | 2.01s |
| #134 | Nemotron 3 Super none | NVIDIA | 2 | 3.4 | 0/2 | 3.02s |
| #135 | Mistral Small 4 none | Mistral | 2 | 4.0 | 0/2 | 1.03s |
| #138 | GPT-4o-mini none | OpenAI | 2 | 3.2 | 0/2 | 2.05s |
| #140 | Trinity Large Preview none | Arcee AI | 1 | 4.9 | 0/1 | 14.3s |