Coding: Wrong answer
Coding
Wrong answer
See which AI models are most likely to hit Wrong answer on Coding, so you can spot weak points faster. Sort by: Tests Correct ↓.
Failure Reasons
197/197
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #180 | Nemotron 3 Ultra none | NVIDIA | 2 | 5.5 | $0.095 | 1/3 | 1.02s |
| #182 | Gemini 2.5 Flash none | 2 | 5.5 | $0.017 | 1/3 | 736ms | |
| #184 | GPT-5.6 Terra none | OpenAI | 2 | 5.5 | $0.280 | 1/3 | 1.00s |
| #186 | GPT-5 Nano medium | OpenAI | 2 | 7.0 | $0.118 | 1/3 | 41.6s |
| #187 | Qwen3.5-Flash none | Qwen | 2 | 5.5 | $0.073 | 1/3 | 850ms |
| #188 | Qwen3.5-35B-A3B none | Qwen | 2 | 5.5 | $0.142 | 1/3 | 1.39s |
| #193 | GPT-5.4 Mini none | OpenAI | 2 | 5.5 | $0.095 | 1/3 | 913ms |
| #195 | GPT-5.4 none | OpenAI | 2 | 5.5 | $0.397 | 1/3 | 1.62s |
| #196 | Solar Pro 4 none | Upstage | 2 | 5.5 | $0.006 | 1/3 | 2.61s |
| #201 | Ling-3.0-flash none | Inclusionai | 2 | 5.5 | $0.004 | 1/3 | 6.39s |
| #203 | Kimi K2.6 none | Moonshot AI | 1 | 5.5 | $0.230 | 1/3 | 82.6s |
| #207 | GLM 5V Turbo none | Z.ai | 2 | 5.5 | $0.052 | 1/3 | 3.13s |
| #208 | Owl Alpha medium | Openrouter | 1 | 5.4 | $0.000 | 1/3 | 18.7s |
| #210 | Mimo V2 PRO none | Xiaomi | 1 | 5.5 | $0.045 | 1/3 | 2.65s |
| #211 | Owl Alpha none | Openrouter | 1 | 5.6 | $0.000 | 1/3 | 36.9s |