Coding: Wrong answer
Coding
Wrong answer
See which AI models are most likely to hit Wrong answer on Coding, so you can spot weak points faster. Sort by: Response Time (avg) ↑.
Failure Reasons
197/197
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #149 | Gemini 3.1 Flash Lite low | 2 | 5.5 | $0.621 | 1/3 | 1.53s | |
| #277 | Nemotron 3.5 Lightning none | NVIDIA | 3 | 3.1 | $0.007 | 0/3 | 1.55s |
| #172 | Qwen3.7 Flash none | Qwen | 2 | 5.5 | $0.019 | 1/3 | 1.55s |
| #195 | GPT-5.4 none | OpenAI | 2 | 5.5 | $0.397 | 1/3 | 1.62s |
| #245 | GPT-4o-mini none | OpenAI | 3 | 3.2 | $0.010 | 0/3 | 1.63s |
| #179 | Qwen3.5 Plus 2026-04-20 none | Qwen | 2 | 3.9 | $0.122 | 0/3 | 1.69s |
| #224 | DeepSeek V4 Flash 0731 none | DeepSeek | 3 | 4.3 | $0.021 | 0/3 | 1.72s |
| #177 | Qwen3.6 Flash none | Qwen | 2 | 5.4 | $0.062 | 1/3 | 1.79s |
| #281 | Grok 4.1 Fast none | X AI | 1 | 1.8 | $0.008 | 0/1 | 1.79s |
| #146 | Qwen3.5-27B none | Qwen | 2 | 5.8 | $0.058 | 1/3 | 1.80s |
| #136 | Gemini 3 Flash Preview none | 2 | 5.5 | $0.085 | 1/3 | 1.80s | |
| #284 | Laguna Xs.2 none | Poolside | 1 | 8.3 | $0.004 | 0/1 | 1.96s |
| #120 | Mercury 2 medium | Inception | 1 | 8.2 | $0.094 | 2/3 | 2.04s |
| #151 | Qwen3.5 Plus 2026-02-15 none | Qwen | 3 | 4.3 | $0.073 | 0/3 | 2.05s |
| #102 | Qwen3.7 Plus none | Qwen | 2 | 5.5 | $0.106 | 1/3 | 2.15s |