Coding: Wrong answer
Coding
Wrong answer
See which AI models are most likely to hit Wrong answer on Coding, so you can spot weak points faster. Sort by: Tests Correct ↓.
Failure Reasons
197/197
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #97 | Gemini 3 Flash Preview low | 2 | 5.8 | $0.185 | 1/3 | 6.00s | |
| #98 | Claude Sonnet 4.6 none | Anthropic | 1 | 5.5 | $0.661 | 1/3 | 5.19s |
| #99 | GLM 5.3 high | Z.ai | 2 | 6.6 | $0.403 | 1/3 | 18.9s |
| #101 | Gemini 3.1 Flash Lite medium | 2 | 5.5 | $0.120 | 1/3 | 3.81s | |
| #102 | Qwen3.7 Plus none | Qwen | 2 | 5.5 | $0.106 | 1/3 | 2.15s |
| #104 | Claude Opus 4.8 none | Anthropic | 1 | 5.5 | $1.166 | 1/3 | 3.29s |
| #106 | KAT-Coder-Pro V2.5 high | Kwaipilot | 2 | 6.4 | $0.506 | 1/3 | 22.0s |
| #108 | Qwen3.5 Plus 2026-04-20 medium | Qwen | 2 | 6.2 | $0.323 | 1/3 | 125.3s |
| #109 | Qwen3.7 Flash low | Qwen | 2 | 6.7 | $0.043 | 1/3 | 42.4s |
| #111 | Qwen3.5-122B-A10B medium | Qwen | 1 | 6.0 | $1.047 | 1/3 | 114.5s |
| #114 | Solar Pro 4 high | Upstage | 1 | 5.7 | $0.046 | 1/3 | 244.7s |
| #115 | Grok 4.3 medium | X AI | 1 | 5.9 | $0.741 | 1/3 | 41.2s |
| #116 | GPT-5.6 Sol none | OpenAI | 2 | 5.5 | $0.262 | 1/3 | 1.39s |
| #117 | DeepSeek V3.2 medium | DeepSeek | 1 | 6.0 | $0.078 | 1/3 | 248.7s |
| #119 | GPT-5.5 none | OpenAI | 2 | 5.5 | $0.544 | 1/3 | 1.35s |