Coding: Wrong answer
Coding
Wrong answer
See which AI models are most likely to hit Wrong answer on Coding, so you can spot weak points faster. Sort by: Tests Correct ↓.
Failure Reasons
197/197
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #100 | KAT-Coder-Pro V2.5 low | Kwaipilot | 1 | 7.8 | $0.400 | 2/3 | 24.9s |
| #107 | Muse Glimmer 30B high | Meta | 1 | 8.8 | $0.535 | 2/3 | 96.0s |
| #110 | Muse Glimmer 30B medium | Meta | 1 | 8.4 | $0.280 | 2/3 | 33.7s |
| #112 | Muse Glimmer 30B low | Meta | 1 | 8.1 | $0.187 | 2/3 | 16.5s |
| #113 | Step 3.7 Flash low | Stepfun | 1 | 8.2 | $0.390 | 2/3 | 9.46s |
| #120 | Mercury 2 medium | Inception | 1 | 8.2 | $0.094 | 2/3 | 2.04s |
| #124 | KAT-Coder-Pro V2.5 medium | Kwaipilot | 1 | 7.8 | $0.478 | 2/3 | 33.1s |
| #127 | Gemini 3.5 Flash none | 1 | 8.8 | $1.093 | 2/3 | 34.7s | |
| #130 | Seed-2.0-Code medium | Bytedance Seed | 1 | 8.9 | $1.153 | 2/3 | 89.9s |
| #148 | Inkling Small medium | Thinkingmachines | 1 | 7.8 | $0.113 | 2/3 | 10.5s |
| #53 | DeepSeek V4 Flash 0731 low | DeepSeek | 1 | 7.3 | $0.072 | 1/3 | 163.3s |
| #62 | Qwen3.7 Plus medium | Qwen | 1 | 6.1 | $0.277 | 1/3 | 108.6s |
| #63 | Qwen3.6 Plus medium | Qwen | 1 | 6.1 | $0.418 | 1/3 | 153.1s |
| #66 | GPT-5.6 Terra medium | OpenAI | 2 | 6.1 | $0.523 | 1/3 | 7.19s |
| #67 | Claude Sonnet 4.6 medium | Anthropic | 1 | 5.7 | $2.126 | 1/3 | 33.3s |