Coding: Wrong answer
Coding
Wrong answer
See which AI models are most likely to hit Wrong answer on Coding, so you can spot weak points faster. Sort by: Total Cost ↓.
Failure Reasons
265/265
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #252 | Claude Sonnet 4.6 none | Anthropic | 1 | 0.5 | $0.661 | 1/3 | 5.19s |
| #200 | LongCat 2.0 low | Meituan | 1 | 0.7 | $0.630 | 1/3 | 479.3s |
| #42 | Gemini 3.5 Flash Lite high | 1 | 0.8 | $0.624 | 2/3 | 16.6s | |
| #103 | GLM 5.3 FlashX max | Z.ai | 1 | 0.8 | $0.623 | 2/3 | 24.6s |
| #164 | GPT-5.2 Chat default | OpenAI | 1 | 0.9 | $0.594 | 2/3 | 9.82s |
| #77 | DeepSeek V4 Flash 0731 high | DeepSeek | 1 | 0.6 | $0.576 | 1/3 | 252.7s |
| #113 | Step 3.7 Flash medium | Stepfun | 1 | 0.9 | $0.571 | 2/3 | 27.4s |
| #203 | KAT-Coder-Pro V2.5 low | Kwaipilot | 1 | 0.8 | $0.568 | 2/3 | 24.9s |
| #150 | Qwen3.5 Plus 2026-02-15 medium | Qwen | 2 | 0.7 | $0.567 | 1/3 | 180.7s |
| #147 | Qwen3.6 Plus medium | Qwen | 1 | 0.6 | $0.554 | 1/3 | 153.1s |
| #183 | GPT-6 Sol none | OpenAI | 2 | 0.5 | $0.551 | 1/3 | 12.2s |
| #193 | GPT 5.3 Chat default | OpenAI | 2 | 0.6 | $0.533 | 1/3 | 10.5s |
| #140 | Inkling medium | Thinkingmachines | 1 | 0.8 | $0.527 | 2/3 | 25.2s |
| #219 | Gemini 3.5 Flash minimal | 1 | 0.6 | $0.508 | 1/3 | 2.75s | |
| #210 | KAT-Coder-Pro V2.5 high | Kwaipilot | 2 | 0.6 | $0.506 | 1/3 | 22.0s |