Coding: Wrong answer
Coding
Wrong answer
See which AI models are most likely to hit Wrong answer on Coding, so you can spot weak points faster. Sort by: Tests Correct ↓.
Failure Reasons
265/265
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #172 | Muse Glimmer 30B low | Meta | 1 | 0.8 | $0.219 | 2/3 | 16.5s |
| #182 | Mercury 2.5 Preview medium | Inception | 1 | 0.8 | $0.039 | 2/3 | 3.86s |
| #201 | Mercury 2 medium | Inception | 1 | 0.8 | $0.121 | 2/3 | 2.04s |
| #203 | KAT-Coder-Pro V2.5 low | Kwaipilot | 1 | 0.8 | $0.568 | 2/3 | 24.9s |
| #239 | KAT-Coder-Pro V2.5 medium | Kwaipilot | 1 | 0.8 | $0.669 | 2/3 | 33.1s |
| #244 | Gemini 3.5 Flash none | 1 | 0.9 | $1.752 | 2/3 | 34.7s | |
| #255 | Inkling Small medium | Thinkingmachines | 1 | 0.8 | $0.113 | 2/3 | 10.5s |
| #395 | Decider V1.1 27B default | Perplexity | 1 | 0.5 | $0.002 | 1/2 | 305ms |
| #397 | Kev 4B default | Jaredpalmer | 1 | 0.5 | $0.002 | 1/2 | 771ms |
| #59 | GPT-6 Sol low | OpenAI | 2 | 0.6 | $0.477 | 1/3 | 8.74s |
| #77 | DeepSeek V4 Flash 0731 high | DeepSeek | 1 | 0.6 | $0.576 | 1/3 | 252.7s |
| #78 | GLM 5.2 high | Z.ai | 2 | 0.6 | $4.632 | 1/3 | 73.0s |
| #80 | Claude Haiku 5.5 high | Anthropic | 2 | 0.6 | $0.088 | 1/3 | 9.54s |
| #83 | GPT-6 Luna medium | OpenAI | 2 | 0.7 | $0.047 | 1/3 | 23.6s |
| #86 | Qwen3.7 Plus medium | Qwen | 2 | 0.6 | $0.415 | 1/3 | 108.6s |