Coding: Wrong answer
Coding
Wrong answer
See which AI models are most likely to hit Wrong answer on Coding, so you can spot weak points faster. Sort by: Response Time (avg) ↑.
Failure Reasons
197/197
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #57 | GPT-5.6 Terra high | OpenAI | 1 | 7.6 | $0.836 | 2/3 | 9.14s |
| #113 | Step 3.7 Flash low | Stepfun | 1 | 8.2 | $0.390 | 2/3 | 9.46s |
| #83 | GPT-5.6 Terra low | OpenAI | 2 | 6.6 | $0.420 | 1/3 | 9.56s |
| #285 | gpt-oss-120b none | OpenAI | 1 | 1.5 | $0.010 | 0/1 | 9.57s |
| #59 | GPT-5.2 Chat none | OpenAI | 1 | 8.8 | $0.594 | 2/3 | 9.82s |
| #64 | Gemini 3.5 Flash Lite medium | 1 | 7.9 | $0.272 | 2/3 | 9.96s | |
| #38 | Muse Spark 1.2 low | Meta | 1 | 8.4 | $0.655 | 2/3 | 10.1s |
| #93 | GPT-5.6 Luna medium | OpenAI | 2 | 5.4 | $0.072 | 1/3 | 10.4s |
| #148 | Inkling Small medium | Thinkingmachines | 1 | 7.8 | $0.113 | 2/3 | 10.5s |
| #85 | GPT 5.3 Chat none | OpenAI | 2 | 5.6 | $0.533 | 1/3 | 10.5s |
| #229 | Ling-2.6-1T none | Inclusionai | 1 | 3.8 | $0.016 | 0/3 | 10.6s |
| #164 | MiMo-V2-Flash medium | Xiaomi | 1 | 6.0 | $0.043 | 1/3 | 10.7s |
| #220 | KAT-Coder-Air V2.5 low | Kwaipilot | 1 | 3.5 | $0.046 | 0/3 | 11.1s |
| #178 | Gemma 4 31B none | 2 | 5.5 | $0.016 | 1/3 | 11.2s | |
| #29 | Claude Opus 4.7 medium | Anthropic | 1 | 7.6 | $1.476 | 2/3 | 13.0s |