Coding: Wrong answer
Coding
Wrong answer
See which AI models are most likely to hit Wrong answer on Coding, so you can spot weak points faster. Sort by: Tests Correct ↑.
Failure Reasons
197/197
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #28 | Gemini 3.6 Flash low | 1 | 7.8 | $0.251 | 2/3 | 6.95s | |
| #29 | Claude Opus 4.7 medium | Anthropic | 1 | 7.6 | $1.476 | 2/3 | 13.0s |
| #34 | Qwen3.6 Max Preview medium | Qwen | 1 | 8.8 | $1.132 | 2/3 | 146.5s |
| #35 | Qwen3.8 Max low | Qwen | 1 | 8.4 | $0.702 | 2/3 | 28.7s |
| #36 | GPT-5.4 medium | OpenAI | 1 | 8.8 | $1.560 | 2/3 | 44.4s |
| #37 | Grok 4.5 medium | X AI | 1 | 7.6 | $2.042 | 2/3 | 155.7s |
| #38 | Muse Spark 1.2 low | Meta | 1 | 8.4 | $0.655 | 2/3 | 10.1s |
| #39 | Grok 4.6 medium | X AI | 1 | 8.2 | $1.713 | 2/3 | 120.0s |
| #46 | Gemini 2.5 Flash medium | 1 | 7.8 | $0.644 | 2/3 | 41.0s | |
| #47 | Claude Sonnet 5 medium | Anthropic | 1 | 9.0 | $0.922 | 2/3 | 17.3s |
| #51 | Inkling high | Thinkingmachines | 1 | 8.5 | $1.041 | 2/3 | 148.4s |
| #56 | Inkling medium | Thinkingmachines | 1 | 8.4 | $0.377 | 2/3 | 25.2s |
| #57 | GPT-5.6 Terra high | OpenAI | 1 | 7.6 | $0.836 | 2/3 | 9.14s |
| #59 | GPT-5.2 Chat none | OpenAI | 1 | 8.8 | $0.594 | 2/3 | 9.82s |
| #60 | Step 3.7 Flash medium | Stepfun | 1 | 8.8 | $0.495 | 2/3 | 27.4s |