Coding: Wrong answer
Coding
Wrong answer
See which AI models are most likely to hit Wrong answer on Coding, so you can spot weak points faster. Sort by: Total Cost ↑.
Failure Reasons
197/197
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #111 | Qwen3.5-122B-A10B medium | Qwen | 1 | 6.0 | $1.047 | 1/3 | 114.5s |
| #127 | Gemini 3.5 Flash none | 1 | 8.8 | $1.093 | 2/3 | 34.7s | |
| #27 | Claude Opus 5 low | Anthropic | 1 | 7.8 | $1.121 | 2/3 | 6.70s |
| #89 | Grok Build 0.1 medium | X AI | 1 | 5.7 | $1.130 | 1/3 | 108.5s |
| #34 | Qwen3.6 Max Preview medium | Qwen | 1 | 8.8 | $1.132 | 2/3 | 146.5s |
| #130 | Seed-2.0-Code medium | Bytedance Seed | 1 | 8.9 | $1.153 | 2/3 | 89.9s |
| #104 | Claude Opus 4.8 none | Anthropic | 1 | 5.5 | $1.166 | 1/3 | 3.29s |
| #129 | Step 3.7 Flash high | Stepfun | 1 | 4.0 | $1.229 | 0/3 | 206.2s |
| #12 | Gemini 3.1 Pro Preview medium | 1 | 7.9 | $1.352 | 2/3 | 40.2s | |
| #29 | Claude Opus 4.7 medium | Anthropic | 1 | 7.6 | $1.476 | 2/3 | 13.0s |
| #81 | Claude Opus 5 none | Anthropic | 1 | 5.9 | $1.550 | 1/3 | 5.54s |
| #36 | GPT-5.4 medium | OpenAI | 1 | 8.8 | $1.560 | 2/3 | 44.4s |
| #39 | Grok 4.6 medium | X AI | 1 | 8.2 | $1.713 | 2/3 | 120.0s |
| #37 | Grok 4.5 medium | X AI | 1 | 7.6 | $2.042 | 2/3 | 155.7s |
| #70 | Claude Opus 4.8 low | Anthropic | 1 | 6.6 | $2.089 | 1/3 | 7.58s |