Coding: Wrong answer
Coding
Wrong answer
See which AI models are most likely to hit Wrong answer on Coding, so you can spot weak points faster. Sort by: Tests Correct ↓.
Failure Reasons
197/197
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #70 | Claude Opus 4.8 low | Anthropic | 1 | 6.6 | $2.089 | 1/3 | 7.58s |
| #73 | Seed-2.0-Code low | Bytedance Seed | 1 | 7.0 | $0.767 | 1/3 | 109.7s |
| #78 | GPT-5.6 Luna high | OpenAI | 2 | 5.5 | $0.179 | 1/3 | 15.6s |
| #79 | Solar Pro 4 xhigh | Upstage | 1 | 5.8 | $0.050 | 1/3 | 292.2s |
| #81 | Claude Opus 5 none | Anthropic | 1 | 5.9 | $1.550 | 1/3 | 5.54s |
| #82 | GPT-5.4 Nano medium | OpenAI | 2 | 6.1 | $0.142 | 1/3 | 19.1s |
| #83 | GPT-5.6 Terra low | OpenAI | 2 | 6.6 | $0.420 | 1/3 | 9.56s |
| #85 | GPT 5.3 Chat none | OpenAI | 2 | 5.6 | $0.533 | 1/3 | 10.5s |
| #86 | Qwen3.5 Plus 2026-02-15 medium | Qwen | 1 | 6.6 | $0.459 | 1/3 | 180.7s |
| #87 | Qwen3.5-27B medium | Qwen | 2 | 6.2 | $0.982 | 1/3 | 160.7s |
| #89 | Grok Build 0.1 medium | X AI | 1 | 5.7 | $1.130 | 1/3 | 108.5s |
| #90 | Gemini 3.1 Flash Lite Preview medium | 2 | 5.5 | $0.117 | 1/3 | 4.09s | |
| #91 | Qwen3.7 Max none | Qwen | 2 | 5.5 | $0.197 | 1/3 | 1.35s |
| #93 | GPT-5.6 Luna medium | OpenAI | 2 | 5.4 | $0.072 | 1/3 | 10.4s |
| #96 | Grok 4.6 low | X AI | 2 | 5.5 | $0.449 | 1/3 | 21.7s |