Coding: Wrong answer
Coding
Wrong answer
See which AI models are most likely to hit Wrong answer on Coding, so you can spot weak points faster. Sort by: Response Time (avg) ↑.
Failure Reasons
265/265
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #169 | Qwen3.5-122B-A10B medium | Qwen | 1 | 0.6 | $1.152 | 1/3 | 114.5s |
| #114 | Grok 4.6 medium | X AI | 1 | 0.8 | $2.270 | 2/3 | 120.0s |
| #121 | Qwen3.5 Plus 2026-04-20 medium | Qwen | 2 | 0.6 | $0.435 | 1/3 | 125.3s |
| #165 | Qwen3.6 Max Preview medium | Qwen | 1 | 0.9 | $1.132 | 2/3 | 146.5s |
| #75 | Inkling high | Thinkingmachines | 1 | 0.9 | $1.238 | 2/3 | 148.4s |
| #147 | Qwen3.6 Plus medium | Qwen | 1 | 0.6 | $0.554 | 1/3 | 153.1s |
| #111 | Grok 4.5 medium | X AI | 1 | 0.8 | $2.996 | 2/3 | 155.7s |
| #90 | Seed-2.0-Lite medium | Bytedance Seed | 1 | 0.8 | $0.271 | 2/3 | 156.7s |
| #315 | Laguna S 2.1 medium | Poolside | 1 | 0.5 | $0.092 | 1/3 | 159.0s |
| #102 | Qwen3.5-27B medium | Qwen | 2 | 0.6 | $1.135 | 1/3 | 160.7s |
| #134 | DeepSeek V4 Flash 0731 low | DeepSeek | 1 | 0.7 | $0.306 | 1/3 | 163.3s |
| #343 | Laguna S 2.1 low | Poolside | 3 | 0.4 | $0.108 | 0/3 | 167.5s |
| #305 | Nemotron 3.5 Lightning high | NVIDIA | 2 | 0.4 | $0.168 | 0/3 | 168.4s |
| #150 | Qwen3.5 Plus 2026-02-15 medium | Qwen | 2 | 0.7 | $0.567 | 1/3 | 180.7s |
| #330 | Mimo V2 Omni medium | Xiaomi | 1 | 0.3 | $0.683 | 0/3 | 183.9s |