Coding: Wrong answer
Coding
Wrong answer
See which AI models are most likely to hit Wrong answer on Coding, so you can spot weak points faster. Sort by: Total Cost ↓.
Failure Reasons
197/197
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #127 | Gemini 3.5 Flash none | 1 | 8.8 | $1.093 | 2/3 | 34.7s | |
| #111 | Qwen3.5-122B-A10B medium | Qwen | 1 | 6.0 | $1.047 | 1/3 | 114.5s |
| #51 | Inkling high | Thinkingmachines | 1 | 8.5 | $1.041 | 2/3 | 148.4s |
| #87 | Qwen3.5-27B medium | Qwen | 2 | 6.2 | $0.982 | 1/3 | 160.7s |
| #47 | Claude Sonnet 5 medium | Anthropic | 1 | 9.0 | $0.922 | 2/3 | 17.3s |
| #57 | GPT-5.6 Terra high | OpenAI | 1 | 7.6 | $0.836 | 2/3 | 9.14s |
| #121 | Grok 4.20 medium | X AI | 2 | 6.3 | $0.805 | 1/3 | 109.9s |
| #88 | GPT-5.4 Mini medium | OpenAI | 1 | 8.4 | $0.786 | 2/3 | 57.9s |
| #80 | Nemotron 3 Ultra medium | NVIDIA | 1 | 8.4 | $0.780 | 2/3 | 26.5s |
| #73 | Seed-2.0-Code low | Bytedance Seed | 1 | 7.0 | $0.767 | 1/3 | 109.7s |
| #5 | Gemini 3 Flash Preview medium | 1 | 8.6 | $0.763 | 2/3 | 84.4s | |
| #128 | Qwen3.6 Flash medium | Qwen | 3 | 5.0 | $0.741 | 0/3 | 42.9s |
| #115 | Grok 4.3 medium | X AI | 1 | 5.9 | $0.741 | 1/3 | 41.2s |
| #35 | Qwen3.8 Max low | Qwen | 1 | 8.4 | $0.702 | 2/3 | 28.7s |
| #191 | Mimo V2 Omni medium | Xiaomi | 1 | 3.3 | $0.683 | 0/3 | 183.9s |