Coding: Wrong answer
Coding
Wrong answer
See which AI models are most likely to hit Wrong answer on Coding, so you can spot weak points faster. Sort by: Failure Count ↑.
Failure Reasons
265/265
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #15 | Gemini 3 Flash Preview medium | 1 | 0.9 | $0.876 | 2/3 | 84.4s | |
| #17 | Gemini 3.7 Flash medium | 1 | 0.8 | $0.278 | 2/3 | 8.86s | |
| #18 | GPT-6 Sol medium | OpenAI | 1 | 0.8 | $0.703 | 2/3 | 11.8s |
| #25 | Gemini 3.7 Flash low | 1 | 0.8 | $0.183 | 2/3 | 6.20s | |
| #29 | Claude Opus 5.5 medium | Anthropic | 1 | 0.8 | $1.804 | 2/3 | 13.5s |
| #30 | GPT-5.5 medium | OpenAI | 1 | 0.9 | $4.809 | 2/3 | 59.8s |
| #39 | Gemini 3.5 Flash low | 1 | 0.8 | $0.752 | 2/3 | 6.71s | |
| #40 | Qwen3.8 Max (0902) medium | Qwen | 1 | 0.8 | $1.096 | 2/3 | 45.7s |
| #42 | Gemini 3.5 Flash Lite high | 1 | 0.8 | $0.624 | 2/3 | 16.6s | |
| #43 | Claude Opus 5 low | Anthropic | 1 | 0.8 | $2.350 | 2/3 | 6.70s |
| #44 | Gemini 3.6 Flash low | 1 | 0.8 | $0.363 | 2/3 | 6.95s | |
| #50 | Qwen3.8 MAX low | Qwen | 1 | 0.8 | $1.089 | 2/3 | 28.7s |
| #51 | GPT-5.4 medium | OpenAI | 1 | 0.9 | $2.213 | 2/3 | 44.4s |
| #54 | Muse Spark 1.2 low | Meta | 1 | 0.8 | $0.881 | 2/3 | 10.1s |
| #68 | Claude Sonnet 5 medium | Anthropic | 1 | 0.9 | $1.438 | 2/3 | 17.3s |