Coding: Wrong answer
Coding
Wrong answer
See which AI models are most likely to hit Wrong answer on Coding, so you can spot weak points faster. Sort by: Tests Correct ↑.
Failure Reasons
265/265
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #355 | Granite 4.2 8B none | IBM Granite | 2 | 0.5 | $0.037 | 1/3 | 105.6s |
| #395 | Decider V1.1 27B default | Perplexity | 1 | 0.5 | $0.002 | 1/2 | 305ms |
| #397 | Kev 4B default | Jaredpalmer | 1 | 0.5 | $0.002 | 1/2 | 771ms |
| #15 | Gemini 3 Flash Preview medium | 1 | 0.9 | $0.876 | 2/3 | 84.4s | |
| #17 | Gemini 3.7 Flash medium | 1 | 0.8 | $0.278 | 2/3 | 8.86s | |
| #18 | GPT-6 Sol medium | OpenAI | 1 | 0.8 | $0.703 | 2/3 | 11.8s |
| #25 | Gemini 3.7 Flash low | 1 | 0.8 | $0.183 | 2/3 | 6.20s | |
| #29 | Claude Opus 5.5 medium | Anthropic | 1 | 0.8 | $1.804 | 2/3 | 13.5s |
| #30 | GPT-5.5 medium | OpenAI | 1 | 0.9 | $4.809 | 2/3 | 59.8s |
| #39 | Gemini 3.5 Flash low | 1 | 0.8 | $0.752 | 2/3 | 6.71s | |
| #40 | Qwen3.8 Max (0902) medium | Qwen | 1 | 0.8 | $1.096 | 2/3 | 45.7s |
| #42 | Gemini 3.5 Flash Lite high | 1 | 0.8 | $0.624 | 2/3 | 16.6s | |
| #43 | Claude Opus 5 low | Anthropic | 1 | 0.8 | $2.350 | 2/3 | 6.70s |
| #44 | Gemini 3.6 Flash low | 1 | 0.8 | $0.363 | 2/3 | 6.95s | |
| #50 | Qwen3.8 MAX low | Qwen | 1 | 0.8 | $1.089 | 2/3 | 28.7s |