Coding: Wrong answer
Coding
Wrong answer
See which AI models are most likely to hit Wrong answer on Coding, so you can spot weak points faster. Sort by: Total Cost ↑.
Failure Reasons
265/265
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #123 | Muse Glimmer 30B medium | Meta | 1 | 0.8 | $0.288 | 2/3 | 33.7s |
| #272 | Mistral Large 4 none | Mistral | 3 | 0.5 | $0.290 | 0/3 | 85.0s |
| #247 | Inkling none | Thinkingmachines | 3 | 0.4 | $0.292 | 0/3 | 1.01s |
| #181 | Inkling low | Thinkingmachines | 3 | 0.5 | $0.293 | 0/3 | 8.71s |
| #134 | DeepSeek V4 Flash 0731 low | DeepSeek | 1 | 0.7 | $0.306 | 1/3 | 163.3s |
| #213 | Qwen3.5-122B-A10B none | Qwen | 3 | 0.4 | $0.308 | 0/3 | 2.77s |
| #152 | Gemini 3.8 Flash low | 2 | 0.5 | $0.323 | 1/3 | 4.31s | |
| #307 | Mimo V2 PRO medium | Xiaomi | 1 | 0.6 | $0.333 | 1/3 | 94.2s |
| #44 | Gemini 3.6 Flash low | 1 | 0.8 | $0.363 | 2/3 | 6.95s | |
| #265 | GPT-5.6 Terra none | OpenAI | 2 | 0.5 | $0.377 | 1/3 | 1.00s |
| #266 | DeepSeek V4.1 Flash none | DeepSeek | 1 | 0.6 | $0.391 | 1/3 | 83.7s |
| #86 | Qwen3.7 Plus medium | Qwen | 2 | 0.6 | $0.415 | 1/3 | 108.6s |
| #121 | Qwen3.5 Plus 2026-04-20 medium | Qwen | 2 | 0.6 | $0.435 | 1/3 | 125.3s |
| #101 | GPT-5.6 Terra low | OpenAI | 2 | 0.7 | $0.435 | 1/3 | 9.56s |
| #359 | MiniMax M2.5 medium | Minimax | 1 | 0.3 | $0.440 | 0/3 | 188.6s |