Coding: Wrong answer
Coding
Wrong answer
See which AI models are most likely to hit Wrong answer on Coding, so you can spot weak points faster. Sort by: Total Cost ↓.
Failure Reasons
197/197
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #98 | Claude Sonnet 4.6 none | Anthropic | 1 | 5.5 | $0.661 | 1/3 | 5.19s |
| #38 | Muse Spark 1.2 low | Meta | 1 | 8.4 | $0.655 | 2/3 | 10.1s |
| #147 | Gemini 3.1 Flash Lite Preview low | 2 | 5.5 | $0.646 | 1/3 | 1.39s | |
| #46 | Gemini 2.5 Flash medium | 1 | 7.8 | $0.644 | 2/3 | 41.0s | |
| #252 | Trinity Large Thinking high | Arcee AI | 1 | 3.7 | $0.624 | 0/3 | 245.0s |
| #149 | Gemini 3.1 Flash Lite low | 2 | 5.5 | $0.621 | 1/3 | 1.53s | |
| #59 | GPT-5.2 Chat none | OpenAI | 1 | 8.8 | $0.594 | 2/3 | 9.82s |
| #168 | Claude Sonnet 5 none | Anthropic | 3 | 4.6 | $0.548 | 0/3 | 3.67s |
| #119 | GPT-5.5 none | OpenAI | 2 | 5.5 | $0.544 | 1/3 | 1.35s |
| #25 | Gemini 3.5 Flash Lite high | 1 | 8.4 | $0.540 | 2/3 | 16.6s | |
| #107 | Muse Glimmer 30B high | Meta | 1 | 8.8 | $0.535 | 2/3 | 96.0s |
| #85 | GPT 5.3 Chat none | OpenAI | 2 | 5.6 | $0.533 | 1/3 | 10.5s |
| #66 | GPT-5.6 Terra medium | OpenAI | 2 | 6.1 | $0.523 | 1/3 | 7.19s |
| #106 | KAT-Coder-Pro V2.5 high | Kwaipilot | 2 | 6.4 | $0.506 | 1/3 | 22.0s |
| #60 | Step 3.7 Flash medium | Stepfun | 1 | 8.8 | $0.495 | 2/3 | 27.4s |