Coding: Wrong answer
Coding
Wrong answer
See which AI models are most likely to hit Wrong answer on Coding, so you can spot weak points faster. Sort by: Tests Correct ↑.
Failure Reasons
265/265
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #111 | Grok 4.5 medium | X AI | 1 | 0.8 | $2.996 | 2/3 | 155.7s |
| #113 | Step 3.7 Flash medium | Stepfun | 1 | 0.9 | $0.571 | 2/3 | 27.4s |
| #114 | Grok 4.6 medium | X AI | 1 | 0.8 | $2.270 | 2/3 | 120.0s |
| #118 | GPT-6 Luna high | OpenAI | 1 | 0.8 | $0.074 | 2/3 | 24.7s |
| #119 | Muse Glimmer 30B high | Meta | 1 | 0.9 | $0.506 | 2/3 | 96.0s |
| #123 | Muse Glimmer 30B medium | Meta | 1 | 0.8 | $0.288 | 2/3 | 33.7s |
| #135 | Seed-2.0-Code medium | Bytedance Seed | 1 | 0.9 | $1.275 | 2/3 | 89.9s |
| #136 | GLM 5.3 FlashX high | Z.ai | 1 | 0.8 | $0.210 | 2/3 | 8.06s |
| #137 | Grok 4.7 low | X AI | 1 | 0.8 | $1.933 | 2/3 | 189.1s |
| #140 | Inkling medium | Thinkingmachines | 1 | 0.8 | $0.527 | 2/3 | 25.2s |
| #142 | GLM 5.3 Flash high | Z.ai | 1 | 0.8 | $0.056 | 2/3 | 19.6s |
| #145 | Gemini 2.5 Flash medium | 1 | 0.8 | $0.680 | 2/3 | 41.0s | |
| #148 | Gemini 3.5 Flash Lite medium | 1 | 0.8 | $0.440 | 2/3 | 9.96s | |
| #154 | Qwen3.7 Flash high | Qwen | 1 | 0.8 | $0.063 | 2/3 | 58.8s |
| #157 | Step 3.7 Flash low | Stepfun | 1 | 0.8 | $0.449 | 2/3 | 9.46s |