Coding: Wrong answer
Coding
Wrong answer
See which AI models are most likely to hit Wrong answer on Coding, so you can spot weak points faster. Sort by: Total Cost ↓.
Failure Reasons
265/265
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #119 | Muse Glimmer 30B high | Meta | 1 | 0.9 | $0.506 | 2/3 | 96.0s |
| #112 | GLM 5.3 high | Z.ai | 2 | 0.7 | $0.495 | 1/3 | 18.9s |
| #282 | Kimi K2.6 none | Moonshot AI | 1 | 0.6 | $0.486 | 1/3 | 82.6s |
| #89 | GPT-5.6 Terra medium | OpenAI | 2 | 0.6 | $0.483 | 1/3 | 7.19s |
| #59 | GPT-6 Sol low | OpenAI | 2 | 0.6 | $0.477 | 1/3 | 8.74s |
| #287 | GLM 5V Turbo medium | Z.ai | 2 | 0.6 | $0.457 | 1/3 | 63.4s |
| #209 | GLM 5.1 none | Z.ai | 3 | 0.4 | $0.451 | 0/3 | 4.96s |
| #106 | Qwen3.7 Max none | Qwen | 2 | 0.5 | $0.451 | 1/3 | 1.35s |
| #157 | Step 3.7 Flash low | Stepfun | 1 | 0.8 | $0.449 | 2/3 | 9.46s |
| #148 | Gemini 3.5 Flash Lite medium | 1 | 0.8 | $0.440 | 2/3 | 9.96s | |
| #359 | MiniMax M2.5 medium | Minimax | 1 | 0.3 | $0.440 | 0/3 | 188.6s |
| #101 | GPT-5.6 Terra low | OpenAI | 2 | 0.7 | $0.435 | 1/3 | 9.56s |
| #121 | Qwen3.5 Plus 2026-04-20 medium | Qwen | 2 | 0.6 | $0.435 | 1/3 | 125.3s |
| #86 | Qwen3.7 Plus medium | Qwen | 2 | 0.6 | $0.415 | 1/3 | 108.6s |
| #266 | DeepSeek V4.1 Flash none | DeepSeek | 1 | 0.6 | $0.391 | 1/3 | 83.7s |