Coding: Wrong answer
Coding
Wrong answer
See which AI models are most likely to hit Wrong answer on Coding, so you can spot weak points faster. Sort by: Response Time (avg) ↑.
Failure Reasons
197/197
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #213 | Nemotron 3.5 Lightning high | NVIDIA | 2 | 4.4 | $0.134 | 0/3 | 168.4s |
| #86 | Qwen3.5 Plus 2026-02-15 medium | Qwen | 1 | 6.6 | $0.459 | 1/3 | 180.7s |
| #191 | Mimo V2 Omni medium | Xiaomi | 1 | 3.3 | $0.683 | 0/3 | 183.9s |
| #263 | MiniMax M2.5 medium | Minimax | 1 | 3.4 | $0.273 | 0/3 | 188.6s |
| #129 | Step 3.7 Flash high | Stepfun | 1 | 4.0 | $1.229 | 0/3 | 206.2s |
| #122 | Seed-2.0-Mini medium | Bytedance Seed | 1 | 5.5 | $0.116 | 1/3 | 220.5s |
| #250 | Nemotron 3.5 Lightning low | NVIDIA | 3 | 4.0 | $0.140 | 0/3 | 224.4s |
| #114 | Solar Pro 4 high | Upstage | 1 | 5.7 | $0.046 | 1/3 | 244.7s |
| #252 | Trinity Large Thinking high | Arcee AI | 1 | 3.7 | $0.624 | 0/3 | 245.0s |
| #117 | DeepSeek V3.2 medium | DeepSeek | 1 | 6.0 | $0.078 | 1/3 | 248.7s |
| #131 | Solar Pro 4 low | Upstage | 1 | 5.5 | $0.044 | 1/3 | 259.6s |
| #234 | Nemotron 3.5 Lightning medium | NVIDIA | 3 | 4.4 | $0.156 | 0/3 | 285.5s |
| #79 | Solar Pro 4 xhigh | Upstage | 1 | 5.8 | $0.050 | 1/3 | 292.2s |
| #190 | Dots 3 Note Preview medium | Dots Studio | 1 | 4.2 | $0.000 | 0/3 | 309.1s |
| #132 | Solar Pro 4 medium | Upstage | 1 | 5.5 | $0.047 | 1/3 | 310.4s |