Coding: Wrong answer
Coding
Wrong answer
See which AI models are most likely to hit Wrong answer on Coding, so you can spot weak points faster. Sort by: Tests Correct ↓.
Failure Reasons
265/265
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #353 | KAT Coder AIR V2.5 default | Kwaipilot | 1 | 0.3 | $0.070 | 0/3 | 14.3s |
| #354 | Trinity Large Preview default | Arcee AI | 1 | 0.4 | $0.008 | 0/3 | 14.3s |
| #356 | Cobuddy medium | Baidu | 1 | 0.4 | $0.000 | 0/3 | 79.2s |
| #357 | Mercury 2 none | Inception | 3 | 0.3 | $0.033 | 0/3 | 1.03s |
| #359 | MiniMax M2.5 medium | Minimax | 1 | 0.3 | $0.440 | 0/3 | 188.6s |
| #361 | gpt-oss-120b none | OpenAI | 1 | 0.1 | $0.016 | 0/1 | 9.57s |
| #362 | GLM 5 Turbo none | Z.ai | 3 | 0.4 | $0.047 | 0/3 | 2.41s |
| #363 | Mercury 2.5 none | Inception | 2 | 0.4 | $0.026 | 0/3 | 12.5s |
| #370 | Ling 3.0 Tiny default | Inclusionai | 3 | 0.4 | $0.000 | 0/3 | 1.19s |
| #371 | Granite 4.1 8b default | IBM Granite | 1 | 0.4 | $0.007 | 0/3 | 775ms |
| #372 | Nemotron 3.5 Lightning none | NVIDIA | 3 | 0.3 | $0.009 | 0/3 | 1.55s |
| #376 | Grok 4.20 Beta default | X AI | 1 | 0.2 | $0.087 | 0/1 | 1.14s |
| #377 | Laguna M.1 default | Poolside | 1 | 0.2 | $0.009 | 0/1 | 2.93s |
| #378 | Elephant Alpha default | Openrouter | 1 | 0.4 | $0.000 | 0/3 | 1.39s |
| #379 | Elephant Alpha medium | Openrouter | 1 | 0.4 | $0.000 | 0/3 | 1.30s |