Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↓.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #317 | Nemotron 3.5 Super VL none | NVIDIA | 11 | 0.6 | $0.040 | 8/23 | 47.0s |
| #318 | Nemotron 3 Super medium | NVIDIA | 6 | 0.6 | $0.081 | 8/23 | 56.4s |
| #321 | Gemini 2.5 Flash none | 13 | 0.5 | $0.017 | 8/23 | 6.00s | |
| #328 | North Mini Code medium | Cohere | 10 | 0.5 | $0.000 | 8/23 | 140.4s |
| #332 | Ember-1 none | Fireworks | 10 | 0.5 | $0.786 | 8/23 | 22.6s |
| #349 | KAT Coder AIR V2.5 medium | Kwaipilot | 10 | 0.5 | $0.048 | 8/23 | 8.32s |
| #383 | Mimo V2 PRO default | Xiaomi | 11 | 0.5 | $0.045 | 7/21 | 2.27s |
| #384 | Owl Alpha default | Openrouter | 10 | 0.5 | $0.000 | 7/21 | 9.88s |
| #414 | Grok 4.20 Beta default | X AI | 10 | 0.4 | $0.087 | 6/18 | 1.19s |
| #418 | Hunter Alpha default | OpenRouter | 9 | 0.3 | $0.000 | 6/18 | 4.70s |
| #419 | Grok 4.20 none | X AI | 10 | 0.3 | $0.057 | 6/18 | 1.11s |
| #433 | d1-ultra default | Liquid | 7 | 0.3 | $0.003 | 4/12 | 531ms |
| #437 | Decider V1.1 27B default | Perplexity | 8 | 0.3 | $0.002 | 4/12 | 320ms |
| #438 | Drex v1.5 default | Nace AI | 8 | 0.2 | $0.002 | 4/12 | 986ms |
| #441 | Jev 1.14 default | Typesafe | 7 | 0.2 | $0.003 | 4/12 | 377ms |