Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↑.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #366 | Hy4 preview none | Tencent | 14 | 0.5 | $0.165 | 3/23 | 40.4s |
| #375 | Qwen3 Coder Next medium | Qwen | 15 | 0.5 | $0.071 | 3/23 | 17.0s |
| #380 | Laguna S 2.1 low | Poolside | 16 | 0.5 | $0.108 | 3/23 | 88.2s |
| #392 | Granite 4.2 8B none | IBM Granite | 11 | 0.4 | $0.037 | 3/23 | 84.7s |
| #402 | Qwen3.5-9B medium | Qwen | 2 | 0.4 | $0.106 | 3/23 | 110.2s |
| #409 | Nemotron 3.5 Lightning none | NVIDIA | 16 | 0.4 | $0.009 | 3/23 | 15.9s |
| #454 | Nimble v3 9B default | Bespoke Labs | 5 | 0.8 | ~$0.001 | 1/7 | 363ms |
| #427 | Grok 4.1 Fast default | X AI | 13 | 0.3 | $0.008 | 3/19 | 1.62s |
| #444 | Clef Omni default | Cloudflare | 9 | 0.2 | $0.011 | 2/12 | 880ms |
| #447 | D1 default | Liquid | 10 | 0.2 | $0.003 | 2/12 | 508ms |
| #339 | Qwen3.6 35B A3B none | Qwen | 13 | 0.5 | $0.105 | 4/23 | 8.43s |
| #352 | Laguna S 2.1 medium | Poolside | 14 | 0.5 | $0.092 | 4/23 | 63.1s |
| #361 | Laguna S 2.1 high | Poolside | 12 | 0.5 | $0.145 | 4/23 | 113.6s |
| #363 | Ling 2.6 1t default | Inclusionai | 12 | 0.5 | $0.016 | 4/23 | 8.16s |
| #365 | Qwen3.5-9B none | Qwen | 15 | 0.5 | $0.041 | 4/23 | 37.2s |