Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Response Time (avg) ↓.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #449 | LFM2-24B-A2B default | Liquid | 9 | 0.2 | $0.001 | 2/16 | 782ms |
| #434 | Nemotron 3 Nano Omni 30b A3b Reasoning default | NVIDIA | 9 | 0.3 | $0.000 | 2/19 | 728ms |
| #435 | Jev 1.13 default | Typesafe | 6 | 0.3 | $0.003 | 6/12 | 698ms |
| #433 | d1-ultra default | Liquid | 7 | 0.3 | $0.003 | 4/12 | 531ms |
| #436 | Decider V1.2 default | Perplexity | 5 | 0.3 | $0.001 | 5/12 | 517ms |
| #447 | D1 default | Liquid | 10 | 0.2 | $0.003 | 2/12 | 508ms |
| #453 | Tev1 4B Experimental default | Togethercomputer | 4 | 1.0 | $0.002 | 3/7 | 498ms |
| #439 | GPT-6 Luna Decisions default | OpenAI | 8 | 0.2 | $0.005 | 3/12 | 495ms |
| #445 | Decider Flash V1.2 default | Perplexity | 9 | 0.2 | $0.001 | 3/12 | 462ms |
| #441 | Jev 1.14 default | Typesafe | 7 | 0.2 | $0.003 | 4/12 | 377ms |
| #454 | Nimble v3 9B default | Bespoke Labs | 5 | 0.8 | ~$0.001 | 1/7 | 363ms |
| #437 | Decider V1.1 27B default | Perplexity | 8 | 0.3 | $0.002 | 4/12 | 320ms |