Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↓.
Categories
447/447
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #187 | GPT-5.2 Chat default | OpenAI | 6 | 0.7 | $0.594 | 13/23 | 7.43s |
| #191 | Ember-1 low | Fireworks | 3 | 0.7 | $1.488 | 13/23 | 34.9s |
| #198 | Gemini 3.1 Flash Lite medium | 8 | 0.7 | $0.153 | 13/23 | 6.27s | |
| #203 | Claude Opus 4.8 none | Anthropic | 5 | 0.7 | $2.334 | 13/23 | 7.54s |
| #208 | GPT-6 Sol none | OpenAI | 10 | 0.7 | $0.551 | 13/23 | 9.02s |
| #212 | Grok Build 0.1 medium | X AI | 6 | 0.7 | $1.419 | 13/23 | 55.1s |
| #215 | Grok 4.7 high | X AI | 2 | 0.7 | $3.037 | 13/23 | 122.2s |
| #218 | GPT 5.3 Chat default | OpenAI | 6 | 0.7 | $0.533 | 13/23 | 6.31s |
| #223 | GLM 5.2 none | Z.ai | 8 | 0.7 | $0.250 | 13/23 | 11.3s |
| #242 | Gemini 3 Flash Preview none | 9 | 0.6 | $0.155 | 13/23 | 6.05s | |
| #250 | Gemini 3.5 Flash minimal | 7 | 0.6 | $0.508 | 13/23 | 4.67s | |
| #260 | Gemini 3.1 Flash Lite low | 9 | 0.6 | $0.717 | 13/23 | 19.0s | |
| #378 | Gemini 3.1 Flash Lite high | 4 | 0.5 | $2.044 | 10/18 | 62.0s | |
| #286 | Claude Sonnet 4.6 none | Anthropic | 5 | 0.6 | $0.661 | 12/22 | 7.67s |
| #324 | GLM 5V Turbo medium | Z.ai | 7 | 0.5 | $0.457 | 11/21 | 23.1s |