AI BENCHY Failures
Wrong answer Failures
See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one.
Categories
165/165
Filter models
No models match the current search and filters.
| Rank | Model | Company | Wrong answer Count | Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #68 | Gemini 3.5 Flash none | 3 | 7.0 | $1.079 | 15/21 | 9.93s | |
| #76 | Hy3 preview high | Tencent | 3 | 6.8 | $0.048 | 11/21 | 56.6s |
| #92 | Gemini 3 PRO Preview medium | 3 | 6.2 | $0.385 | 14/21 | 9.05s | |
| #3 | Gemini 3.1 Flash Lite Preview high | 2 | 9.4 | $2.310 | 13/16 | 68.1s | |
| #7 | Gemini 3.5 Flash low | 2 | 9.2 | $0.349 | 19/21 | 3.27s | |
| #9 | Claude Fable 5 medium | Anthropic | 2 | 9.2 | $3.165 | 17/21 | 17.0s |
| #10 | Gemini 3.1 Pro Preview medium | 2 | 9.2 | $1.054 | 19/21 | 20.1s | |
| #11 | Gemini 3.5 Flash medium | 2 | 9.1 | $0.582 | 18/21 | 4.94s | |
| #87 | Qwen3.6 Plus Preview medium | Qwen | 2 | 6.3 | $0.000 | 9/19 | 15.2s |
| #89 | Gemma 4 31B medium | 2 | 6.3 | $0.033 | 14/21 | 56.5s | |
| #90 | Qwen3.5-35B-A3B medium | Qwen | 2 | 6.3 | $0.401 | 11/21 | 72.6s |
| #164 | Qwen3.5-9B medium | Qwen | 2 | 3.8 | $0.036 | 3/21 | 82.2s |
| #1 | Gemini 3.5 Flash high | 1 | 9.8 | $1.115 | 20/21 | 8.84s | |
| #2 | Gemini 3 Flash Preview medium | 1 | 9.6 | $0.667 | 20/21 | 18.6s | |
| #158 | Step 3.5 Flash none | Stepfun | 1 | 4.3 | $0.020 | 6/12 | 39.0s |