Wrong answer Failure Ranking

AI BENCHY Failures

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Response Time (avg) ↑.

Models Shown

Total Failures

572

Most Affected Model

Categories

In category Domain specific182 In category Anti-AI Tricks165 In category Puzzle Solving85 In category Instructions following44 In category Combined37 In category Coding28 In category Data parsing and extraction19 In category General Intelligence10 In category Tool Calling2

Rank	Model	Company	Wrong answer Count	Score	Tests Correct	Response Time (avg)
#8	Qwen3.5 Plus 2026-02-15 medium	Qwen	2	8.5	14/18	46.6s
#10	Qwen3.5-27B medium	Qwen	1	8.4	13/18	53.0s
#32	Qwen3.5-Flash medium	Qwen	1	7.8	11/18	66.7s
#11	Gemini 3.1 Flash Lite Preview high	Google	3	8.4	12/16	68.8s
#39	Seed-2.0-Mini medium	Bytedance Seed	2	7.5	11/18	69.7s
#46	Kimi K2.5 medium	Moonshot AI	4	7.0	9/18	72.4s
#97	Qwen3.5-9B medium	Qwen	1	4.4	3/18	73.6s

←

1 2 3 4 5 6 7

Wrong answer Failures