Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one.

Models Shown

Total Failures

2144

Most Affected Model

Categories

In category Domain specific615 In category Anti-AI Tricks375 In category Coding340 In category Puzzle Solving267 In category Trivia230 In category Combined89 In category General Intelligence86 In category Instructions following78 In category Data parsing and extraction59 In category Tool Calling5

291/291

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#233	Gemini 3.1 Flash Lite Preview high	Google	2	5.3	$2.310	13/16	68.1s
Total Tests 16 Wrong Tests 3 Total Cost $2.310 Response Time (avg) 68.1s
#249	Qwen3.6 Plus Preview medium	Qwen	2	4.9	$0.000	9/19	15.2s
Total Tests 19 Wrong Tests 10 Total Cost $0.000 Response Time (avg) 15.2s
#285	Qwen3.5-9B medium	Qwen	2	3.8	$0.062	3/22	107.5s
Total Tests 22 Wrong Tests 19 Total Cost $0.062 Response Time (avg) 107.5s
#1	Gemini 3.6 Flash high	Google	1	9.9	$0.699	21/22	16.8s
Total Tests 22 Wrong Tests 1 Total Cost $0.699 Response Time (avg) 16.8s
#34	Claude Fable 5 medium	Anthropic	1	8.6	$3.004	17/22	15.0s
Total Tests 22 Wrong Tests 5 Total Cost $3.004 Response Time (avg) 15.0s
#291	Step 3.5 Flash none	Stepfun	1	2.3	$0.020	6/12	39.0s
Total Tests 12 Wrong Tests 6 Total Cost $0.020 Response Time (avg) 39.0s

←

1 19 20

Wrong answer Failures