Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one.

Models Shown

Total Failures

1847

Most Affected Model

Categories

In category Domain specific498 In category Anti-AI Tricks337 In category Coding295 In category Puzzle Solving242 In category Trivia198 In category Combined79 In category Instructions following74 In category General Intelligence71 In category Data parsing and extraction49 In category Tool Calling4

248/248

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#143	Qwen3.5-35B-A3B medium	Qwen	2	6.2	$0.837	11/22	112.5s
Total Tests 22 Wrong Tests 11 Total Cost $0.837 Response Time (avg) 112.5s
#196	Gemini 3.1 Flash Lite Preview high	Google	2	5.3	$2.310	13/16	68.1s
Total Tests 16 Wrong Tests 3 Total Cost $2.310 Response Time (avg) 68.1s
#209	Qwen3.6 Plus Preview medium	Qwen	2	4.9	$0.000	9/19	15.2s
Total Tests 19 Wrong Tests 10 Total Cost $0.000 Response Time (avg) 15.2s
#243	Qwen3.5-9B medium	Qwen	2	3.8	$0.036	3/22	82.2s
Total Tests 22 Wrong Tests 19 Total Cost $0.036 Response Time (avg) 82.2s
#2	Gemini 3.6 Flash medium	Google	1	9.9	$0.830	21/22	11.6s
Total Tests 22 Wrong Tests 1 Total Cost $0.830 Response Time (avg) 11.6s
#3	Gemini 3 Flash Preview medium	Google	1	9.6	$0.742	21/22	19.2s
Total Tests 22 Wrong Tests 1 Total Cost $0.742 Response Time (avg) 19.2s
#4	Gemini 3.5 Flash high	Google	1	9.5	$1.976	20/22	15.1s
Total Tests 22 Wrong Tests 2 Total Cost $1.976 Response Time (avg) 15.1s
#249	Step 3.5 Flash none	Stepfun	1	2.3	$0.020	6/12	39.0s
Total Tests 12 Wrong Tests 6 Total Cost $0.020 Response Time (avg) 39.0s

←

1 16 17

Wrong answer Failures