Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one.

Models Shown

Total Failures

1585

Most Affected Model

Categories

In category Domain specific421 In category Anti-AI Tricks293 In category Coding259 In category Puzzle Solving204 In category Trivia172 In category Combined69 In category General Intelligence62 In category Instructions following61 In category Data parsing and extraction41 In category Tool Calling3

215/215

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#2	Gemini 3.6 Flash high	Google	1	9.7	$1.785	21/22	14.9s
Total Tests 22 Wrong Tests 1 Total Cost $1.785 Response Time (avg) 14.9s
#3	Gemini 3 Flash Preview medium	Google	1	9.6	$0.742	21/22	19.2s
Total Tests 22 Wrong Tests 1 Total Cost $0.742 Response Time (avg) 19.2s
#4	Gemini 3.5 Flash high	Google	1	9.5	$1.976	20/22	15.1s
Total Tests 22 Wrong Tests 2 Total Cost $1.976 Response Time (avg) 15.1s
#6	Gemini 3.6 Flash low	Google	1	9.4	$0.517	21/22	4.42s
Total Tests 22 Wrong Tests 1 Total Cost $0.517 Response Time (avg) 4.42s
#215	Step 3.5 Flash none	Stepfun	1	2.3	$0.020	6/12	39.0s
Total Tests 12 Wrong Tests 6 Total Cost $0.020 Response Time (avg) 39.0s

←

1 14 15

Wrong answer Failures