Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↑.

Models Shown

Total Failures

1642

Most Affected Model

Categories

In category Domain specific433 In category Anti-AI Tricks306 In category Coding266 In category Puzzle Solving214 In category Trivia176 In category Combined71 In category General Intelligence66 In category Instructions following65 In category Data parsing and extraction41 In category Tool Calling4

219/219

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#9	GPT-5.5 low	OpenAI	3	9.3	$1.253	19/22	10.1s
Total Tests 22 Wrong Tests 3 Total Cost $1.253 Response Time (avg) 10.1s
#12	Gemini 3.5 Flash medium	Google	2	9.1	$0.642	19/22	8.20s
Total Tests 22 Wrong Tests 3 Total Cost $0.642 Response Time (avg) 8.20s
#14	Gemini 3.5 Flash low	Google	2	8.9	$0.433	19/22	5.55s
Total Tests 22 Wrong Tests 3 Total Cost $0.433 Response Time (avg) 5.55s
#4	Gemini 3.5 Flash high	Google	1	9.5	$1.976	20/22	15.1s
Total Tests 22 Wrong Tests 2 Total Cost $1.976 Response Time (avg) 15.1s
#10	Gemini 3.1 Pro Preview medium	Google	2	9.2	$1.361	20/22	21.5s
Total Tests 22 Wrong Tests 2 Total Cost $1.361 Response Time (avg) 21.5s
#1	Gemini 3.6 Flash medium	Google	1	9.9	$0.831	21/22	10.1s
Total Tests 22 Wrong Tests 1 Total Cost $0.831 Response Time (avg) 10.1s
#2	Gemini 3.6 Flash high	Google	1	9.7	$1.785	21/22	14.9s
Total Tests 22 Wrong Tests 1 Total Cost $1.785 Response Time (avg) 14.9s
#3	Gemini 3 Flash Preview medium	Google	1	9.6	$0.742	21/22	19.2s
Total Tests 22 Wrong Tests 1 Total Cost $0.742 Response Time (avg) 19.2s
#6	Gemini 3.6 Flash low	Google	1	9.4	$0.517	21/22	4.42s
Total Tests 22 Wrong Tests 1 Total Cost $0.517 Response Time (avg) 4.42s

←

1 14 15

Wrong answer Failures