Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Failure Count ↑.

Models Shown

Total Failures

1642

Most Affected Model

Gemini 3.6 Flash 1

Categories

In category Domain specific433 In category Anti-AI Tricks306 In category Coding266 In category Puzzle Solving214 In category Trivia176 In category Combined71 In category General Intelligence66 In category Instructions following65 In category Data parsing and extraction41 In category Tool Calling4

219/219

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#100	Gemma 4 26B A4B medium	Google	3	6.6	$0.089	14/22	103.8s
Total Tests 22 Wrong Tests 8 Total Cost $0.089 Response Time (avg) 103.8s
#106	Hy3 preview medium	Tencent	3	6.5	$0.018	14/21	16.3s
Total Tests 21 Wrong Tests 7 Total Cost $0.018 Response Time (avg) 16.3s
#137	Grok 4.20 Beta medium	X AI	3	6.0	$0.750	14/18	9.75s
Total Tests 18 Wrong Tests 4 Total Cost $0.750 Response Time (avg) 9.75s
#139	Gemini 3 PRO Preview medium	Google	3	6.0	$0.385	14/21	9.05s
Total Tests 21 Wrong Tests 7 Total Cost $0.385 Response Time (avg) 9.05s
#141	Hy3 preview high	Tencent	3	5.9	$0.048	11/21	56.6s
Total Tests 21 Wrong Tests 10 Total Cost $0.048 Response Time (avg) 56.6s
#5	GPT-5.6 Sol low	OpenAI	4	9.5	$0.971	18/22	8.79s
Total Tests 22 Wrong Tests 4 Total Cost $0.971 Response Time (avg) 8.79s
#7	GPT-5.6 Sol medium	OpenAI	4	9.4	$1.316	18/22	11.4s
Total Tests 22 Wrong Tests 4 Total Cost $1.316 Response Time (avg) 11.4s
#8	GPT-5.6 Sol high	OpenAI	4	9.4	$1.234	18/22	11.7s
Total Tests 22 Wrong Tests 4 Total Cost $1.234 Response Time (avg) 11.7s
#13	GPT-5.5 medium	OpenAI	4	9.0	$4.137	18/22	38.4s
Total Tests 22 Wrong Tests 4 Total Cost $4.137 Response Time (avg) 38.4s
#16	GPT-5.3-Codex medium	OpenAI	4	8.9	$0.920	16/22	17.0s
Total Tests 22 Wrong Tests 6 Total Cost $0.920 Response Time (avg) 17.0s
#19	Muse Spark 1.1 medium	Meta	4	8.6	$1.357	15/22	25.0s
Total Tests 22 Wrong Tests 7 Total Cost $1.357 Response Time (avg) 25.0s
#26	Claude Sonnet 5 medium	Anthropic	4	8.3	$0.922	16/22	12.5s
Total Tests 22 Wrong Tests 6 Total Cost $0.922 Response Time (avg) 12.5s
#30	Muse Spark 1.1 high	Meta	4	8.1	$1.694	12/22	31.5s
Total Tests 22 Wrong Tests 10 Total Cost $1.694 Response Time (avg) 31.5s
#32	Inkling high	Thinkingmachines	4	8.0	$1.006	15/22	64.2s
Total Tests 22 Wrong Tests 7 Total Cost $1.006 Response Time (avg) 64.2s
#36	Inkling medium	Thinkingmachines	4	8.0	$0.391	15/22	16.2s
Total Tests 22 Wrong Tests 7 Total Cost $0.391 Response Time (avg) 16.2s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)