Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↑.

Models Shown

Total Failures

2144

Most Affected Model

Categories

In category Domain specific615 In category Anti-AI Tricks375 In category Coding340 In category Puzzle Solving267 In category Trivia230 In category Combined89 In category General Intelligence86 In category Instructions following78 In category Data parsing and extraction59 In category Tool Calling5

291/291

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#49	Qwen3.8 2.4T A95B low	Qwen	4	8.1	$2.672	15/22	119.0s
Total Tests 22 Wrong Tests 7 Total Cost $2.672 Response Time (avg) 119.0s
#75	Claude Opus 4.6 medium	Anthropic	4	7.7	$2.961	13/22	32.2s
Total Tests 22 Wrong Tests 9 Total Cost $2.961 Response Time (avg) 32.2s
#34	Claude Fable 5 medium	Anthropic	1	8.6	$3.004	17/22	15.0s
Total Tests 22 Wrong Tests 5 Total Cost $3.004 Response Time (avg) 15.0s
#14	Claude Opus 5 high	Anthropic	2	9.2	$3.070	18/22	22.5s
Total Tests 22 Wrong Tests 4 Total Cost $3.070 Response Time (avg) 22.5s
#19	GPT-5.5 medium	OpenAI	4	9.0	$4.163	18/22	39.0s
Total Tests 22 Wrong Tests 4 Total Cost $4.163 Response Time (avg) 39.0s
#256	Grok 4.20 Multi Agent Beta medium	X AI	4	4.8	$5.599	8/18	9.69s
Total Tests 18 Wrong Tests 10 Total Cost $5.599 Response Time (avg) 9.69s

←

1 19 20

Wrong answer Failures