Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one.

Models Shown

Total Failures

3190

Most Affected Model

Categories

In category Domain specific900 In category Anti-AI Tricks521 In category Coding485 In category Puzzle Solving355 In category Trivia317 In category General Intelligence134 In category Combined130 In category Agentic128 In category Instructions following118 In category Data parsing and extraction93

447/447

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#24	Claude Opus 5.5 low	Anthropic	2	0.9	$1.733	19/23	25.7s
Total Tests 23 Wrong Tests 4 Total Cost $1.733 Response Time (avg) 25.7s
#25	Claude Opus 5.5 high	Anthropic	2	0.9	$2.133	19/23	27.6s
Total Tests 23 Wrong Tests 4 Total Cost $2.133 Response Time (avg) 27.6s
#26	Gemini 3.7 Flash low	Google	2	0.9	$0.183	21/23	6.24s
Total Tests 23 Wrong Tests 2 Total Cost $0.183 Response Time (avg) 6.24s
#27	Claude Opus 5 high	Anthropic	2	0.9	$4.524	19/23	25.3s
Total Tests 23 Wrong Tests 4 Total Cost $4.524 Response Time (avg) 25.3s
#30	Muse Spark Open high	Meta	2	0.9	$1.782	17/23	152.0s
Total Tests 23 Wrong Tests 6 Total Cost $1.782 Response Time (avg) 152.0s
#31	Claude Opus 5.5 medium	Anthropic	2	0.9	$1.804	20/23	25.9s
Total Tests 23 Wrong Tests 3 Total Cost $1.804 Response Time (avg) 25.9s
#32	Muse Wonder medium	Meta	2	0.9	$3.397	17/23	21.6s
Total Tests 23 Wrong Tests 6 Total Cost $3.397 Response Time (avg) 21.6s
#37	Qwen3.8 Max (0902) high	Qwen	2	0.9	$3.306	18/23	186.1s
Total Tests 23 Wrong Tests 5 Total Cost $3.306 Response Time (avg) 186.1s
#39	Claude Haiku 5.5 xhigh	Anthropic	2	0.9	$0.140	18/23	16.6s
Total Tests 23 Wrong Tests 5 Total Cost $0.140 Response Time (avg) 16.6s
#45	Muse Spark Open xhigh	Meta	2	0.9	$2.081	16/23	92.4s
Total Tests 23 Wrong Tests 7 Total Cost $2.081 Response Time (avg) 92.4s
#53	GLM 5.3 Flash max	Z.ai	2	0.9	$0.089	17/23	54.0s
Total Tests 23 Wrong Tests 6 Total Cost $0.089 Response Time (avg) 54.0s
#66	Kimi K3.1 Pro max	Moonshot AI	2	0.9	$3.578	17/23	152.7s
Total Tests 23 Wrong Tests 6 Total Cost $3.578 Response Time (avg) 152.7s
#69	Qwen3.8 27B high	Qwen	2	0.9	~$0.298	17/23	166.3s
Total Tests 23 Wrong Tests 6 Total Cost ~$0.298 Response Time (avg) 166.3s
#88	Gemini 3.1 Pro Preview medium	Google	2	0.8	$1.585	20/23	22.7s
Total Tests 23 Wrong Tests 3 Total Cost $1.585 Response Time (avg) 22.7s
#95	Gemini 3.5 Flash high	Google	2	0.8	$2.737	19/23	18.6s
Total Tests 23 Wrong Tests 4 Total Cost $2.737 Response Time (avg) 18.6s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)