Did not follow instructions Failure Ranking

See which AI models run into Did not follow instructions most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↑.

Models Shown

Total Failures

386

Most Affected Model

Categories

In category Puzzle Solving128 In category General Intelligence115 In category Instructions following48 In category Anti-AI Tricks44 In category Coding29 In category Tool Calling12 In category Data parsing and extraction7 In category Domain specific2 In category Combined1

215/215

Rank	Model	Company	Did not follow instructions Count	Score	Total Cost	Tests Correct	Response Time (avg)
#110	Qwen3.8 2.4T A95B high	Qwen	2	7.4	$2.357	14/22	120.6s
Total Tests 22 Wrong Tests 8 Total Cost $2.357 Response Time (avg) 120.6s
#141	Claude Fable 5.1 low	Anthropic	3	6.9	$2.565	11/22	10.3s
Total Tests 22 Wrong Tests 11 Total Cost $2.565 Response Time (avg) 10.3s
#57	Claude Fable 5.1 medium	Anthropic	1	8.3	$2.909	15/22	11.7s
Total Tests 22 Wrong Tests 7 Total Cost $2.909 Response Time (avg) 11.7s
#87	Claude Opus 4.6 medium	Anthropic	1	7.7	$2.961	13/22	32.2s
Total Tests 22 Wrong Tests 9 Total Cost $2.961 Response Time (avg) 32.2s
#278	Grok 4.20 Multi Agent Beta medium	X AI	2	4.8	$5.599	8/18	9.69s
Total Tests 18 Wrong Tests 10 Total Cost $5.599 Response Time (avg) 9.69s

Did not follow instructions Failures