Did not follow instructions Failure Ranking

See which AI models run into Did not follow instructions most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↑.

Models Shown

Total Failures

386

Most Affected Model

Categories

In category Puzzle Solving128 In category General Intelligence115 In category Instructions following48 In category Anti-AI Tricks44 In category Coding29 In category Tool Calling12 In category Data parsing and extraction7 In category Domain specific2 In category Combined1

215/215

Rank	Model	Company	Did not follow instructions Count	Score	Total Cost	Tests Correct	Response Time (avg)
#53	Qwen3.8 27B high	Qwen	2	8.4	~$0.287	16/22	167.9s
Total Tests 22 Wrong Tests 6 Total Cost ~$0.287 Response Time (avg) 167.9s
#29	Grok 4.5 high	X AI	1	9.0	$2.252	17/22	72.3s
Total Tests 22 Wrong Tests 5 Total Cost $2.252 Response Time (avg) 72.3s
#201	Grok 4.20 Beta medium	X AI	1	6.0	$0.750	14/18	9.75s
Total Tests 18 Wrong Tests 4 Total Cost $0.750 Response Time (avg) 9.75s
#250	Gemini 3.1 Flash Lite Preview high	Google	1	5.3	$2.310	13/16	68.1s
Total Tests 16 Wrong Tests 3 Total Cost $2.310 Response Time (avg) 68.1s
#26	Gemini 3.5 Flash medium	Google	1	9.0	$0.665	18/22	8.48s
Total Tests 22 Wrong Tests 4 Total Cost $0.665 Response Time (avg) 8.48s

Did not follow instructions Failures