Did not follow instructions Failure Ranking

See which AI models run into Did not follow instructions most often, so you can spot reliability risks before choosing one. Sort by: Response Time (avg) ↓.

Models Shown

Total Failures

245

Most Affected Model

Step 3.5 Flash 3

Categories

In category Puzzle Solving90 In category General Intelligence78 In category Anti-AI Tricks33 In category Instructions following18 In category Coding16 In category Tool Calling8 In category Combined1 In category Domain specific1

140/140

Rank	Model	Company	Did not follow instructions Count	Score	Total Cost	Tests Correct	Response Time (avg)
#191	Grok 4.20 Beta none	X AI	1	4.4	$0.087	6/18	1.19s
Total Tests 18 Wrong Tests 12 Total Cost $0.087 Response Time (avg) 1.19s
#189	Mercury 2 none	Inception	1	4.6	$0.030	4/22	829ms
Total Tests 22 Wrong Tests 18 Total Cost $0.030 Response Time (avg) 829ms
#205	Laguna Xs.2 none	Poolside	1	3.8	$0.004	5/19	806ms
Total Tests 19 Wrong Tests 14 Total Cost $0.004 Response Time (avg) 806ms
#210	LFM2-24B-A2B none	Liquid	1	2.2	$0.001	2/16	782ms
Total Tests 16 Wrong Tests 14 Total Cost $0.001 Response Time (avg) 782ms
#208	Nemotron 3 Nano Omni 30b A3b Reasoning none	NVIDIA	2	3.2	$0.000	2/19	728ms
Total Tests 19 Wrong Tests 17 Total Cost $0.000 Response Time (avg) 728ms

Did not follow instructions Failures

Filter models

Top Models by Did not follow instructions Count

Did not follow instructions Count vs Score

Top Models by Response Time (avg)