Did not follow instructions Failure Ranking

See which AI models run into Did not follow instructions most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↓.

Models Shown

Total Failures

386

Most Affected Model

Categories

In category Puzzle Solving128 In category General Intelligence115 In category Instructions following48 In category Anti-AI Tricks44 In category Coding29 In category Tool Calling12 In category Data parsing and extraction7 In category Domain specific2 In category Combined1

215/215

Rank	Model	Company	Did not follow instructions Count	Score	Total Cost	Tests Correct	Response Time (avg)
#316	LFM2-24B-A2B none	Liquid	1	2.2	$0.001	2/16	782ms
Total Tests 16 Wrong Tests 14 Total Cost $0.001 Response Time (avg) 782ms
#314	Nemotron 3 Nano Omni 30b A3b Reasoning none	NVIDIA	2	3.2	$0.000	2/19	728ms
Total Tests 19 Wrong Tests 17 Total Cost $0.000 Response Time (avg) 728ms
#290	Laguna S 2.1 none	Poolside	1	4.5	$0.022	2/22	11.7s
Total Tests 22 Wrong Tests 20 Total Cost $0.022 Response Time (avg) 11.7s
#302	Ling 3.0 Tiny none	Inclusionai	4	4.0	$0.000	2/22	14.0s
Total Tests 22 Wrong Tests 20 Total Cost $0.000 Response Time (avg) 14.0s
#303	Granite 4.1 8B none	IBM Granite	4	4.0	$0.007	2/22	1.44s
Total Tests 22 Wrong Tests 20 Total Cost $0.007 Response Time (avg) 1.44s

Did not follow instructions Failures