Did not follow instructions Failure Ranking

See which AI models run into Did not follow instructions most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↓.

Models Shown

Total Failures

522

Most Affected Model

Categories

In category Puzzle Solving166 In category General Intelligence142 In category Instructions following77 In category Anti-AI Tricks52 In category Coding50 In category Tool Calling13 In category Agentic10 In category Data parsing and extraction8 In category Domain specific3 In category Combined1

293/293

Rank	Model	Company	Did not follow instructions Count	Score	Total Cost	Tests Correct	Response Time (avg)
#445	LFM2-24B-A2B default	Liquid	1	0.2	$0.001	2/16	782ms
Total Tests 16 Wrong Tests 14 Total Cost $0.001 Response Time (avg) 782ms
#431	Nemotron 3 Nano Omni 30b A3b Reasoning default	NVIDIA	2	0.3	$0.000	2/19	728ms
Total Tests 19 Wrong Tests 17 Total Cost $0.000 Response Time (avg) 728ms
#370	Laguna S 2.1 none	Poolside	2	0.5	$0.044	2/23	17.7s
Total Tests 23 Wrong Tests 21 Total Cost $0.044 Response Time (avg) 17.7s
#397	Mercury 2.5 none	Inception	4	0.4	$0.026	2/23	5.10s
Total Tests 23 Wrong Tests 21 Total Cost $0.026 Response Time (avg) 5.10s
#404	Ling 3.0 Tiny default	Inclusionai	4	0.4	$0.000	2/23	13.4s
Total Tests 23 Wrong Tests 21 Total Cost $0.000 Response Time (avg) 13.4s
#405	Granite 4.1 8b default	IBM Granite	4	0.4	$0.007	2/23	1.38s
Total Tests 23 Wrong Tests 21 Total Cost $0.007 Response Time (avg) 1.38s
#407	Xing4.0 29b A4b medium	Xingchen AGI	3	0.4	$0.000	1/23	371.7s
Total Tests 23 Wrong Tests 22 Total Cost $0.000 Response Time (avg) 371.7s
#421	Xing4.0 29b A4b none	Xingchen AGI	5	0.3	$0.000	0/23	42.7s
Total Tests 23 Wrong Tests 23 Total Cost $0.000 Response Time (avg) 42.7s

Did not follow instructions Failures