Did not follow instructions Failure Ranking

See which AI models run into Did not follow instructions most often, so you can spot reliability risks before choosing one. Sort by: Response Time (avg) ↑.

Models Shown

Total Failures

245

Most Affected Model

Nemotron 3 Nano Omni 30b A3b Reasoning 2

Categories

In category Puzzle Solving90 In category General Intelligence78 In category Anti-AI Tricks33 In category Instructions following18 In category Coding16 In category Tool Calling8 In category Combined1 In category Domain specific1

140/140

Rank	Model	Company	Did not follow instructions Count	Score	Total Cost	Tests Correct	Response Time (avg)
#68	Kimi K2.6 medium	Moonshot AI	2	7.2	$1.036	12/22	110.0s
Total Tests 22 Wrong Tests 10 Total Cost $1.036 Response Time (avg) 110.0s
#58	Qwen3.5-27B medium	Qwen	2	7.4	$1.627	13/22	111.9s
Total Tests 22 Wrong Tests 9 Total Cost $1.627 Response Time (avg) 111.9s
#194	GLM 4.7 Flash medium	Z.ai	2	4.3	$0.166	4/22	142.6s
Total Tests 22 Wrong Tests 18 Total Cost $0.166 Response Time (avg) 142.6s
#97	LongCat 2.0 high	Meituan	2	6.6	$0.469	9/22	148.7s
Total Tests 22 Wrong Tests 13 Total Cost $0.469 Response Time (avg) 148.7s
#130	Step 3.5 Flash medium	Stepfun	3	6.0	$0.108	11/21	174.2s
Total Tests 21 Wrong Tests 10 Total Cost $0.108 Response Time (avg) 174.2s

Did not follow instructions Failures

Filter models

Top Models by Did not follow instructions Count

Did not follow instructions Count vs Score

Top Models by Response Time (avg)