Did not follow instructions Failure Ranking

See which AI models run into Did not follow instructions most often, so you can spot reliability risks before choosing one. Sort by: Response Time (avg) ↑.

Models Shown

Total Failures

386

Most Affected Model

Nemotron 3 Nano Omni 30b A3b Reasoning 2

Categories

In category Puzzle Solving128 In category General Intelligence115 In category Instructions following48 In category Anti-AI Tricks44 In category Coding29 In category Tool Calling12 In category Data parsing and extraction7 In category Domain specific2 In category Combined1

215/215

Rank	Model	Company	Did not follow instructions Count	Score	Total Cost	Tests Correct	Response Time (avg)
#53	Qwen3.8 27B high	Qwen	2	8.4	~$0.287	16/22	167.9s
Total Tests 22 Wrong Tests 6 Total Cost ~$0.287 Response Time (avg) 167.9s
#32	Seed 2.1 Turbo high	Bytedance Seed	1	8.9	$1.797	16/22	174.0s
Total Tests 22 Wrong Tests 6 Total Cost $1.797 Response Time (avg) 174.0s
#207	Step 3.5 Flash medium	Stepfun	3	5.9	$0.132	10/21	191.6s
Total Tests 21 Wrong Tests 11 Total Cost $0.132 Response Time (avg) 191.6s
#54	Seed 2.1 Turbo medium	Bytedance Seed	1	8.4	$1.951	15/22	193.6s
Total Tests 22 Wrong Tests 7 Total Cost $1.951 Response Time (avg) 193.6s
#233	Hy4 preview low	Tencent	1	5.6	$1.745	3/22	214.3s
Total Tests 22 Wrong Tests 19 Total Cost $1.745 Response Time (avg) 214.3s

Did not follow instructions Failures

Filter models

Top Models by Did not follow instructions Count

Did not follow instructions Count vs Score

Top Models by Response Time (avg)