Did not follow instructions Failure Ranking

See which AI models run into Did not follow instructions most often, so you can spot reliability risks before choosing one. Sort by: Failure Count ↑.

Models Shown

Total Failures

386

Most Affected Model

Gemini 3.5 Flash 1

Categories

In category Puzzle Solving128 In category General Intelligence115 In category Instructions following48 In category Anti-AI Tricks44 In category Coding29 In category Tool Calling12 In category Data parsing and extraction7 In category Domain specific2 In category Combined1

215/215

Rank	Model	Company	Did not follow instructions Count	Score	Total Cost	Tests Correct	Response Time (avg)
#55	Inkling Small high	Thinkingmachines	2	8.4	$0.398	14/22	30.4s
Total Tests 22 Wrong Tests 8 Total Cost $0.398 Response Time (avg) 30.4s
#65	Muse Spark 1.1 high	Meta	2	8.0	$2.253	12/22	36.9s
Total Tests 22 Wrong Tests 10 Total Cost $2.253 Response Time (avg) 36.9s
#67	DeepSeek V4 Flash 0731 high	DeepSeek	2	8.0	$0.084	14/22	114.9s
Total Tests 22 Wrong Tests 8 Total Cost $0.084 Response Time (avg) 114.9s
#81	Qwen3.8 27B medium	Qwen	2	7.8	~$0.058	14/22	33.0s
Total Tests 22 Wrong Tests 8 Total Cost ~$0.058 Response Time (avg) 33.0s
#82	Seed-2.0-Lite medium	Bytedance Seed	2	7.8	$0.236	13/22	47.9s
Total Tests 22 Wrong Tests 9 Total Cost $0.236 Response Time (avg) 47.9s
#88	DeepSeek V4 Pro high	DeepSeek	2	7.7	$0.476	10/22	92.5s
Total Tests 22 Wrong Tests 12 Total Cost $0.476 Response Time (avg) 92.5s
#89	DeepSeek V4 Flash 0423 high	DeepSeek	2	7.6	$0.042	13/22	51.8s
Total Tests 22 Wrong Tests 9 Total Cost $0.042 Response Time (avg) 51.8s
#95	GPT-5.4 Nano medium	OpenAI	2	7.5	$0.142	12/22	13.3s
Total Tests 22 Wrong Tests 10 Total Cost $0.142 Response Time (avg) 13.3s
#97	MiniMax M3 medium	Minimax	2	7.5	$0.300	11/22	75.2s
Total Tests 22 Wrong Tests 11 Total Cost $0.300 Response Time (avg) 75.2s
#98	GPT 5.3 Chat none	OpenAI	2	7.5	$0.533	13/22	6.56s
Total Tests 22 Wrong Tests 9 Total Cost $0.533 Response Time (avg) 6.56s
#100	Qwen3.5-27B medium	Qwen	2	7.5	$0.982	13/22	113.3s
Total Tests 22 Wrong Tests 9 Total Cost $0.982 Response Time (avg) 113.3s
#110	Qwen3.8 2.4T A95B high	Qwen	2	7.4	$2.357	14/22	120.6s
Total Tests 22 Wrong Tests 8 Total Cost $2.357 Response Time (avg) 120.6s
#121	Kimi K2.6 medium	Moonshot AI	2	7.2	$1.247	12/22	115.9s
Total Tests 22 Wrong Tests 10 Total Cost $1.247 Response Time (avg) 115.9s
#131	Grok 4.3 medium	X AI	2	7.0	$0.741	12/22	44.2s
Total Tests 22 Wrong Tests 10 Total Cost $0.741 Response Time (avg) 44.2s
#137	Grok 4.20 medium	X AI	2	7.0	$0.805	11/22	32.6s
Total Tests 22 Wrong Tests 11 Total Cost $0.805 Response Time (avg) 32.6s

Did not follow instructions Failures

Filter models

Top Models by Did not follow instructions Count

Did not follow instructions Count vs Score

Top Models by Response Time (avg)