Did not follow instructions Failure Ranking

See which AI models run into Did not follow instructions most often, so you can spot reliability risks before choosing one.

Models Shown

Total Failures

522

Most Affected Model

Claude Sonnet 5.5 5

Categories

In category Puzzle Solving166 In category General Intelligence142 In category Instructions following77 In category Anti-AI Tricks52 In category Coding50 In category Tool Calling13 In category Agentic10 In category Data parsing and extraction8 In category Domain specific3 In category Combined1

293/293

Rank	Model	Company	Did not follow instructions Count	Score	Total Cost	Tests Correct	Response Time (avg)
#213	MiniMax M3 medium	Minimax	2	0.7	$0.422	11/23	77.0s
Total Tests 23 Wrong Tests 12 Total Cost $0.422 Response Time (avg) 77.0s
#215	GPT 5.3 Chat default	OpenAI	2	0.7	$0.533	13/23	6.31s
Total Tests 23 Wrong Tests 10 Total Cost $0.533 Response Time (avg) 6.31s
#218	GLM 5.3 Flash low	Z.ai	2	0.7	$0.038	11/23	11.8s
Total Tests 23 Wrong Tests 12 Total Cost $0.038 Response Time (avg) 11.8s
#230	Mercury 2.5 Preview high	Inception	2	0.6	$0.040	12/23	7.61s
Total Tests 23 Wrong Tests 11 Total Cost $0.040 Response Time (avg) 7.61s
#236	Grok 4.3 medium	X AI	2	0.6	$0.989	12/23	44.5s
Total Tests 23 Wrong Tests 11 Total Cost $0.989 Response Time (avg) 44.5s
#238	Qwen3.5-122B-A10B none	Qwen	2	0.6	$0.308	7/23	14.8s
Total Tests 23 Wrong Tests 16 Total Cost $0.308 Response Time (avg) 14.8s
#240	Beam 1.0 501B A23B max	Reflection	2	0.6	$0.799	12/23	11.1s
Total Tests 23 Wrong Tests 11 Total Cost $0.799 Response Time (avg) 11.1s
#241	Solar Pro 4 medium	Upstage	2	0.6	$0.098	12/23	133.9s
Total Tests 23 Wrong Tests 11 Total Cost $0.098 Response Time (avg) 133.9s
#243	Minimax M3.1 Flash xhigh	Minimax	2	0.6	$0.000	10/23	21.7s
Total Tests 23 Wrong Tests 13 Total Cost $0.000 Response Time (avg) 21.7s
#244	Kimi K2.5 medium	Moonshot AI	2	0.6	$0.841	10/23	125.8s
Total Tests 23 Wrong Tests 13 Total Cost $0.841 Response Time (avg) 125.8s
#245	Beam 1.0 501B A23B low	Reflection	2	0.6	$0.432	11/23	4.89s
Total Tests 23 Wrong Tests 12 Total Cost $0.432 Response Time (avg) 4.89s
#248	MiMo-V2.5-Pro medium	Xiaomi	2	0.6	$0.332	11/23	56.7s
Total Tests 23 Wrong Tests 12 Total Cost $0.332 Response Time (avg) 56.7s
#250	Dots 3 Note Preview low	Dots Studio	2	0.6	$0.000	10/23	66.1s
Total Tests 23 Wrong Tests 13 Total Cost $0.000 Response Time (avg) 66.1s
#253	Qwen3.6 27B none	Qwen	2	0.6	$0.148	8/23	12.7s
Total Tests 23 Wrong Tests 15 Total Cost $0.148 Response Time (avg) 12.7s
#266	Grok 4.20 medium	X AI	2	0.6	$1.246	11/23	36.7s
Total Tests 23 Wrong Tests 12 Total Cost $1.246 Response Time (avg) 36.7s

Did not follow instructions Failures

Filter models

Top Models by Did not follow instructions Count

Did not follow instructions Count vs Score

Top Models by Response Time (avg)