Instructions following x Did not follow instructions Ranking

See which AI models are most likely to hit Did not follow instructions on Instructions following, so you can spot weak points faster.

Models Shown

Total Failures

Most Affected Model

Failure Reasons

Wrong answer61 Did not follow instructions18 Extra formatting3 No answer2 API error1 Timed out1

Categories

Puzzle Solving90 General Intelligence78 Anti-AI Tricks33 Instructions following18 Coding16 Tool Calling8 Combined1 Domain specific1

18/18

Rank	Model	Company	Did not follow instructions Count	Category Score	Total Cost	Tests Correct	Response Time (avg)
#203	Grok 4.1 Fast none	X AI	1	3.0	$0.008	0/2	685ms
Total Tests 2 Wrong Tests 2 Total Cost $0.008 Response Time (avg) 685ms
#207	Nemotron 3 Nano Omni 30b A3b Reasoning medium	NVIDIA	1	7.3	$0.000	1/2	1.37s
Total Tests 2 Wrong Tests 1 Total Cost $0.000 Response Time (avg) 1.37s
#208	Nemotron 3 Nano Omni 30b A3b Reasoning none	NVIDIA	1	4.8	$0.000	0/2	541ms
Total Tests 2 Wrong Tests 2 Total Cost $0.000 Response Time (avg) 541ms

Filter models