Instructions following x Wrong answer Ranking

See which AI models are most likely to hit Wrong answer on Instructions following, so you can spot weak points faster.

Models Shown

Total Failures

111

Most Affected Model

Failure Reasons

Wrong answer111 Did not follow instructions73 API error25 Extra formatting8 Timed out5 No answer2

Categories

Domain specific878 Anti-AI Tricks502 Coding477 Puzzle Solving344 Trivia306 General Intelligence129 Agentic126 Combined126 Instructions following111 Data parsing and extraction93

111/111

Rank	Model	Company	Wrong answer Count	Category Score	Total Cost	Tests Correct	Response Time (avg)
#434	D1 default	Liquid	1	0.2	$0.003	0/1	820ms
Total Tests 1 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 820ms
#436	LFM2-24B-A2B default	Liquid	1	0.6	$0.001	1/2	752ms
Total Tests 2 Wrong Tests 1 Total Cost $0.001 Response Time (avg) 752ms
#437	Solar Decide Flash default	Upstage	1	0.2	$0.003	0/1	1.66s
Total Tests 1 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 1.66s
#438	Microsoft-Decision-1 default	Microsoft	1	0.2	$0.002	0/1	997ms
Total Tests 1 Wrong Tests 1 Total Cost $0.002 Response Time (avg) 997ms
#440	Tev1 4B Experimental default	Togethercomputer	1	0.2	$0.002	0/1	555ms
Total Tests 1 Wrong Tests 1 Total Cost $0.002 Response Time (avg) 555ms
#441	Nimble v3 9B default	Bespoke Labs	1	0.2	~$0.001	0/1	469ms
Total Tests 1 Wrong Tests 1 Total Cost ~$0.001 Response Time (avg) 469ms

Filter models