Instructions following Model Ranking

See which AI models perform best on Instructions following, which ones stay reliable, and where the biggest gaps appear. Sort by: Score ↑.

Models Shown

Average Instructions following Score

0.8

Best Model

Solar Decide 0.5

Failure Reasons

With failure reason Wrong answer118 With failure reason Did not follow instructions82 With failure reason API error25 With failure reason Extra formatting8 With failure reason Timed out5 With failure reason No answer2

461/461

Rank	Model	Company	Instructions following Score	Score	Total Cost	Tests Correct	Response Time (avg)
#458	Solar Decide default	Upstage	0.5	0.1	$0.009	1/1	11.7s
Total Tests 1 Wrong Tests 0 Total Cost $0.009 Response Time (avg) 11.7s
#457	Microsoft-Decision-1 default	Microsoft	0.2	0.1	$0.002	0/1	997ms
Total Tests 1 Wrong Tests 1 Total Cost $0.002 Response Time (avg) 997ms
#461	Claude Opus 5.5 none	Anthropic	0.0	0.2	$0.015	0/0	0ms
Total Tests 0 Wrong Tests 0 Total Cost $0.015 Response Time (avg) 0ms
#456	Solar Decide Flash default	Upstage	0.2	0.2	$0.003	0/1	1.66s
Total Tests 1 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 1.66s
#455	LFM2-24B-A2B default	Liquid	0.6	0.2	$0.001	1/2	752ms
Total Tests 2 Wrong Tests 1 Total Cost $0.001 Response Time (avg) 752ms
#454	Gemini 3 Flash Preview high	Google	0.0	0.2	$0.105	0/0	0ms
Total Tests 0 Wrong Tests 0 Total Cost $0.105 Response Time (avg) 0ms
#453	D1 default	Liquid	0.2	0.2	$0.003	0/1	820ms
Total Tests 1 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 820ms
#451	Decider Flash V1.2 default	Perplexity	0.2	0.2	$0.001	0/1	424ms
Total Tests 1 Wrong Tests 1 Total Cost $0.001 Response Time (avg) 424ms
#452	Step 3.5 Flash none	Stepfun	0.5	0.2	$0.020	1/1	9.30s
Total Tests 1 Wrong Tests 0 Total Cost $0.020 Response Time (avg) 9.30s
#450	Clef Omni default	Cloudflare	0.2	0.2	$0.011	0/1	904ms
Total Tests 1 Wrong Tests 1 Total Cost $0.011 Response Time (avg) 904ms
#449	Classify-1 default	Scaledown	0.2	0.2	$0.008	0/1	4.26s
Total Tests 1 Wrong Tests 1 Total Cost $0.008 Response Time (avg) 4.26s
#448	Mammoth 1 default	Baseten	0.2	0.2	$0.000	0/1	4.04s
Total Tests 1 Wrong Tests 1 Total Cost $0.000 Response Time (avg) 4.04s
#447	Jev 1.14 default	Typesafe	0.2	0.2	$0.003	0/1	543ms
Total Tests 1 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 543ms
#446	Kev 4B default	Jaredpalmer	0.2	0.2	$0.002	0/1	17.3s
Total Tests 1 Wrong Tests 1 Total Cost $0.002 Response Time (avg) 17.3s
#445	GPT-6 Luna Decisions default	OpenAI	0.2	0.2	$0.005	0/1	842ms
Total Tests 1 Wrong Tests 1 Total Cost $0.005 Response Time (avg) 842ms

Instructions following Ranking

Filter models

Top Models by Instructions following Score

Instructions following Score vs Total Cost

Top Models by Response Time (avg)