Instructions following Model Ranking

See which AI models perform best on Instructions following, which ones stay reliable, and where the biggest gaps appear. Sort by: Tests Correct ↑.

Models Shown

Average Instructions following Score

0.8

Best Model

Minimax M3.1 Flash 0.5

Failure Reasons

With failure reason Wrong answer118 With failure reason Did not follow instructions82 With failure reason API error25 With failure reason Extra formatting8 With failure reason Timed out5 With failure reason No answer2

461/461

Rank	Model	Company	Instructions following Score	Score	Total Cost	Tests Correct	Response Time (avg)
#223	Ember-1 max	Fireworks	0.6	0.7	$3.264	1/2	33.0s
Total Tests 2 Wrong Tests 1 Total Cost $3.264 Response Time (avg) 33.0s
#225	GPT-5.6 Sol none	OpenAI	0.9	0.7	$0.795	1/2	1.33s
Total Tests 2 Wrong Tests 1 Total Cost $0.795 Response Time (avg) 1.33s
#226	Apodex 1.1 Mini high	Apodex	0.8	0.7	$0.000	1/2	8.10s
Total Tests 2 Wrong Tests 1 Total Cost $0.000 Response Time (avg) 8.10s
#228	GPT-5.5 none	OpenAI	0.6	0.7	$1.212	1/2	1.15s
Total Tests 2 Wrong Tests 1 Total Cost $1.212 Response Time (avg) 1.15s
#231	LongCat 2.0 low	Meituan	0.7	0.7	$0.630	1/2	6.39s
Total Tests 2 Wrong Tests 1 Total Cost $0.630 Response Time (avg) 6.39s
#236	Claude Sonnet 5.5 medium	Anthropic	0.6	0.7	$1.100	1/2	1.88s
Total Tests 2 Wrong Tests 1 Total Cost $1.100 Response Time (avg) 1.88s
#240	Mercury 2.5 high	Inception	0.7	0.6	$0.044	1/2	934ms
Total Tests 2 Wrong Tests 1 Total Cost $0.044 Response Time (avg) 934ms
#247	Qwen3.5-122B-A10B none	Qwen	0.6	0.6	$0.308	1/2	513ms
Total Tests 2 Wrong Tests 1 Total Cost $0.308 Response Time (avg) 513ms
#248	Gemini 3 Flash Preview none	Google	0.6	0.6	$0.155	1/2	1.58s
Total Tests 2 Wrong Tests 1 Total Cost $0.155 Response Time (avg) 1.58s
#249	Beam 1.0 501B A23B max	Reflection	0.8	0.6	$0.799	1/2	866ms
Total Tests 2 Wrong Tests 1 Total Cost $0.799 Response Time (avg) 866ms
#254	Beam 1.0 501B A23B low	Reflection	0.8	0.6	$0.432	1/2	1.14s
Total Tests 2 Wrong Tests 1 Total Cost $0.432 Response Time (avg) 1.14s
#255	Mercury 2.5 medium	Inception	0.6	0.6	$0.034	1/2	1.07s
Total Tests 2 Wrong Tests 1 Total Cost $0.034 Response Time (avg) 1.07s
#256	Gemini 3.5 Flash minimal	Google	0.6	0.6	$0.508	1/2	893ms
Total Tests 2 Wrong Tests 1 Total Cost $0.508 Response Time (avg) 893ms
#258	Dots 3 Note Preview high	Dots Studio	0.8	0.6	$0.000	1/2	7.80s
Total Tests 2 Wrong Tests 1 Total Cost $0.000 Response Time (avg) 7.80s
#259	Dots 3 Note Preview low	Dots Studio	0.8	0.6	$0.000	1/2	7.83s
Total Tests 2 Wrong Tests 1 Total Cost $0.000 Response Time (avg) 7.83s

Instructions following Ranking

Filter models

Top Models by Instructions following Score

Instructions following Score vs Total Cost

Top Models by Response Time (avg)