Coding x Extra formatting Ranking

See which AI models are most likely to hit Extra formatting on Coding, so you can spot weak points faster.

Models Shown

Total Failures

Most Affected Model

Failure Reasons

Wrong answer456 API error64 Did not follow instructions41 No answer41 Extra formatting36 Timed out24

Categories

Coding36 Domain specific36 Anti-AI Tricks33 Puzzle Solving16 Data parsing and extraction12 Instructions following8 Combined1

33/33

Rank	Model	Company	Extra formatting Count	Category Score	Total Cost	Tests Correct	Response Time (avg)
#347	Owl Alpha default	Openrouter	1	0.6	$0.000	1/3	36.9s
Total Tests 3 Wrong Tests 2 Total Cost $0.000 Response Time (avg) 36.9s
#351	Mimo V2 Omni default	Xiaomi	1	0.4	$0.021	0/3	2.75s
Total Tests 3 Wrong Tests 3 Total Cost $0.021 Response Time (avg) 2.75s
#371	Granite 4.1 8b default	IBM Granite	1	0.4	$0.007	0/3	775ms
Total Tests 3 Wrong Tests 3 Total Cost $0.007 Response Time (avg) 775ms

Filter models