Domain specific x Wrong answer Ranking

See which AI models are most likely to hit Wrong answer on Domain specific, so you can spot weak points faster.

Models Shown

Total Failures

412

Most Affected Model

Failure Reasons

Wrong answer412 Timed out43 Extra formatting17 No answer8 API error7 Did not follow instructions1

Categories

Domain specific412 Anti-AI Tricks293 Coding252 Puzzle Solving201 Trivia168 Combined68 Instructions following61 General Intelligence59 Data parsing and extraction41 Tool Calling3

198/198

Rank	Model	Company	Wrong answer Count	Category Score	Total Cost	Tests Correct	Response Time (avg)
#184	Hunter Alpha medium	OpenRouter	1	3.0	$0.000	0/3	10.5s
Total Tests 3 Wrong Tests 3 Total Cost $0.000 Response Time (avg) 10.5s
#185	Grok 4.1 Fast medium	X AI	1	5.8	$0.069	1/3	121.8s
Total Tests 3 Wrong Tests 2 Total Cost $0.069 Response Time (avg) 121.8s
#210	LFM2-24B-A2B none	Liquid	1	5.9	$0.001	1/3	287ms
Total Tests 3 Wrong Tests 2 Total Cost $0.001 Response Time (avg) 287ms

Filter models