Domain specific x Wrong answer Ranking

See which AI models are most likely to hit Wrong answer on Domain specific, so you can spot weak points faster. Sort by: Tests Correct ↓.

Models Shown

Total Failures

893

Most Affected Model

Failure Reasons

Wrong answer893 No answer66 Timed out46 API error40 Extra formatting36 Did not follow instructions3

Categories

Domain specific893 Anti-AI Tricks519 Coding484 Puzzle Solving352 Trivia315 General Intelligence134 Agentic128 Combined128 Instructions following117 Data parsing and extraction93

423/423

Rank	Model	Company	Wrong answer Count	Category Score	Total Cost	Tests Correct	Response Time (avg)
#443	D1 default	Liquid	3	0.4	$0.003	0/3	555ms
Total Tests 3 Wrong Tests 3 Total Cost $0.003 Response Time (avg) 555ms
#447	Microsoft-Decision-1 default	Microsoft	3	0.3	$0.002	0/3	1.03s
Total Tests 3 Wrong Tests 3 Total Cost $0.002 Response Time (avg) 1.03s
#450	Nimble v3 9B default	Bespoke Labs	2	0.2	~$0.001	0/2	80ms
Total Tests 2 Wrong Tests 2 Total Cost ~$0.001 Response Time (avg) 80ms

Filter models