Domain specific x Wrong answer Ranking

See which AI models are most likely to hit Wrong answer on Domain specific, so you can spot weak points faster. Sort by: Total Cost ↑.

Models Shown

Total Failures

412

Most Affected Model

Failure Reasons

Wrong answer412 Timed out43 Extra formatting17 No answer8 API error7 Did not follow instructions1

Categories

Domain specific412 Anti-AI Tricks293 Coding252 Puzzle Solving201 Trivia168 Combined68 Instructions following61 General Intelligence59 Data parsing and extraction41 Tool Calling3

198/198

Rank	Model	Company	Wrong answer Count	Category Score	Total Cost	Tests Correct	Response Time (avg)
#17	Claude Fable 5 medium	Anthropic	2	5.3	$3.478	1/3	53.4s
Total Tests 3 Wrong Tests 2 Total Cost $3.478 Response Time (avg) 53.4s
#10	GPT-5.5 medium	OpenAI	2	5.3	$4.137	1/3	164.1s
Total Tests 3 Wrong Tests 2 Total Cost $4.137 Response Time (avg) 164.1s
#181	Grok 4.20 Multi Agent Beta medium	X AI	2	2.9	$5.599	0/3	24.7s
Total Tests 3 Wrong Tests 3 Total Cost $5.599 Response Time (avg) 24.7s

Filter models