Domain specific x Wrong answer Ranking

See which AI models are most likely to hit Wrong answer on Domain specific, so you can spot weak points faster. Sort by: Response Time (avg) ↓.

Models Shown

Total Failures

421

Most Affected Model

Failure Reasons

Wrong answer421 Timed out43 Extra formatting17 No answer8 API error7 Did not follow instructions1

Categories

Domain specific421 Anti-AI Tricks293 Coding259 Puzzle Solving204 Trivia172 Combined69 General Intelligence62 Instructions following61 Data parsing and extraction41 Tool Calling3

202/202

Rank	Model	Company	Wrong answer Count	Category Score	Total Cost	Tests Correct	Response Time (avg)
#211	Laguna Xs.2 none	Poolside	2	5.3	$0.004	1/3	371ms
Total Tests 3 Wrong Tests 2 Total Cost $0.004 Response Time (avg) 371ms
#171	Mistral Small 4 none	Mistral	2	5.3	$0.022	1/3	367ms
Total Tests 3 Wrong Tests 2 Total Cost $0.022 Response Time (avg) 367ms
#166	Laguna XS 2.1 none	Poolside	2	5.3	$0.008	1/3	364ms
Total Tests 3 Wrong Tests 2 Total Cost $0.008 Response Time (avg) 364ms
#207	Granite 4.1 8B none	IBM Granite	3	3.0	$0.007	0/3	357ms
Total Tests 3 Wrong Tests 3 Total Cost $0.007 Response Time (avg) 357ms
#216	LFM2-24B-A2B none	Liquid	1	5.9	$0.001	1/3	287ms
Total Tests 3 Wrong Tests 2 Total Cost $0.001 Response Time (avg) 287ms
#44	Claude Sonnet 4.6 medium	Anthropic	1	2.9	$2.057	0/3	0ms
Total Tests 3 Wrong Tests 3 Total Cost $2.057 Response Time (avg) 0ms
#46	GLM 5 medium	Z.ai	2	3.5	$0.307	0/3	0ms
Total Tests 3 Wrong Tests 3 Total Cost $0.307 Response Time (avg) 0ms

Filter models