Domain specific x Wrong answer Ranking

See which AI models are most likely to hit Wrong answer on Domain specific, so you can spot weak points faster. Sort by: Response Time (avg) ↓.

Models Shown

Total Failures

878

Most Affected Model

Failure Reasons

Wrong answer878 No answer63 Timed out46 API error40 Extra formatting36 Did not follow instructions3

Categories

Domain specific878 Anti-AI Tricks502 Coding477 Puzzle Solving344 Trivia306 General Intelligence129 Agentic126 Combined126 Instructions following111 Data parsing and extraction93

414/414

Rank	Model	Company	Wrong answer Count	Category Score	Total Cost	Tests Correct	Response Time (avg)
#335	Mistral Small 4 none	Mistral	2	0.5	$0.047	1/3	377ms
Total Tests 3 Wrong Tests 2 Total Cost $0.047 Response Time (avg) 377ms
#416	Laguna Xs.2 default	Poolside	2	0.5	$0.004	1/3	371ms
Total Tests 3 Wrong Tests 2 Total Cost $0.004 Response Time (avg) 371ms
#361	Laguna S 2.1 none	Poolside	3	0.3	$0.044	0/3	337ms
Total Tests 3 Wrong Tests 3 Total Cost $0.044 Response Time (avg) 337ms
#425	Decider V1.1 27B default	Perplexity	2	0.5	$0.002	1/3	313ms
Total Tests 3 Wrong Tests 2 Total Cost $0.002 Response Time (avg) 313ms
#326	Laguna XS 2.1 none	Poolside	2	0.5	$0.020	1/3	303ms
Total Tests 3 Wrong Tests 2 Total Cost $0.020 Response Time (avg) 303ms
#396	Granite 4.1 8b default	IBM Granite	3	0.3	$0.007	0/3	287ms
Total Tests 3 Wrong Tests 3 Total Cost $0.007 Response Time (avg) 287ms
#436	LFM2-24B-A2B default	Liquid	1	0.6	$0.001	1/3	287ms
Total Tests 3 Wrong Tests 2 Total Cost $0.001 Response Time (avg) 287ms
#441	Nimble v3 9B default	Bespoke Labs	2	0.2	~$0.001	0/2	80ms
Total Tests 2 Wrong Tests 2 Total Cost ~$0.001 Response Time (avg) 80ms
#172	GLM 5 medium	Z.ai	2	0.3	$0.479	0/3	0ms
Total Tests 3 Wrong Tests 3 Total Cost $0.479 Response Time (avg) 0ms

Filter models