Domain specific x Wrong answer Ranking

See which AI models are most likely to hit Wrong answer on Domain specific, so you can spot weak points faster.

Models Shown

Total Failures

878

Most Affected Model

Failure Reasons

Wrong answer878 No answer63 Timed out46 API error40 Extra formatting36 Did not follow instructions3

Categories

Domain specific878 Anti-AI Tricks502 Coding477 Puzzle Solving344 Trivia306 General Intelligence129 Agentic126 Combined126 Instructions following111 Data parsing and extraction93

414/414

Rank	Model	Company	Wrong answer Count	Category Score	Total Cost	Tests Correct	Response Time (avg)
#392	Hunter Alpha medium	OpenRouter	1	0.3	$0.000	0/3	10.5s
Total Tests 3 Wrong Tests 3 Total Cost $0.000 Response Time (avg) 10.5s
#393	Grok 4.1 Fast medium	X AI	1	0.6	$0.069	1/3	121.8s
Total Tests 3 Wrong Tests 2 Total Cost $0.069 Response Time (avg) 121.8s
#398	Xing4.0 29b A4b medium	Xingchen AGI	1	0.4	$0.000	0/3	381.9s
Total Tests 3 Wrong Tests 3 Total Cost $0.000 Response Time (avg) 381.9s
#423	Jev 1.13 default	Typesafe	1	0.8	$0.003	2/3	632ms
Total Tests 3 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 632ms
#424	Decider V1.2 default	Perplexity	1	0.6	$0.001	1/3	541ms
Total Tests 3 Wrong Tests 2 Total Cost $0.001 Response Time (avg) 541ms
#429	Jev 1.14 default	Typesafe	1	0.8	$0.003	2/3	444ms
Total Tests 3 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 444ms
#436	LFM2-24B-A2B default	Liquid	1	0.6	$0.001	1/3	287ms
Total Tests 3 Wrong Tests 2 Total Cost $0.001 Response Time (avg) 287ms
#437	Solar Decide Flash default	Upstage	1	0.4	$0.003	1/2	1.11s
Total Tests 2 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 1.11s
#439	Solar Decide default	Upstage	1	0.4	$0.009	1/2	7.26s
Total Tests 2 Wrong Tests 1 Total Cost $0.009 Response Time (avg) 7.26s

Filter models