Domain specific x Wrong answer Ranking

See which AI models are most likely to hit Wrong answer on Domain specific, so you can spot weak points faster. Sort by: Tests Correct ↓.

Models Shown

Total Failures

878

Most Affected Model

Failure Reasons

Wrong answer878 No answer63 Timed out46 API error40 Extra formatting36 Did not follow instructions3

Categories

Domain specific878 Anti-AI Tricks502 Coding477 Puzzle Solving344 Trivia306 General Intelligence129 Agentic126 Combined126 Instructions following111 Data parsing and extraction93

414/414

Rank	Model	Company	Wrong answer Count	Category Score	Total Cost	Tests Correct	Response Time (avg)
#410	Hy3 preview none	Tencent	2	0.4	$0.007	0/3	17.6s
Total Tests 3 Wrong Tests 3 Total Cost $0.007 Response Time (avg) 17.6s
#412	Xing4.0 29b A4b none	Xingchen AGI	3	0.3	$0.000	0/3	5.73s
Total Tests 3 Wrong Tests 3 Total Cost $0.000 Response Time (avg) 5.73s
#413	Grok Build 0.1 none	X AI	2	0.4	$0.547	0/3	103.7s
Total Tests 3 Wrong Tests 3 Total Cost $0.547 Response Time (avg) 103.7s
#420	Nemotron 3 Nano Omni 30b A3b Reasoning medium	NVIDIA	2	0.3	$0.000	0/3	56.7s
Total Tests 3 Wrong Tests 3 Total Cost $0.000 Response Time (avg) 56.7s
#422	Nemotron 3 Nano Omni 30b A3b Reasoning default	NVIDIA	3	0.4	$0.000	0/3	489ms
Total Tests 3 Wrong Tests 3 Total Cost $0.000 Response Time (avg) 489ms
#431	Clef Omni default	Cloudflare	3	0.3	$0.011	0/3	1.05s
Total Tests 3 Wrong Tests 3 Total Cost $0.011 Response Time (avg) 1.05s
#434	D1 default	Liquid	3	0.4	$0.003	0/3	555ms
Total Tests 3 Wrong Tests 3 Total Cost $0.003 Response Time (avg) 555ms
#438	Microsoft-Decision-1 default	Microsoft	3	0.3	$0.002	0/3	1.03s
Total Tests 3 Wrong Tests 3 Total Cost $0.002 Response Time (avg) 1.03s
#441	Nimble v3 9B default	Bespoke Labs	2	0.2	~$0.001	0/2	80ms
Total Tests 2 Wrong Tests 2 Total Cost ~$0.001 Response Time (avg) 80ms

Filter models