Domain specific x Wrong answer Ranking

See which AI models are most likely to hit Wrong answer on Domain specific, so you can spot weak points faster.

Models Shown

Total Failures

893

Most Affected Model

Failure Reasons

Wrong answer893 No answer66 Timed out46 API error40 Extra formatting36 Did not follow instructions3

Categories

Domain specific893 Anti-AI Tricks519 Coding484 Puzzle Solving352 Trivia315 General Intelligence134 Agentic128 Combined128 Instructions following117 Data parsing and extraction93

423/423

Rank	Model	Company	Wrong answer Count	Category Score	Total Cost	Tests Correct	Response Time (avg)
#445	LFM2-24B-A2B default	Liquid	1	0.6	$0.001	1/3	287ms
Total Tests 3 Wrong Tests 2 Total Cost $0.001 Response Time (avg) 287ms
#446	Solar Decide Flash default	Upstage	1	0.4	$0.003	1/2	1.11s
Total Tests 2 Wrong Tests 1 Total Cost $0.003 Response Time (avg) 1.11s
#448	Solar Decide default	Upstage	1	0.4	$0.009	1/2	7.26s
Total Tests 2 Wrong Tests 1 Total Cost $0.009 Response Time (avg) 7.26s

Filter models