Domain specific x Wrong answer Ranking

See which AI models are most likely to hit Wrong answer on Domain specific, so you can spot weak points faster. Sort by: Response Time (avg) ↑.

Models Shown

Total Failures

412

Most Affected Model

Failure Reasons

Wrong answer412 Timed out43 Extra formatting17 No answer8 API error7 Did not follow instructions1

Categories

Domain specific412 Anti-AI Tricks293 Coding252 Puzzle Solving201 Trivia168 Combined68 Instructions following61 General Intelligence59 Data parsing and extraction41 Tool Calling3

198/198

Rank	Model	Company	Wrong answer Count	Category Score	Total Cost	Tests Correct	Response Time (avg)
#12	Grok 4.5 high	X AI	2	3.6	$1.707	0/3	332.1s
Total Tests 3 Wrong Tests 3 Total Cost $1.707 Response Time (avg) 332.1s
#60	LongCat 2.0 medium	Meituan	2	2.9	$0.478	0/3	339.9s
Total Tests 3 Wrong Tests 3 Total Cost $0.478 Response Time (avg) 339.9s
#97	LongCat 2.0 high	Meituan	1	3.6	$0.469	0/3	400.3s
Total Tests 3 Wrong Tests 3 Total Cost $0.469 Response Time (avg) 400.3s

Filter models