Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Response Time (avg) ↑.

Models Shown

Total Failures

1585

Most Affected Model

Categories

In category Domain specific421 In category Anti-AI Tricks293 In category Coding259 In category Puzzle Solving204 In category Trivia172 In category Combined69 In category General Intelligence62 In category Instructions following61 In category Data parsing and extraction41 In category Tool Calling3

215/215

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#64	LongCat 2.0 medium	Meituan	7	7.4	$0.478	12/22	136.6s
Total Tests 22 Wrong Tests 10 Total Cost $0.478 Response Time (avg) 136.6s
#143	North Mini Code medium	Cohere	9	5.9	$0.000	9/22	137.1s
Total Tests 22 Wrong Tests 13 Total Cost $0.000 Response Time (avg) 137.1s
#200	GLM 4.7 Flash medium	Z.ai	9	4.3	$0.166	4/22	142.6s
Total Tests 22 Wrong Tests 18 Total Cost $0.166 Response Time (avg) 142.6s
#102	LongCat 2.0 high	Meituan	6	6.6	$0.469	9/22	148.7s
Total Tests 22 Wrong Tests 13 Total Cost $0.469 Response Time (avg) 148.7s
#136	Step 3.5 Flash medium	Stepfun	4	6.0	$0.108	11/21	174.2s
Total Tests 21 Wrong Tests 10 Total Cost $0.108 Response Time (avg) 174.2s

←

1 14 15

Wrong answer Failures