Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one.

Models Shown

Total Failures

3207

Most Affected Model

Categories

In category Domain specific907 In category Anti-AI Tricks521 In category Coding486 In category Puzzle Solving357 In category Trivia323 In category General Intelligence134 In category Combined131 In category Agentic128 In category Instructions following118 In category Data parsing and extraction93

453/453

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#145	Muse Glimmer 30B high	Meta	7	0.8	$0.506	11/23	69.9s
Total Tests 23 Wrong Tests 12 Total Cost $0.506 Response Time (avg) 69.9s
#149	Qwen3.7 Flash low	Qwen	7	0.8	$0.071	12/23	41.0s
Total Tests 23 Wrong Tests 11 Total Cost $0.071 Response Time (avg) 41.0s
#153	GPT-6 Luna low	OpenAI	7	0.8	$0.033	12/23	23.2s
Total Tests 23 Wrong Tests 11 Total Cost $0.033 Response Time (avg) 23.2s
#174	LongCat 2.0 high	Meituan	7	0.7	$0.778	10/23	151.7s
Total Tests 23 Wrong Tests 13 Total Cost $0.778 Response Time (avg) 151.7s
#187	Claude Opus 5 none	Anthropic	7	0.7	$2.766	12/23	10.8s
Total Tests 23 Wrong Tests 11 Total Cost $2.766 Response Time (avg) 10.8s
#195	Gemini 3.1 Flash Lite Preview medium	Google	7	0.7	$0.158	14/23	6.78s
Total Tests 23 Wrong Tests 9 Total Cost $0.158 Response Time (avg) 6.78s
#201	Gemini 3 Flash Preview low	Google	7	0.7	$0.254	16/23	8.51s
Total Tests 23 Wrong Tests 7 Total Cost $0.254 Response Time (avg) 8.51s
#220	Solar Pro 4 low	Upstage	7	0.7	$0.101	11/23	145.2s
Total Tests 23 Wrong Tests 12 Total Cost $0.101 Response Time (avg) 145.2s
#256	Gemini 3.5 Flash minimal	Google	7	0.6	$0.508	13/23	4.67s
Total Tests 23 Wrong Tests 10 Total Cost $0.508 Response Time (avg) 4.67s
#264	Gemini 3.1 Flash Lite Preview low	Google	7	0.6	$0.736	14/23	19.0s
Total Tests 23 Wrong Tests 9 Total Cost $0.736 Response Time (avg) 19.0s
#273	Trinity Large Thinking low	Arcee AI	7	0.6	$0.918	8/23	95.2s
Total Tests 23 Wrong Tests 15 Total Cost $0.918 Response Time (avg) 95.2s
#275	Grok 4.20 medium	X AI	7	0.6	$1.246	11/23	36.7s
Total Tests 23 Wrong Tests 12 Total Cost $1.246 Response Time (avg) 36.7s
#283	Beam 1.0 501B A23B high	Reflection	7	0.6	$0.674	11/23	9.03s
Total Tests 23 Wrong Tests 12 Total Cost $0.674 Response Time (avg) 9.03s
#308	Ling 3.0 Flash high	Inclusionai	7	0.6	$0.021	12/23	13.1s
Total Tests 23 Wrong Tests 11 Total Cost $0.021 Response Time (avg) 13.1s
#330	GLM 5V Turbo medium	Z.ai	7	0.5	$0.457	11/21	23.1s
Total Tests 21 Wrong Tests 10 Total Cost $0.457 Response Time (avg) 23.1s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)