Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one.

Models Shown

Total Failures

3207

Most Affected Model

Categories

In category Domain specific907 In category Anti-AI Tricks521 In category Coding486 In category Puzzle Solving357 In category Trivia323 In category General Intelligence134 In category Combined131 In category Agentic128 In category Instructions following118 In category Data parsing and extraction93

453/453

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#180	Gemini 3.8 Flash low	Google	6	0.7	$0.323	16/23	7.54s
Total Tests 23 Wrong Tests 7 Total Cost $0.323 Response Time (avg) 7.54s
#188	Qwen3.8 Flash Next xhigh	Qwen	6	0.7	~$0.195	14/23	102.7s
Total Tests 23 Wrong Tests 9 Total Cost ~$0.195 Response Time (avg) 102.7s
#193	GPT-5.2 Chat default	OpenAI	6	0.7	$0.594	13/23	7.43s
Total Tests 23 Wrong Tests 10 Total Cost $0.594 Response Time (avg) 7.43s
#202	Muse Glimmer 30B low	Meta	6	0.7	$0.219	11/23	22.4s
Total Tests 23 Wrong Tests 12 Total Cost $0.219 Response Time (avg) 22.4s
#218	Grok Build 0.1 medium	X AI	6	0.7	$1.419	13/23	55.1s
Total Tests 23 Wrong Tests 10 Total Cost $1.419 Response Time (avg) 55.1s
#224	GPT 5.3 Chat default	OpenAI	6	0.7	$0.533	13/23	6.31s
Total Tests 23 Wrong Tests 10 Total Cost $0.533 Response Time (avg) 6.31s
#234	Beam 1.0 501B A23B medium	Reflection	6	0.7	$0.499	14/23	6.27s
Total Tests 23 Wrong Tests 9 Total Cost $0.499 Response Time (avg) 6.27s
#238	Qwen3.6 35B A3B medium	Qwen	6	0.7	$0.834	12/23	59.9s
Total Tests 23 Wrong Tests 11 Total Cost $0.834 Response Time (avg) 59.9s
#239	Mercury 2.5 Preview high	Inception	6	0.6	$0.040	12/23	7.61s
Total Tests 23 Wrong Tests 11 Total Cost $0.040 Response Time (avg) 7.61s
#245	Grok 4.3 medium	X AI	6	0.6	$0.989	12/23	44.5s
Total Tests 23 Wrong Tests 11 Total Cost $0.989 Response Time (avg) 44.5s
#249	Beam 1.0 501B A23B max	Reflection	6	0.6	$0.799	12/23	11.1s
Total Tests 23 Wrong Tests 11 Total Cost $0.799 Response Time (avg) 11.1s
#250	Solar Pro 4 medium	Upstage	6	0.6	$0.098	12/23	133.9s
Total Tests 23 Wrong Tests 11 Total Cost $0.098 Response Time (avg) 133.9s
#254	Beam 1.0 501B A23B low	Reflection	6	0.6	$0.432	11/23	4.89s
Total Tests 23 Wrong Tests 12 Total Cost $0.432 Response Time (avg) 4.89s
#267	Solar Pro 4 high	Upstage	6	0.6	$0.077	11/23	128.9s
Total Tests 23 Wrong Tests 12 Total Cost $0.077 Response Time (avg) 128.9s
#272	DeepSeek V3.2 medium	DeepSeek	6	0.6	$0.152	11/23	70.1s
Total Tests 23 Wrong Tests 12 Total Cost $0.152 Response Time (avg) 70.1s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)