Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↑.

Models Shown

Total Failures

3190

Most Affected Model

Command A+ 1

Categories

In category Domain specific900 In category Anti-AI Tricks521 In category Coding485 In category Puzzle Solving355 In category Trivia317 In category General Intelligence134 In category Combined130 In category Agentic128 In category Instructions following118 In category Data parsing and extraction93

447/447

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#160	Inkling Small high	Thinkingmachines	6	0.7	$0.398	14/23	29.1s
Total Tests 23 Wrong Tests 9 Total Cost $0.398 Response Time (avg) 29.1s
#170	Gemini 3.5 Flash Lite medium	Google	6	0.7	$0.440	14/23	8.68s
Total Tests 23 Wrong Tests 9 Total Cost $0.440 Response Time (avg) 8.68s
#172	Qwen3.5 Plus 2026-02-15 medium	Qwen	6	0.7	$0.567	14/23	97.7s
Total Tests 23 Wrong Tests 9 Total Cost $0.567 Response Time (avg) 97.7s
#173	Qwen3.8 27B medium	Qwen	4	0.7	~$0.073	14/23	40.1s
Total Tests 23 Wrong Tests 9 Total Cost ~$0.073 Response Time (avg) 40.1s
#182	Qwen3.8 Flash Next xhigh	Qwen	6	0.7	~$0.195	14/23	102.7s
Total Tests 23 Wrong Tests 9 Total Cost ~$0.195 Response Time (avg) 102.7s
#189	Gemini 3.1 Flash Lite Preview medium	Google	7	0.7	$0.158	14/23	6.78s
Total Tests 23 Wrong Tests 9 Total Cost $0.158 Response Time (avg) 6.78s
#193	Qwen3.5-122B-A10B medium	Qwen	5	0.7	$1.152	14/23	67.0s
Total Tests 23 Wrong Tests 9 Total Cost $1.152 Response Time (avg) 67.0s
#200	Gemma 4 31B medium	Google	4	0.7	$0.144	14/23	78.8s
Total Tests 23 Wrong Tests 9 Total Cost $0.144 Response Time (avg) 78.8s
#211	Grok 4.7 xhigh	X AI	3	0.7	$3.398	14/23	124.0s
Total Tests 23 Wrong Tests 9 Total Cost $3.398 Response Time (avg) 124.0s
#228	Beam 1.0 501B A23B medium	Reflection	6	0.7	$0.499	14/23	6.27s
Total Tests 23 Wrong Tests 9 Total Cost $0.499 Response Time (avg) 6.27s
#258	Gemini 3.1 Flash Lite Preview low	Google	7	0.6	$0.736	14/23	19.0s
Total Tests 23 Wrong Tests 9 Total Cost $0.736 Response Time (avg) 19.0s
#276	Gemini 3.5 Flash none	Google	4	0.6	$1.752	14/23	14.1s
Total Tests 23 Wrong Tests 9 Total Cost $1.752 Response Time (avg) 14.1s
#245	Claude Sonnet 4.6 medium	Anthropic	4	0.6	$2.126	14/22	28.1s
Total Tests 22 Wrong Tests 8 Total Cost $2.126 Response Time (avg) 28.1s
#55	Muse Spark 1.2 high	Meta	4	0.9	$2.018	15/23	28.1s
Total Tests 23 Wrong Tests 8 Total Cost $2.018 Response Time (avg) 28.1s
#56	Muse Spark 1.2 medium	Meta	3	0.9	$1.590	15/23	21.3s
Total Tests 23 Wrong Tests 8 Total Cost $1.590 Response Time (avg) 21.3s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)