Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one.

Models Shown

Total Failures

3190

Most Affected Model

Categories

In category Domain specific900 In category Anti-AI Tricks521 In category Coding485 In category Puzzle Solving355 In category Trivia317 In category General Intelligence134 In category Combined130 In category Agentic128 In category Instructions following118 In category Data parsing and extraction93

447/447

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#116	Gemini 3.8 Flash medium	Google	2	0.8	$0.769	19/23	16.6s
Total Tests 23 Wrong Tests 4 Total Cost $0.769 Response Time (avg) 16.6s
#120	GLM 5.3 FlashX max	Z.ai	2	0.8	$0.623	15/23	44.0s
Total Tests 23 Wrong Tests 8 Total Cost $0.623 Response Time (avg) 44.0s
#127	Muse Wonder max	Meta	2	0.8	$4.766	16/23	44.4s
Total Tests 23 Wrong Tests 7 Total Cost $4.766 Response Time (avg) 44.4s
#128	Ling 3.1 Flash high	Inclusionai	2	0.8	$0.000	15/23	87.4s
Total Tests 23 Wrong Tests 8 Total Cost $0.000 Response Time (avg) 87.4s
#137	Muse Wonder high	Meta	2	0.8	$3.426	15/23	23.0s
Total Tests 23 Wrong Tests 8 Total Cost $3.426 Response Time (avg) 23.0s
#163	Gemma 4 26B A4B medium	Google	2	0.7	$0.101	16/23	105.0s
Total Tests 23 Wrong Tests 7 Total Cost $0.101 Response Time (avg) 105.0s
#199	Ember-1 high	Fireworks	2	0.7	$2.405	12/23	58.1s
Total Tests 23 Wrong Tests 11 Total Cost $2.405 Response Time (avg) 58.1s
#215	Grok 4.7 high	X AI	2	0.7	$3.037	13/23	122.2s
Total Tests 23 Wrong Tests 10 Total Cost $3.037 Response Time (avg) 122.2s
#263	Ling 3.1 Flash low	Inclusionai	2	0.6	$0.000	12/23	85.2s
Total Tests 23 Wrong Tests 11 Total Cost $0.000 Response Time (avg) 85.2s
#314	Step 5 Preview low	Stepfun	2	0.6	$4.110	10/23	138.3s
Total Tests 23 Wrong Tests 13 Total Cost $4.110 Response Time (avg) 138.3s
#395	Gemini 3.1 Flash Lite Preview high	Google	2	0.4	$2.310	13/16	68.1s
Total Tests 16 Wrong Tests 3 Total Cost $2.310 Response Time (avg) 68.1s
#401	Qwen3.6 Plus Preview medium	Qwen	2	0.4	$0.000	9/19	15.2s
Total Tests 19 Wrong Tests 10 Total Cost $0.000 Response Time (avg) 15.2s
#402	Qwen3.5-9B medium	Qwen	2	0.4	$0.106	3/23	110.2s
Total Tests 23 Wrong Tests 20 Total Cost $0.106 Response Time (avg) 110.2s
#1	Gemini 3.6 Flash high	Google	1	1.0	$0.900	22/23	18.9s
Total Tests 23 Wrong Tests 1 Total Cost $0.900 Response Time (avg) 18.9s
#3	GPT-6 Sol high	OpenAI	1	1.0	$0.921	22/23	23.6s
Total Tests 23 Wrong Tests 1 Total Cost $0.921 Response Time (avg) 23.6s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)