Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↑.

Models Shown

Total Failures

3190

Most Affected Model

Ling 3.1 Flash 3

Categories

In category Domain specific900 In category Anti-AI Tricks521 In category Coding485 In category Puzzle Solving355 In category Trivia317 In category General Intelligence134 In category Combined130 In category Agentic128 In category Instructions following118 In category Data parsing and extraction93

447/447

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#395	Gemini 3.1 Flash Lite Preview high	Google	2	0.4	$2.310	13/16	68.1s
Total Tests 16 Wrong Tests 3 Total Cost $2.310 Response Time (avg) 68.1s
#203	Claude Opus 4.8 none	Anthropic	5	0.7	$2.334	13/23	7.54s
Total Tests 23 Wrong Tests 10 Total Cost $2.334 Response Time (avg) 7.54s
#51	Claude Opus 5 low	Anthropic	4	0.9	$2.350	19/23	9.87s
Total Tests 23 Wrong Tests 4 Total Cost $2.350 Response Time (avg) 9.87s
#199	Ember-1 high	Fireworks	2	0.7	$2.405	12/23	58.1s
Total Tests 23 Wrong Tests 11 Total Cost $2.405 Response Time (avg) 58.1s
#90	Muse Spark 1.1 high	Meta	3	0.8	$2.570	13/23	37.4s
Total Tests 23 Wrong Tests 10 Total Cost $2.570 Response Time (avg) 37.4s
#79	Grok 4.6 high	X AI	3	0.9	$2.629	19/23	87.5s
Total Tests 23 Wrong Tests 4 Total Cost $2.629 Response Time (avg) 87.5s
#41	Muse Wonder low	Meta	4	0.9	$2.637	17/23	16.0s
Total Tests 23 Wrong Tests 6 Total Cost $2.637 Response Time (avg) 16.0s
#103	Grok 4.5 high	X AI	3	0.8	$2.687	17/23	72.5s
Total Tests 23 Wrong Tests 6 Total Cost $2.687 Response Time (avg) 72.5s
#21	GPT-6 Astra medium	OpenAI	3	0.9	$2.707	20/23	9.90s
Total Tests 23 Wrong Tests 3 Total Cost $2.707 Response Time (avg) 9.90s
#95	Gemini 3.5 Flash high	Google	2	0.8	$2.737	19/23	18.6s
Total Tests 23 Wrong Tests 4 Total Cost $2.737 Response Time (avg) 18.6s
#181	Claude Opus 5 none	Anthropic	7	0.7	$2.766	12/23	10.8s
Total Tests 23 Wrong Tests 11 Total Cost $2.766 Response Time (avg) 10.8s
#28	Claude Opus 5 medium	Anthropic	3	0.9	$2.870	19/23	13.2s
Total Tests 23 Wrong Tests 4 Total Cost $2.870 Response Time (avg) 13.2s
#166	Grok 4.7 medium	X AI	5	0.7	$2.938	15/23	117.7s
Total Tests 23 Wrong Tests 8 Total Cost $2.938 Response Time (avg) 117.7s
#125	Qwen3.8 2.4T A95B high	Qwen	4	0.8	$2.949	15/23	120.9s
Total Tests 23 Wrong Tests 8 Total Cost $2.949 Response Time (avg) 120.9s
#264	Claude Opus 4.6 medium	Anthropic	4	0.6	$2.961	13/22	32.2s
Total Tests 22 Wrong Tests 9 Total Cost $2.961 Response Time (avg) 32.2s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)