Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Total Cost ↑.

Models Shown

Total Failures

1680

Most Affected Model

Ling 3.0 Flash 8

Categories

In category Domain specific449 In category Anti-AI Tricks312 In category Coding272 In category Puzzle Solving216 In category Trivia179 In category Combined72 In category General Intelligence68 In category Instructions following66 In category Data parsing and extraction42 In category Tool Calling4

225/225

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#33	Muse Spark 1.1 high	Meta	4	8.1	$1.694	12/22	31.5s
Total Tests 22 Wrong Tests 10 Total Cost $1.694 Response Time (avg) 31.5s
#17	Grok 4.5 high	X AI	2	8.9	$1.707	17/22	76.5s
Total Tests 22 Wrong Tests 5 Total Cost $1.707 Response Time (avg) 76.5s
#2	Gemini 3.6 Flash high	Google	1	9.7	$1.785	21/22	14.9s
Total Tests 22 Wrong Tests 1 Total Cost $1.785 Response Time (avg) 14.9s
#28	Grok 4.5 medium	X AI	6	8.3	$1.928	16/22	61.7s
Total Tests 22 Wrong Tests 6 Total Cost $1.928 Response Time (avg) 61.7s
#19	Claude Opus 4.8 medium	Anthropic	3	8.8	$1.931	18/22	12.5s
Total Tests 22 Wrong Tests 4 Total Cost $1.931 Response Time (avg) 12.5s
#4	Gemini 3.5 Flash high	Google	1	9.5	$1.976	20/22	15.1s
Total Tests 22 Wrong Tests 2 Total Cost $1.976 Response Time (avg) 15.1s
#155	Gemini 3.1 Flash Lite high	Google	4	5.6	$2.044	10/18	62.0s
Total Tests 18 Wrong Tests 8 Total Cost $2.044 Response Time (avg) 62.0s
#47	Claude Sonnet 4.6 medium	Anthropic	4	7.8	$2.057	14/22	25.9s
Total Tests 22 Wrong Tests 8 Total Cost $2.057 Response Time (avg) 25.9s
#48	Claude Opus 4.8 low	Anthropic	4	7.8	$2.077	16/22	12.7s
Total Tests 22 Wrong Tests 6 Total Cost $2.077 Response Time (avg) 12.7s
#177	Gemini 3.1 Flash Lite Preview high	Google	2	5.3	$2.310	13/16	68.1s
Total Tests 16 Wrong Tests 3 Total Cost $2.310 Response Time (avg) 68.1s
#11	Claude Opus 5 high	Anthropic	2	9.2	$2.835	18/22	20.4s
Total Tests 22 Wrong Tests 4 Total Cost $2.835 Response Time (avg) 20.4s
#50	Claude Opus 4.6 medium	Anthropic	3	7.7	$3.059	13/22	34.3s
Total Tests 22 Wrong Tests 9 Total Cost $3.059 Response Time (avg) 34.3s
#22	Claude Fable 5 medium	Anthropic	2	8.6	$3.478	17/22	17.2s
Total Tests 22 Wrong Tests 5 Total Cost $3.478 Response Time (avg) 17.2s
#15	GPT-5.5 medium	OpenAI	4	9.0	$4.137	18/22	38.4s
Total Tests 22 Wrong Tests 4 Total Cost $4.137 Response Time (avg) 38.4s
#196	Grok 4.20 Multi Agent Beta medium	X AI	4	4.8	$5.599	8/18	9.69s
Total Tests 18 Wrong Tests 10 Total Cost $5.599 Response Time (avg) 9.69s

←

1 14 15

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)