Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Score ↑.

Models Shown

Total Failures

1642

Most Affected Model

LFM2-24B-A2B 9

Categories

In category Domain specific433 In category Anti-AI Tricks306 In category Coding266 In category Puzzle Solving214 In category Trivia176 In category Combined71 In category General Intelligence66 In category Instructions following65 In category Data parsing and extraction41 In category Tool Calling4

219/219

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#24	GPT-5.2 medium	OpenAI	3	8.4	$0.951	14/22	22.6s
Total Tests 22 Wrong Tests 8 Total Cost $0.951 Response Time (avg) 22.6s
#23	Grok 4.5 low	X AI	6	8.4	$0.935	16/22	15.6s
Total Tests 22 Wrong Tests 6 Total Cost $0.935 Response Time (avg) 15.6s
#22	Qwen3.6 Max Preview medium	Qwen	5	8.4	$1.143	16/22	67.5s
Total Tests 22 Wrong Tests 6 Total Cost $1.143 Response Time (avg) 67.5s
#21	GPT-5.4 medium	OpenAI	5	8.5	$1.533	15/22	23.1s
Total Tests 22 Wrong Tests 7 Total Cost $1.533 Response Time (avg) 23.1s
#20	Claude Fable 5 medium	Anthropic	2	8.6	$3.478	17/22	17.2s
Total Tests 22 Wrong Tests 5 Total Cost $3.478 Response Time (avg) 17.2s
#19	Muse Spark 1.1 medium	Meta	4	8.6	$1.357	15/22	25.0s
Total Tests 22 Wrong Tests 7 Total Cost $1.357 Response Time (avg) 25.0s
#18	Claude Opus 4.7 medium	Anthropic	3	8.7	$1.477	18/22	7.61s
Total Tests 22 Wrong Tests 4 Total Cost $1.477 Response Time (avg) 7.61s
#17	Claude Opus 4.8 medium	Anthropic	3	8.8	$1.931	18/22	12.5s
Total Tests 22 Wrong Tests 4 Total Cost $1.931 Response Time (avg) 12.5s
#16	GPT-5.3-Codex medium	OpenAI	4	8.9	$0.920	16/22	17.0s
Total Tests 22 Wrong Tests 6 Total Cost $0.920 Response Time (avg) 17.0s
#15	Grok 4.5 high	X AI	2	8.9	$1.707	17/22	76.5s
Total Tests 22 Wrong Tests 5 Total Cost $1.707 Response Time (avg) 76.5s
#14	Gemini 3.5 Flash low	Google	2	8.9	$0.433	19/22	5.55s
Total Tests 22 Wrong Tests 3 Total Cost $0.433 Response Time (avg) 5.55s
#13	GPT-5.5 medium	OpenAI	4	9.0	$4.137	18/22	38.4s
Total Tests 22 Wrong Tests 4 Total Cost $4.137 Response Time (avg) 38.4s
#12	Gemini 3.5 Flash medium	Google	2	9.1	$0.642	19/22	8.20s
Total Tests 22 Wrong Tests 3 Total Cost $0.642 Response Time (avg) 8.20s
#11	Qwen3.7 Max medium	Qwen	3	9.2	$1.116	18/22	40.6s
Total Tests 22 Wrong Tests 4 Total Cost $1.116 Response Time (avg) 40.6s
#10	Gemini 3.1 Pro Preview medium	Google	2	9.2	$1.361	20/22	21.5s
Total Tests 22 Wrong Tests 2 Total Cost $1.361 Response Time (avg) 21.5s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)