Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Failure Count ↑.

Models Shown

Total Failures

1585

Most Affected Model

Gemini 3.6 Flash 1

Categories

In category Domain specific421 In category Anti-AI Tricks293 In category Coding259 In category Puzzle Solving204 In category Trivia172 In category Combined69 In category General Intelligence62 In category Instructions following61 In category Data parsing and extraction41 In category Tool Calling3

215/215

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#216	LFM2-24B-A2B none	Liquid	9	2.2	$0.001	2/16	782ms
Total Tests 16 Wrong Tests 14 Total Cost $0.001 Response Time (avg) 782ms
#66	KAT-Coder-Pro V2.5 low	Kwaipilot	10	7.4	$0.387	11/22	19.5s
Total Tests 22 Wrong Tests 11 Total Cost $0.387 Response Time (avg) 19.5s
#73	KAT-Coder-Pro V2.5 high	Kwaipilot	10	7.2	$0.482	11/22	20.8s
Total Tests 22 Wrong Tests 11 Total Cost $0.482 Response Time (avg) 20.8s
#75	Qwen3.7 Plus none	Qwen	10	7.2	$0.106	11/22	12.1s
Total Tests 22 Wrong Tests 11 Total Cost $0.106 Response Time (avg) 12.1s
#87	GPT-5.6 Sol none	OpenAI	10	6.9	$0.524	11/22	2.16s
Total Tests 22 Wrong Tests 11 Total Cost $0.524 Response Time (avg) 2.16s
#97	KAT-Coder-Pro V2.5 none	Kwaipilot	10	6.7	$0.476	11/22	25.6s
Total Tests 22 Wrong Tests 11 Total Cost $0.476 Response Time (avg) 25.6s
#103	Qwen3.6 Max Preview none	Qwen	10	6.6	$0.231	12/22	7.82s
Total Tests 22 Wrong Tests 10 Total Cost $0.231 Response Time (avg) 7.82s
#123	GPT-5.6 Luna low	OpenAI	10	6.2	$0.249	10/22	5.04s
Total Tests 22 Wrong Tests 12 Total Cost $0.249 Response Time (avg) 5.04s
#152	Owl Alpha medium	Openrouter	10	5.6	$0.000	8/21	11.9s
Total Tests 21 Wrong Tests 13 Total Cost $0.000 Response Time (avg) 11.9s
#154	Owl Alpha none	Openrouter	10	5.6	$0.000	7/21	9.88s
Total Tests 21 Wrong Tests 14 Total Cost $0.000 Response Time (avg) 9.88s
#162	Gemma 4 26B A4B none	Google	10	5.5	$0.015	8/22	7.64s
Total Tests 22 Wrong Tests 14 Total Cost $0.015 Response Time (avg) 7.64s
#163	Mimo V2 Omni none	Xiaomi	10	5.5	$0.021	8/21	2.44s
Total Tests 21 Wrong Tests 13 Total Cost $0.021 Response Time (avg) 2.44s
#197	Grok 4.20 Beta none	X AI	10	4.4	$0.087	6/18	1.19s
Total Tests 18 Wrong Tests 12 Total Cost $0.087 Response Time (avg) 1.19s
#198	Laguna M.1 none	Poolside	10	4.4	$0.009	4/19	2.89s
Total Tests 19 Wrong Tests 15 Total Cost $0.009 Response Time (avg) 2.89s
#203	Grok 4.20 none	X AI	10	4.1	$0.057	6/18	1.11s
Total Tests 18 Wrong Tests 12 Total Cost $0.057 Response Time (avg) 1.11s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)