Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Failure Count ↑.

Models Shown

Total Failures

3190

Most Affected Model

Gemini 3.6 Flash 1

Categories

In category Domain specific900 In category Anti-AI Tricks521 In category Coding485 In category Puzzle Solving355 In category Trivia317 In category General Intelligence134 In category Combined130 In category Agentic128 In category Instructions following118 In category Data parsing and extraction93

447/447

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#309	Dots 3 Note Preview medium	Dots Studio	10	0.6	$0.000	8/23	70.3s
Total Tests 23 Wrong Tests 15 Total Cost $0.000 Response Time (avg) 70.3s
#323	Gemma 4 26B A4B none	Google	10	0.5	$0.031	9/23	10.5s
Total Tests 23 Wrong Tests 14 Total Cost $0.031 Response Time (avg) 10.5s
#328	North Mini Code medium	Cohere	10	0.5	$0.000	8/23	140.4s
Total Tests 23 Wrong Tests 15 Total Cost $0.000 Response Time (avg) 140.4s
#332	Ember-1 none	Fireworks	10	0.5	$0.786	8/23	22.6s
Total Tests 23 Wrong Tests 15 Total Cost $0.786 Response Time (avg) 22.6s
#349	KAT Coder AIR V2.5 medium	Kwaipilot	10	0.5	$0.048	8/23	8.32s
Total Tests 23 Wrong Tests 15 Total Cost $0.048 Response Time (avg) 8.32s
#382	Owl Alpha medium	Openrouter	10	0.5	$0.000	8/21	11.9s
Total Tests 21 Wrong Tests 13 Total Cost $0.000 Response Time (avg) 11.9s
#384	Owl Alpha default	Openrouter	10	0.5	$0.000	7/21	9.88s
Total Tests 21 Wrong Tests 14 Total Cost $0.000 Response Time (avg) 9.88s
#388	Mimo V2 Omni default	Xiaomi	10	0.4	$0.021	8/21	2.44s
Total Tests 21 Wrong Tests 13 Total Cost $0.021 Response Time (avg) 2.44s
#397	GLM 4.7 Flash medium	Z.ai	10	0.4	$0.193	4/23	150.9s
Total Tests 23 Wrong Tests 19 Total Cost $0.193 Response Time (avg) 150.9s
#414	Grok 4.20 Beta default	X AI	10	0.4	$0.087	6/18	1.19s
Total Tests 18 Wrong Tests 12 Total Cost $0.087 Response Time (avg) 1.19s
#415	Laguna M.1 default	Poolside	10	0.4	$0.009	4/19	2.89s
Total Tests 19 Wrong Tests 15 Total Cost $0.009 Response Time (avg) 2.89s
#419	Grok 4.20 none	X AI	10	0.3	$0.057	6/18	1.11s
Total Tests 18 Wrong Tests 12 Total Cost $0.057 Response Time (avg) 1.11s
#447	D1 default	Liquid	10	0.2	$0.003	2/12	508ms
Total Tests 12 Wrong Tests 10 Total Cost $0.003 Response Time (avg) 508ms
#171	Qwen3.5-27B none	Qwen	11	0.7	$0.116	10/23	9.98s
Total Tests 23 Wrong Tests 13 Total Cost $0.116 Response Time (avg) 9.98s
#222	GPT-5.5 none	OpenAI	11	0.7	$1.212	12/23	4.75s
Total Tests 23 Wrong Tests 11 Total Cost $1.212 Response Time (avg) 4.75s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)