Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↑.

Models Shown

Total Failures

2265

Most Affected Model

Laguna S 2.1 18

Categories

In category Domain specific659 In category Anti-AI Tricks386 In category Coding361 In category Puzzle Solving275 In category Trivia246 In category Combined95 In category General Intelligence90 In category Instructions following82 In category Data parsing and extraction66 In category Tool Calling5

313/313

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#131	Grok 4.3 medium	X AI	6	7.0	$0.741	12/22	44.2s
Total Tests 22 Wrong Tests 10 Total Cost $0.741 Response Time (avg) 44.2s
#132	GPT-5.6 Sol none	OpenAI	9	7.0	$0.201	12/22	2.17s
Total Tests 22 Wrong Tests 10 Total Cost $0.201 Response Time (avg) 2.17s
#134	GLM 5.1 medium	Z.ai	4	7.0	$0.727	12/22	58.8s
Total Tests 22 Wrong Tests 10 Total Cost $0.727 Response Time (avg) 58.8s
#135	GPT-5.5 none	OpenAI	10	7.0	$0.544	12/22	2.35s
Total Tests 22 Wrong Tests 10 Total Cost $0.544 Response Time (avg) 2.35s
#145	Qwen3.6 Flash medium	Qwen	8	6.8	$0.741	12/22	45.0s
Total Tests 22 Wrong Tests 10 Total Cost $0.741 Response Time (avg) 45.0s
#149	Solar Pro 4 medium	Upstage	5	6.8	$0.047	12/22	127.6s
Total Tests 22 Wrong Tests 10 Total Cost $0.047 Response Time (avg) 127.6s
#151	GLM 5.3 low	Z.ai	8	6.8	$0.257	12/22	13.6s
Total Tests 22 Wrong Tests 10 Total Cost $0.257 Response Time (avg) 13.6s
#162	Gemini 3.5 Flash Lite low	Google	8	6.6	$0.138	12/22	2.56s
Total Tests 22 Wrong Tests 10 Total Cost $0.138 Response Time (avg) 2.56s
#167	Qwen3.6 35B A3B medium	Qwen	5	6.6	$0.672	12/22	58.5s
Total Tests 22 Wrong Tests 10 Total Cost $0.672 Response Time (avg) 58.5s
#168	Mercury 2.5 Preview high	Inception	6	6.6	$0.030	12/22	4.01s
Total Tests 22 Wrong Tests 10 Total Cost $0.030 Response Time (avg) 4.01s
#173	Gemini 3.1 Flash Lite Preview none	Google	7	6.4	$0.052	12/22	1.56s
Total Tests 22 Wrong Tests 10 Total Cost $0.052 Response Time (avg) 1.56s
#179	Ling-3.0-flash high	Inclusionai	7	6.4	$0.021	12/22	13.7s
Total Tests 22 Wrong Tests 10 Total Cost $0.021 Response Time (avg) 13.7s
#224	Gemini 3.1 Flash Lite high	Google	4	5.6	$2.044	10/18	62.0s
Total Tests 18 Wrong Tests 8 Total Cost $2.044 Response Time (avg) 62.0s
#181	Mimo V2 PRO medium	Xiaomi	5	6.3	$0.333	12/21	22.2s
Total Tests 21 Wrong Tests 9 Total Cost $0.333 Response Time (avg) 22.2s
#182	MiMo-V2-Flash medium	Xiaomi	5	6.3	$0.043	12/21	20.1s
Total Tests 21 Wrong Tests 9 Total Cost $0.043 Response Time (avg) 20.1s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)