Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Tests Correct ↓.

Models Shown

Total Failures

3190

Most Affected Model

Gemini 3.6 Flash 1

Categories

In category Domain specific900 In category Anti-AI Tricks521 In category Coding485 In category Puzzle Solving355 In category Trivia317 In category General Intelligence134 In category Combined130 In category Agentic128 In category Instructions following118 In category Data parsing and extraction93

447/447

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#399	GLM 5 Turbo none	Z.ai	13	0.4	$0.047	6/21	2.82s
Total Tests 21 Wrong Tests 15 Total Cost $0.047 Response Time (avg) 2.82s
#417	Elephant Alpha medium	Openrouter	9	0.4	$0.000	6/21	1.27s
Total Tests 21 Wrong Tests 15 Total Cost $0.000 Response Time (avg) 1.27s
#452	Solar Decide default	Upstage	5	0.1	$0.009	2/7	6.01s
Total Tests 7 Wrong Tests 5 Total Cost $0.009 Response Time (avg) 6.01s
#428	Laguna Xs.2 default	Poolside	8	0.3	$0.004	5/19	806ms
Total Tests 19 Wrong Tests 14 Total Cost $0.004 Response Time (avg) 806ms
#304	Trinity Large Thinking high	Arcee AI	10	0.6	$0.794	6/23	74.5s
Total Tests 23 Wrong Tests 17 Total Cost $0.794 Response Time (avg) 74.5s
#306	GPT-5.4 Mini none	OpenAI	14	0.6	$0.170	6/23	3.34s
Total Tests 23 Wrong Tests 17 Total Cost $0.170 Response Time (avg) 3.34s
#307	Mistral Large 4 none	Mistral	15	0.6	$0.290	6/23	20.4s
Total Tests 23 Wrong Tests 17 Total Cost $0.290 Response Time (avg) 20.4s
#316	Qwen3.5-35B-A3B none	Qwen	14	0.6	$0.120	6/23	18.3s
Total Tests 23 Wrong Tests 17 Total Cost $0.120 Response Time (avg) 18.3s
#319	Kimi K2.6 none	Moonshot AI	13	0.5	$0.486	6/23	26.3s
Total Tests 23 Wrong Tests 17 Total Cost $0.486 Response Time (avg) 26.3s
#325	Seed-2.0-Code none	Bytedance Seed	12	0.5	$0.257	6/23	17.5s
Total Tests 23 Wrong Tests 17 Total Cost $0.257 Response Time (avg) 17.5s
#330	MiMo-V2.6-Flash none	Xiaomi	15	0.5	$0.060	6/23	6.20s
Total Tests 23 Wrong Tests 17 Total Cost $0.060 Response Time (avg) 6.20s
#334	GPT-5.6 Luna none	OpenAI	15	0.5	$0.042	6/23	3.78s
Total Tests 23 Wrong Tests 17 Total Cost $0.042 Response Time (avg) 3.78s
#341	Ling 3.0 Flash none	Inclusionai	13	0.5	$0.004	6/23	3.40s
Total Tests 23 Wrong Tests 17 Total Cost $0.004 Response Time (avg) 3.40s
#348	Mercury 2.5 low	Inception	14	0.5	$0.020	6/23	3.34s
Total Tests 23 Wrong Tests 17 Total Cost $0.020 Response Time (avg) 3.34s
#353	Mercury 2.5 Preview low	Inception	13	0.5	$0.015	6/23	4.92s
Total Tests 23 Wrong Tests 17 Total Cost $0.015 Response Time (avg) 4.92s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)