Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one. Sort by: Failure Count ↑.

Models Shown

Total Failures

3190

Most Affected Model

Gemini 3.6 Flash 1

Categories

In category Domain specific900 In category Anti-AI Tricks521 In category Coding485 In category Puzzle Solving355 In category Trivia317 In category General Intelligence134 In category Combined130 In category Agentic128 In category Instructions following118 In category Data parsing and extraction93

447/447

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#411	Ling 3.0 Tiny high	Inclusionai	6	0.4	$0.000	4/23	72.2s
Total Tests 23 Wrong Tests 19 Total Cost $0.000 Response Time (avg) 72.2s
#421	Laguna Xs.2 medium	Poolside	6	0.3	$0.015	6/19	6.73s
Total Tests 19 Wrong Tests 13 Total Cost $0.015 Response Time (avg) 6.73s
#431	Span-02 default	Respan	6	0.3	$0.001	6/12	1.36s
Total Tests 12 Wrong Tests 6 Total Cost $0.001 Response Time (avg) 1.36s
#435	Jev 1.13 default	Typesafe	6	0.3	$0.003	6/12	698ms
Total Tests 12 Wrong Tests 6 Total Cost $0.003 Response Time (avg) 698ms
#442	Mammoth 1 default	Baseten	6	0.2	$0.000	3/12	1.80s
Total Tests 12 Wrong Tests 9 Total Cost $0.000 Response Time (avg) 1.80s
#93	GPT-5.6 Terra high	OpenAI	7	0.8	$0.698	15/23	13.6s
Total Tests 23 Wrong Tests 8 Total Cost $0.698 Response Time (avg) 13.6s
#97	GPT-6 Luna medium	OpenAI	7	0.8	$0.047	15/23	18.1s
Total Tests 23 Wrong Tests 8 Total Cost $0.047 Response Time (avg) 18.1s
#108	Seed-2.0-Code low	Bytedance Seed	7	0.8	$0.881	14/23	73.0s
Total Tests 23 Wrong Tests 9 Total Cost $0.881 Response Time (avg) 73.0s
#112	DeepSeek V4.1 Flash low	DeepSeek	7	0.8	$0.494	15/23	28.0s
Total Tests 23 Wrong Tests 8 Total Cost $0.494 Response Time (avg) 28.0s
#114	Nemotron 3 Ultra medium	NVIDIA	7	0.8	$0.674	14/23	40.3s
Total Tests 23 Wrong Tests 9 Total Cost $0.674 Response Time (avg) 40.3s
#123	Qwen3.7 Max none	Qwen	7	0.8	$0.451	16/23	7.85s
Total Tests 23 Wrong Tests 7 Total Cost $0.451 Response Time (avg) 7.85s
#135	Grok 4.5 low	X AI	7	0.8	$1.345	16/23	18.1s
Total Tests 23 Wrong Tests 7 Total Cost $1.345 Response Time (avg) 18.1s
#139	Muse Glimmer 30B high	Meta	7	0.8	$0.506	11/23	69.9s
Total Tests 23 Wrong Tests 12 Total Cost $0.506 Response Time (avg) 69.9s
#143	Qwen3.7 Flash low	Qwen	7	0.8	$0.071	12/23	41.0s
Total Tests 23 Wrong Tests 11 Total Cost $0.071 Response Time (avg) 41.0s
#147	GPT-6 Luna low	OpenAI	7	0.8	$0.033	12/23	23.2s
Total Tests 23 Wrong Tests 11 Total Cost $0.033 Response Time (avg) 23.2s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)