Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one.

Models Shown

Total Failures

3190

Most Affected Model

Categories

In category Domain specific900 In category Anti-AI Tricks521 In category Coding485 In category Puzzle Solving355 In category Trivia317 In category General Intelligence134 In category Combined130 In category Agentic128 In category Instructions following118 In category Data parsing and extraction93

447/447

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#84	Nemotron 3.5 Super VL high	NVIDIA	3	0.8	$0.349	15/23	49.9s
Total Tests 23 Wrong Tests 8 Total Cost $0.349 Response Time (avg) 49.9s
#90	Muse Spark 1.1 high	Meta	3	0.8	$2.570	13/23	37.4s
Total Tests 23 Wrong Tests 10 Total Cost $2.570 Response Time (avg) 37.4s
#99	Ling 3.1 Flash medium	Inclusionai	3	0.8	$0.000	15/23	88.7s
Total Tests 23 Wrong Tests 8 Total Cost $0.000 Response Time (avg) 88.7s
#103	Grok 4.5 high	X AI	3	0.8	$2.687	17/23	72.5s
Total Tests 23 Wrong Tests 6 Total Cost $2.687 Response Time (avg) 72.5s
#104	GLM 5.2 medium	Z.ai	3	0.8	$1.007	16/22	26.9s
Total Tests 22 Wrong Tests 6 Total Cost $1.007 Response Time (avg) 26.9s
#110	Claude Opus 4.7 medium	Anthropic	3	0.8	$3.636	18/23	14.1s
Total Tests 23 Wrong Tests 5 Total Cost $3.636 Response Time (avg) 14.1s
#121	Claude Fable 5.1 high	Anthropic	3	0.8	$3.471	19/23	13.3s
Total Tests 23 Wrong Tests 4 Total Cost $3.471 Response Time (avg) 13.3s
#124	Gemini 3.5 Flash medium	Google	3	0.8	$1.316	18/23	11.8s
Total Tests 23 Wrong Tests 5 Total Cost $1.316 Response Time (avg) 11.8s
#145	Muse Wonder xhigh	Meta	3	0.8	$4.012	14/23	34.4s
Total Tests 23 Wrong Tests 9 Total Cost $4.012 Response Time (avg) 34.4s
#165	Claude Fable 5.1 medium	Anthropic	3	0.7	$3.197	15/23	11.9s
Total Tests 23 Wrong Tests 8 Total Cost $3.197 Response Time (avg) 11.9s
#191	Ember-1 low	Fireworks	3	0.7	$1.488	13/23	34.9s
Total Tests 23 Wrong Tests 10 Total Cost $1.488 Response Time (avg) 34.9s
#192	Step 5 Preview high	Stepfun	3	0.7	$4.513	10/23	154.4s
Total Tests 23 Wrong Tests 13 Total Cost $4.513 Response Time (avg) 154.4s
#211	Grok 4.7 xhigh	X AI	3	0.7	$3.398	14/23	124.0s
Total Tests 23 Wrong Tests 9 Total Cost $3.398 Response Time (avg) 124.0s
#217	Ember-1 max	Fireworks	3	0.7	$3.264	11/23	97.3s
Total Tests 23 Wrong Tests 12 Total Cost $3.264 Response Time (avg) 97.3s
#255	Qwen3.5-35B-A3B medium	Qwen	3	0.6	$0.716	11/23	111.5s
Total Tests 23 Wrong Tests 12 Total Cost $0.716 Response Time (avg) 111.5s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)