Wrong answer Failure Ranking

See which AI models run into Wrong answer most often, so you can spot reliability risks before choosing one.

Models Shown

Total Failures

3207

Most Affected Model

Categories

In category Domain specific907 In category Anti-AI Tricks521 In category Coding486 In category Puzzle Solving357 In category Trivia323 In category General Intelligence134 In category Combined131 In category Agentic128 In category Instructions following118 In category Data parsing and extraction93

453/453

Rank	Model	Company	Wrong answer Count	Score	Total Cost	Tests Correct	Response Time (avg)
#295	Inkling Small medium	Thinkingmachines	6	0.6	$0.113	10/23	6.03s
Total Tests 23 Wrong Tests 13 Total Cost $0.113 Response Time (avg) 6.03s
#309	Ring 2.6 1t medium	Inclusionai	6	0.6	$0.102	11/23	65.5s
Total Tests 23 Wrong Tests 12 Total Cost $0.102 Response Time (avg) 65.5s
#324	Nemotron 3 Super medium	NVIDIA	6	0.6	$0.081	8/23	56.4s
Total Tests 23 Wrong Tests 15 Total Cost $0.081 Response Time (avg) 56.4s
#337	Step 3.5 Flash medium	Stepfun	6	0.5	$0.105	10/22	190.5s
Total Tests 22 Wrong Tests 12 Total Cost $0.105 Response Time (avg) 190.5s
#360	MiniMax M2.7 medium	Minimax	6	0.5	$0.326	5/23	50.3s
Total Tests 23 Wrong Tests 18 Total Cost $0.326 Response Time (avg) 50.3s
#417	Ling 3.0 Tiny high	Inclusionai	6	0.4	$0.000	4/23	72.2s
Total Tests 23 Wrong Tests 19 Total Cost $0.000 Response Time (avg) 72.2s
#427	Laguna Xs.2 medium	Poolside	6	0.3	$0.015	6/19	6.73s
Total Tests 19 Wrong Tests 13 Total Cost $0.015 Response Time (avg) 6.73s
#437	Span-02 default	Respan	6	0.3	$0.001	6/12	1.36s
Total Tests 12 Wrong Tests 6 Total Cost $0.001 Response Time (avg) 1.36s
#441	Jev 1.13 default	Typesafe	6	0.3	$0.003	6/12	698ms
Total Tests 12 Wrong Tests 6 Total Cost $0.003 Response Time (avg) 698ms
#448	Mammoth 1 default	Baseten	6	0.2	$0.000	3/12	1.80s
Total Tests 12 Wrong Tests 9 Total Cost $0.000 Response Time (avg) 1.80s
#41	DeepSeek V4.1 Flash 1017 low	DeepSeek	5	0.9	$0.355	16/23	32.5s
Total Tests 23 Wrong Tests 7 Total Cost $0.355 Response Time (avg) 32.5s
#52	Qwen3.8 Max (0902) medium	Qwen	5	0.9	$1.096	18/23	30.4s
Total Tests 23 Wrong Tests 5 Total Cost $1.096 Response Time (avg) 30.4s
#54	Gemini 3.5 Flash Lite high	Google	5	0.9	$0.624	18/23	11.9s
Total Tests 23 Wrong Tests 5 Total Cost $0.624 Response Time (avg) 11.9s
#65	Kimi K3.1 Pro low	Moonshot AI	5	0.9	$1.836	17/23	47.5s
Total Tests 23 Wrong Tests 6 Total Cost $1.836 Response Time (avg) 47.5s
#66	Qwen3.8 MAX low	Qwen	5	0.9	$1.089	17/23	25.1s
Total Tests 23 Wrong Tests 6 Total Cost $1.089 Response Time (avg) 25.1s

Wrong answer Failures

Filter models

Top Models by Wrong answer Count

Wrong answer Count vs Score

Top Models by Response Time (avg)