Agentic x Wrong answer Ranking

See which AI models are most likely to hit Wrong answer on Agentic, so you can spot weak points faster. Sort by: Response Time (avg) ↑.

Models Shown

Total Failures

108

Most Affected Model

Failure Reasons

Wrong answer108 Invalid tool call44 API error32 Did not follow instructions14 Timed out10

Categories

Domain specific766 Anti-AI Tricks446 Coding429 Puzzle Solving307 Trivia280 Combined115 General Intelligence112 Agentic108 Instructions following94 Data parsing and extraction71

108/108

Rank	Model	Company	Wrong answer Count	Category Score	Total Cost	Tests Correct	Response Time (avg)
#134	Grok 4.7 medium	X AI	1	3.9	$3.501	0/1	372.1s
Total Tests 1 Wrong Tests 1 Total Cost $3.501 Response Time (avg) 372.1s
#341	GLM 4.7 Flash medium	Z.ai	1	3.9	$0.193	0/1	399.2s
Total Tests 1 Wrong Tests 1 Total Cost $0.193 Response Time (avg) 399.2s
#309	Qwen3.5-9B none	Qwen	1	3.9	$0.041	0/1	433.0s
Total Tests 1 Wrong Tests 1 Total Cost $0.041 Response Time (avg) 433.0s

Filter models