Agentic x Wrong answer Ranking

See which AI models are most likely to hit Wrong answer on Agentic, so you can spot weak points faster. Sort by: Total Cost ↓.

Models Shown

Total Failures

108

Most Affected Model

Failure Reasons

Wrong answer108 Invalid tool call44 API error32 Did not follow instructions14 Timed out10

Categories

Domain specific766 Anti-AI Tricks446 Coding429 Puzzle Solving307 Trivia280 Combined115 General Intelligence112 Agentic108 Instructions following94 Data parsing and extraction71

108/108

Rank	Model	Company	Wrong answer Count	Category Score	Total Cost	Tests Correct	Response Time (avg)
#273	North Mini Code medium	Cohere	1	3.9	$0.000	0/1	105.2s
Total Tests 1 Wrong Tests 1 Total Cost $0.000 Response Time (avg) 105.2s
#299	Dots 3 Note Preview none	Dots Studio	1	3.9	$0.000	0/1	45.7s
Total Tests 1 Wrong Tests 1 Total Cost $0.000 Response Time (avg) 45.7s
#316	North Mini Code none	Cohere	1	3.0	$0.000	0/1	18.9s
Total Tests 1 Wrong Tests 1 Total Cost $0.000 Response Time (avg) 18.9s

Filter models