Combined x Invalid tool call Ranking

See which AI models are most likely to hit Invalid tool call on Combined, so you can spot weak points faster. Sort by: Response Time (avg) ↓.

Models Shown

Total Failures

150

Most Affected Model

Failure Reasons

Invalid tool call150 Wrong answer99 No answer46 API error37 Timed out9 Did not follow instructions1 Extra formatting1

Categories

Combined150 Tool Calling11

128/128

Rank	Model	Company	Invalid tool call Count	Category Score	Total Cost	Tests Correct	Response Time (avg)
#212	GPT-5.6 Terra none	OpenAI	1	2.9	$0.280	0/2	7.02s
Total Tests 2 Wrong Tests 2 Total Cost $0.280 Response Time (avg) 7.02s
#252	GPT-5.6 Luna none	OpenAI	1	3.2	$0.029	0/2	6.68s
Total Tests 2 Wrong Tests 2 Total Cost $0.029 Response Time (avg) 6.68s
#303	Grok 4.20 Beta none	X AI	1	1.5	$0.087	0/1	6.48s
Total Tests 1 Wrong Tests 1 Total Cost $0.087 Response Time (avg) 6.48s
#310	Grok 4.20 none	X AI	1	1.5	$0.057	0/1	6.04s
Total Tests 1 Wrong Tests 1 Total Cost $0.057 Response Time (avg) 6.04s
#304	Laguna M.1 none	Poolside	1	1.5	$0.009	0/1	4.32s
Total Tests 1 Wrong Tests 1 Total Cost $0.009 Response Time (avg) 4.32s
#229	Inkling Small low	Thinkingmachines	1	3.0	$0.055	0/2	4.08s
Total Tests 2 Wrong Tests 2 Total Cost $0.055 Response Time (avg) 4.08s
#318	Mercury 2.5 none	Inception	1	3.0	$0.016	0/2	3.24s
Total Tests 2 Wrong Tests 2 Total Cost $0.016 Response Time (avg) 3.24s
#316	Nemotron 3.5 Lightning none	NVIDIA	1	3.0	$0.007	0/2	2.02s
Total Tests 2 Wrong Tests 2 Total Cost $0.007 Response Time (avg) 2.02s

Filter models