AI BENCHY
Your ad here

AI BENCHY Category Failures

Domain specific: Extra formatting

Domain specific
Extra formatting

See which AI models are most likely to hit Extra formatting on Domain specific, so you can spot weak points faster. Sort by: Response Time (avg) ↑.

Models Shown

7

Total Failures

8

Most Affected Model

Claude Sonnet 4.6 1
Rank Model Company Extra formatting Count Category Score Tests Correct Response Time (avg)
#26 Claude Sonnet 4.6 medium Anthropic 1 2.9 0/3 0ms
#82 Grok 4.20 none X AI 1 3.0 0/3 687ms
#50 Hunter Alpha medium OpenRouter 1 3.0 0/3 10.5s
#56 Grok 4.20 Multi Agent Beta medium X AI 1 2.9 0/3 24.7s
#47 Grok 4.20 medium X AI 1 5.3 1/3 27.0s
#35 MiMo-V2-Omni medium Xiaomi 1 3.0 0/3 55.1s
#37 Claude Opus 4.6 medium Anthropic 2 3.0 0/3 83.4s

Top Models by Extra formatting Count

Extra formatting Count vs Score

Top Models by Response Time (avg)

Top Models by Estimated Wasted Cost