AI BENCHY Category Failures
Coding: Extra formatting
Coding
Extra formatting
See which AI models are most likely to hit Extra formatting on Coding, so you can spot weak points faster.
Failure Reasons
12/12
Filter models
No models match the current search and filters.
| Rank | Model | Company | Extra formatting Count | Category Score | Total Cost | Tests Correct | Response Time (avg) |
|---|---|---|---|---|---|---|---|
| #38 | Claude Sonnet 4.6 medium | Anthropic | 1 | 5.7 | $1.418 | 1/3 | 33.3s |
| #45 | Claude Opus 4.8 low | Anthropic | 1 | 6.6 | $1.270 | 1/3 | 7.58s |
| #46 | Grok 4.3 medium | X AI | 1 | 5.9 | $0.614 | 1/3 | 41.2s |
| #48 | Claude Opus 4.6 medium | Anthropic | 1 | 5.7 | $2.053 | 1/3 | 30.1s |
| #51 | MiniMax M3 medium | Minimax | 1 | 6.1 | $0.131 | 1/3 | 144.7s |
| #53 | Grok Build 0.1 medium | X AI | 1 | 5.7 | $0.927 | 1/3 | 108.5s |
| #63 | MiMo-V2.5-Pro medium | Xiaomi | 1 | 6.2 | $0.106 | 1/3 | 92.1s |
| #67 | Claude Sonnet 4.6 none | Anthropic | 1 | 5.5 | $0.316 | 1/3 | 5.19s |
| #76 | GLM 5.1 medium | Z.ai | 1 | 4.6 | $0.288 | 0/3 | 109.6s |
| #126 | Owl Alpha none | Openrouter | 1 | 5.6 | $0.000 | 1/3 | 36.9s |
| #130 | Mimo V2 Omni none | Xiaomi | 1 | 4.4 | $0.021 | 0/3 | 2.75s |
| #182 | Granite 4.1 8B none | IBM Granite | 1 | 4.5 | $0.003 | 0/3 | 775ms |