Kushindwa kwa AI BENCHY
Kushindwa kwa Hakufuata maelekezo
Ona ni modeli gani za AI hukutana na Hakufuata maelekezo mara nyingi zaidi ili utambue hatari za utegemevu kabla ya kuchagua. Panga kwa: Idadi ya kushindwa ↑.
| Nafasi | Modeli | Kampuni | Idadi ya Hakufuata maelekezo | Alama | Majaribio sahihi | Muda wa majibu (wastani) |
|---|---|---|---|---|---|---|
| #71 | MiniMax M2.5 medium | Minimax | 3 | 5.7 | 5/18 | 39.6s |
| #73 | Mistral Small 4 medium | Mistral | 3 | 5.7 | 5/18 | 5.64s |
| #79 | Grok 4.20 Beta none | X AI | 3 | 5.3 | 4/18 | 1.19s |
| #81 | Elephant medium | Openrouter | 3 | 5.2 | 5/18 | 1.27s |
| #85 | Elephant none | Openrouter | 3 | 5.2 | 5/18 | 1.23s |
| #86 | GPT-5.4 Mini none | OpenAI | 3 | 5.1 | 5/18 | 1.17s |
| #90 | Qwen3.5-9B none | Qwen | 3 | 4.8 | 4/18 | 1.47s |
| #96 | GPT-5.4 Nano none | OpenAI | 3 | 4.5 | 2/18 | 1.40s |
| #45 | GPT-5 Mini medium | OpenAI | 4 | 7.0 | 9/18 | 24.0s |
| #47 | Grok 4.20 medium | X AI | 4 | 7.0 | 9/18 | 10.3s |
| #51 | Nemotron 3 Super medium | NVIDIA | 4 | 6.7 | 9/18 | 19.1s |
| #52 | Grok 4.1 Fast medium | X AI | 4 | 6.7 | 9/18 | 23.9s |
| #54 | Mercury 2 medium | Inception | 4 | 6.5 | 8/18 | 2.21s |
| #56 | Grok 4.20 Multi Agent Beta medium | X AI | 4 | 6.4 | 7/18 | 9.80s |
| #68 | gpt-oss-120b medium | OpenAI | 4 | 5.8 | 7/18 | 16.1s |