Uandishi wa msimbo: Hakufuata maelekezo
Uandishi wa msimbo
Hakufuata maelekezo
Ona ni modeli gani za AI zina uwezekano mkubwa wa kupata Hakufuata maelekezo katika Uandishi wa msimbo, ili uone udhaifu haraka.
Sababu za kushindwa
63/63
Chuja miundo
Hakuna miundo inayolingana na utafutaji na vichujio vya sasa.
| Nafasi | Modeli | Kampuni | Idadi ya Hakufuata maelekezo | Alama ya kategoria | Jumla ya gharama | Majaribio sahihi | Muda wa majibu (wastani) |
|---|---|---|---|---|---|---|---|
| #263 | Claude Sonnet 5.5 low | Anthropic | 2 | 0.3 | $0.909 | 0/3 | 5.81s |
| #293 | Claude Sonnet 5.5 medium | Anthropic | 2 | 0.3 | $1.100 | 0/3 | 6.07s |
| #341 | Claude Fable 5.1 low | Anthropic | 2 | 0.3 | $3.395 | 0/3 | 6.75s |
| #407 | Inkling 2 Mini none | Thinkingmachines | 2 | 0.4 | $0.315 | 0/3 | 89.6s |
| #104 | Qwen3.8 27B high | Qwen | 1 | 0.8 | ~$0.298 | 2/3 | 248.6s |
| #118 | Claude Fable 5.2 low | Anthropic | 1 | 0.6 | $3.471 | 1/3 | 6.83s |
| #121 | Claude Haiku 5.5 low | Anthropic | 1 | 0.8 | $0.061 | 2/3 | 7.30s |
| #139 | DeepSeek V4 Flash 0731 high | DeepSeek | 1 | 0.6 | $0.576 | 1/3 | 252.7s |
| #152 | DeepSeek V4.1 Flash 1017 max | DeepSeek | 1 | 0.6 | $0.757 | 1/3 | 199.2s |
| #178 | Particle-1 max | Particle AI | 1 | 0.6 | $0.361 | 1/3 | 79.3s |
| #180 | Gemini 3.5 Flash medium | 1 | 0.8 | $1.316 | 2/3 | 12.6s | |
| #181 | Qwen3.8 2.4T A95B high | Qwen | 1 | 0.6 | $2.949 | 1/3 | 160.5s |
| #185 | DeepSeek V4.1 Flash 1017 high | DeepSeek | 1 | 0.5 | $0.589 | 0/3 | 196.7s |
| #209 | Mistral Large 4 high | Mistral | 1 | 0.3 | $1.391 | 0/3 | 1277.8s |
| #210 | Seed-2.0-Code high | Bytedance Seed | 1 | 0.6 | $1.448 | 1/3 | 266.7s |