Uandishi wa msimbo: Jibu lisilo sahihi
Uandishi wa msimbo
Jibu lisilo sahihi
Ona ni modeli gani za AI zina uwezekano mkubwa wa kupata Jibu lisilo sahihi katika Uandishi wa msimbo, ili uone udhaifu haraka.
Sababu za kushindwa
265/265
Chuja miundo
Hakuna miundo inayolingana na utafutaji na vichujio vya sasa.
| Nafasi | Modeli | Kampuni | Idadi ya Jibu lisilo sahihi | Alama ya kategoria | Jumla ya gharama | Majaribio sahihi | Muda wa majibu (wastani) |
|---|---|---|---|---|---|---|---|
| #234 | DeepSeek V3.2 medium | DeepSeek | 1 | 0.6 | $0.152 | 1/3 | 248.7s |
| #239 | KAT-Coder-Pro V2.5 medium | Kwaipilot | 1 | 0.8 | $0.669 | 2/3 | 33.1s |
| #244 | Gemini 3.5 Flash none | 1 | 0.9 | $1.752 | 2/3 | 34.7s | |
| #252 | Claude Sonnet 4.6 none | Anthropic | 1 | 0.5 | $0.661 | 1/3 | 5.19s |
| #255 | Inkling Small medium | Thinkingmachines | 1 | 0.8 | $0.113 | 2/3 | 10.5s |
| #266 | DeepSeek V4.1 Flash none | DeepSeek | 1 | 0.6 | $0.391 | 1/3 | 83.7s |
| #269 | Trinity Large Thinking high | Arcee AI | 1 | 0.4 | $0.794 | 0/3 | 245.0s |
| #274 | Dots 3 Note Preview medium | Dots Studio | 1 | 0.4 | $0.000 | 0/3 | 309.1s |
| #282 | Kimi K2.6 none | Moonshot AI | 1 | 0.6 | $0.486 | 1/3 | 82.6s |
| #283 | Ling 3.1 Flash none | Inclusionai | 1 | 0.5 | $0.000 | 0/3 | 31.9s |
| #306 | KAT Coder AIR V2.5 high | Kwaipilot | 1 | 0.4 | $0.077 | 0/3 | 39.1s |
| #307 | Mimo V2 PRO medium | Xiaomi | 1 | 0.6 | $0.333 | 1/3 | 94.2s |
| #308 | MiMo-V2-Flash medium | Xiaomi | 1 | 0.6 | $0.043 | 1/3 | 10.7s |
| #315 | Laguna S 2.1 medium | Poolside | 1 | 0.5 | $0.092 | 1/3 | 159.0s |
| #320 | KAT Coder AIR V2.5 low | Kwaipilot | 1 | 0.3 | $0.046 | 0/3 | 11.1s |