Kazi za mawakala: Jibu lisilo sahihi
Kazi za mawakala
Jibu lisilo sahihi
Ona ni modeli gani za AI zina uwezekano mkubwa wa kupata Jibu lisilo sahihi katika Kazi za mawakala, ili uone udhaifu haraka.
Sababu za kushindwa
139/139
Chuja miundo
Hakuna miundo inayolingana na utafutaji na vichujio vya sasa.
| Nafasi | Modeli | Kampuni | Idadi ya Jibu lisilo sahihi | Alama ya kategoria | Jumla ya gharama | Majaribio sahihi | Muda wa majibu (wastani) |
|---|---|---|---|---|---|---|---|
| #265 | GLM 5.2 none | Z.ai | 1 | 0.6 | $0.250 | 0/1 | 46.9s |
| #267 | LongCat 2.0 low | Meituan | 1 | 0.6 | $0.630 | 0/1 | 145.6s |
| #268 | Mercury 2 medium | Inception | 1 | 0.5 | $0.121 | 0/1 | 34.9s |
| #269 | Step 3.7 Flash high | Stepfun | 1 | 0.5 | $1.478 | 0/1 | 130.4s |
| #270 | Beam 1.0 501B A23B medium | Reflection | 1 | 0.3 | $0.499 | 0/1 | 31.6s |
| #274 | Qwen3.6 35B A3B medium | Qwen | 1 | 0.6 | $0.834 | 0/1 | 88.5s |
| #276 | Mercury 2.5 high | Inception | 1 | 0.4 | $0.044 | 0/1 | 80.3s |
| #277 | Beam 1.0 501B A23B xhigh | Reflection | 1 | 0.3 | $0.688 | 0/1 | 44.6s |
| #284 | Gemini 3 Flash Preview none | 1 | 0.5 | $0.155 | 0/1 | 57.8s | |
| #285 | Beam 1.0 501B A23B max | Reflection | 1 | 0.3 | $0.799 | 0/1 | 50.1s |
| #286 | Solar Pro 4 medium | Upstage | 1 | 0.5 | $0.098 | 0/1 | 272.3s |
| #288 | Minimax M3.1 Flash xhigh | Minimax | 1 | 0.6 | $0.000 | 0/1 | 87.6s |
| #292 | Gemini 3.5 Flash minimal | 1 | 0.5 | $0.508 | 0/1 | 49.2s | |
| #294 | MiMo-V2.5-Pro medium | Xiaomi | 1 | 0.5 | $0.332 | 0/1 | 233.5s |
| #295 | Dots 3 Note Preview high | Dots Studio | 1 | 0.6 | $0.000 | 0/1 | 129.1s |