Kushindwa kwa kategoria za AI BENCHY
Mbinu za kupinga AI: Jibu lisilo sahihi
Mbinu za kupinga AI
Jibu lisilo sahihi
Ona ni modeli gani za AI zina uwezekano mkubwa wa kupata Jibu lisilo sahihi katika Mbinu za kupinga AI, ili uone udhaifu haraka.
Sababu za kushindwa
| Nafasi | Modeli | Kampuni | Idadi ya Jibu lisilo sahihi | Alama ya kategoria | Majaribio sahihi | Muda wa majibu (wastani) |
|---|---|---|---|---|---|---|
| #48 | Gemini 3 Flash Preview none | 1 | 8.3 | 3/4 | 1.25s | |
| #50 | Gemini 3.1 Flash Lite Preview low | 1 | 8.3 | 3/4 | 2.12s | |
| #52 | Claude Sonnet 4.6 medium | Anthropic | 1 | 6.5 | 2/4 | 2.98s |
| #53 | Gemini 3.1 Flash Lite high | 1 | 8.7 | 3/4 | 37.2s | |
| #54 | GPT-5 Mini medium | OpenAI | 1 | 7.1 | 2/4 | 13.9s |
| #57 | Step 3.7 Flash low | Stepfun | 1 | 8.7 | 3/4 | 4.02s |
| #58 | Gemini 3.1 Flash Lite Preview none | 1 | 7.5 | 2/4 | 1.04s | |
| #59 | GLM 5V Turbo medium | Z.ai | 1 | 7.2 | 2/4 | 10.8s |
| #60 | Kimi K2.6 medium | Moonshot AI | 1 | 7.0 | 2/4 | 11.6s |
| #63 | GPT-5.3 Chat none | OpenAI | 1 | 6.7 | 2/4 | 3.86s |
| #65 | Grok 4.20 medium | X AI | 1 | 8.2 | 3/4 | 3.95s |
| #70 | GPT-5.4 Nano medium | OpenAI | 1 | 8.3 | 3/4 | 4.52s |
| #73 | Seed-2.0-Mini medium | Bytedance Seed | 1 | 6.6 | 2/4 | 74.7s |
| #76 | Kimi K2.5 medium | Moonshot AI | 1 | 7.3 | 2/4 | 51.4s |
| #77 | Claude Sonnet 4.6 none | Anthropic | 1 | 4.8 | 1/4 | 2.94s |