- Nafasi
- #236
- Jumla ya tokeni za matokeo
- 139,572
- Muda wa majibu (wastani)
- 24.96s
- Jumla ya gharama
- $0.487
KAT-Coder-Pro V2.5 vs Inkling Small (medium)
KAT-Coder-Pro V2.5 inaongoza kwa average score: 6.1 vs 6.0. Inkling Small (medium) ina gharama ya chini ya benchmark: $0.118 vs $0.487. Inkling Small (medium) ni ya haraka zaidi: 6.03s vs 24.96s, na pass rates 68.1% vs 50.7%.
Modeli zilizolinganishwa
- Nafasi
- #240
- Jumla ya tokeni za matokeo
- 56,269
- Muda wa majibu (wastani)
- 6.03s
- Jumla ya gharama
- $0.118
Muundo unaopendekezwa
Inkling Small (medium)
Its score stays close to the best score here (6.0 vs 6.1), while costing about 4.1x less than KAT-Coder-Pro V2.5.
Ulinganisho wa kina
| Kipimo | KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 none | Inkling Small Inkling Small medium Inapatikana bure |
|---|---|---|
| Alama | 6.1 | 6.0 |
| Nafasi | #236 | #240 |
| Uaminifu | 10.0 | 10.0 |
| Uthabiti | 7.1 | 9.1 |
| Majaribio | 69/69 | 69/69 |
| Majaribio sahihi | ||
| Kiwango cha kupita kwa kila jaribio | 68.1% | 50.7% |
| Majaribio yasiyo thabiti | 8 | 3 |
| Jumla ya uendeshaji | 69 | 69 |
| Gharama kwa matokeo | 4.419 | 1.177 |
| Jumla ya gharama | $0.487 | $0.118 |
| Bei ya ingizo | $0.740 / 1M | $0.450 / 1M |
| Bei ya toleo | $2.960 / 1M | $1.200 / 1M |
| Jumla ya tokeni za ingizo | 98,508 | 100,255 |
| Tokeni za matokeo | 139,572 | 6,422 |
| Tokeni za hoja | 0 | 49,847 |
| Muda wa majibu (wastani) | 24.96s | 6.03s |
| Muda wa majibu (upeo) | 335.41s | 17.26s |
| Muda wa majibu (jumla) | 574.12s | 138.65s |
| Vigezo | ~700B jumla (~72B vinavyotumika) | 276B jumla (12B vinavyotumika) |
| Upatikanaji | Imefungwa | Imefungwa |
Onyesho la kizazi cha modeli
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#236 KAT-Coder-Pro V2.5
none- Gharama
- $0.010
- Muda
- 29.0s
- Tokeni
- 3,439 tok
#240 Thinking Machines: Inkling Small
medium- Gharama
- $0.003
- Muda
- 13.4s
- Tokeni
- 1,753 tok
Modeli bora kwa alama
Alama dhidi ya gharama ya jumla
Muda wa majibu (wastani)
Alama vs Muda wa majibu (wastani)
Jumla ya tokeni za matokeo
Alama vs Jumla ya tokeni za matokeo
Mgawanyo wa kategoria
| Kazi za mawakala | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Pro V2.5 | 3.0 | 10.0 | 0.0% | 0 | 1.90s | 0 | 0 | 0 | |
| Inkling Small | 3.0 | 10.0 | 0.0% | 0 | 49ms | 0 | 0 | 0 |
| Mbinu za kupinga AI | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Pro V2.5 | 8.7 | 7.9 | 91.7% | 1 | 4.58s | 672 | 3,998 | 0 | |
| Inkling Small | 10.0 | 10.0 | 100.0% | 0 | 4.09s | 702 | 401 | 5,846 |
| Uandishi wa msimbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Pro V2.5 | 6.1 | 4.7 | 66.7% | 2 | 22.52s | 7,893 | 22,440 | 0 | |
| Inkling Small | 7.8 | 10.0 | 66.7% | 0 | 10.49s | 7,374 | 434 | 13,783 |
| Mchanganyiko | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Pro V2.5 | 4.1 | 5.0 | 33.3% | 1 | 183.08s | 70,881 | 77,889 | 0 | |
| Inkling Small | 3.8 | 5.8 | 33.3% | 1 | 8.89s | 76,198 | 4,299 | 1,761 |
| Uchanganuzi na uchimbaji wa data | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Pro V2.5 | 10.0 | 10.0 | 100.0% | 0 | 5.07s | 7,776 | 2,361 | 0 | |
| Inkling Small | 10.0 | 10.0 | 100.0% | 0 | 3.95s | 7,068 | 216 | 2,123 |
| Mahususi kwa domeni | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Pro V2.5 | 4.1 | 4.4 | 44.5% | 2 | 24.90s | 780 | 24,683 | 0 | |
| Inkling Small | 3.0 | 10.0 | 0.0% | 0 | 7.65s | 804 | 69 | 9,365 |
| Akili ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Pro V2.5 | 4.8 | 3.2 | 33.3% | 1 | 5.16s | 516 | 1,067 | 0 | |
| Inkling Small | 5.3 | 10.0 | 0.0% | 0 | 2.58s | 501 | 169 | 921 |
| Ufuataji wa maagizo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Pro V2.5 | 9.8 | 10.0 | 100.0% | 0 | 2.61s | 699 | 1,084 | 0 | |
| Inkling Small | 8.5 | 6.8 | 83.3% | 1 | 3.78s | 708 | 93 | 2,477 |
| Utatuzi wa mafumbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Pro V2.5 | 8.2 | 7.2 | 88.9% | 1 | 3.03s | 696 | 1,929 | 0 | |
| Inkling Small | 5.8 | 7.7 | 44.4% | 1 | 5.24s | 714 | 469 | 6,498 |
| Mwito wa zana | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Pro V2.5 | 10.0 | 10.0 | 100.0% | 0 | 5.93s | 8,391 | 1,103 | 0 | |
| Inkling Small | 3.0 | 10.0 | 0.0% | 0 | 2.12s | 5,967 | 240 | 207 |
| Maarifa ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Pro V2.5 | 3.0 | 10.0 | 0.0% | 0 | 9.91s | 204 | 3,018 | 0 | |
| Inkling Small | 3.0 | 10.0 | 0.0% | 0 | 14.19s | 219 | 32 | 6,866 |
Ulinganisho wa haraka
Badilisha jozi ya ulinganisho
Seed-2.0-LitenonevsInkling SmallmediumInapatikana bureInkling SmallmediumInapatikana burevsMiMo-V2.6-PrononeGranite 4.2 8BmediumvsKAT-Coder-Pro V2.5noneInkling SmallmediumInapatikana burevsGLM 5.3 FlashXlowGemini 3.1 Flash LiteminimalvsInkling SmallmediumInapatikana bureTrinity Large ThinkingmediumvsKAT-Coder-Pro V2.5noneGemini 3.1 Flash LitenonevsInkling SmallmediumInapatikana bureQwen3.6 FlashnonevsInkling SmallmediumInapatikana bureClaude Sonnet 5nonevsInkling SmallmediumInapatikana bureKAT-Coder-Pro V2.5nonevsGLM 5.3 FlashXlowNemotron 3 UltranoneInapatikana burevsInkling SmallmediumInapatikana bureQwen3.7 FlashnonevsInkling SmallmediumInapatikana bure