- Nafasi
- #191
- Jumla ya tokeni za matokeo
- 113,193
- Muda wa majibu (wastani)
- 19.40s
- Jumla ya gharama
- $0.400
KAT-Coder-Pro V2.5 (low) vs Qwen3.7 Flash (medium)
Qwen3.7 Flash (medium) inaongoza kwa average score: 6.6 vs 6.5. Qwen3.7 Flash (medium) ina gharama ya chini ya benchmark: $0.076 vs $0.400. KAT-Coder-Pro V2.5 (low) ni ya haraka zaidi: 19.40s vs 51.80s, na pass rates 65.2% vs 62.3%.
Modeli zilizolinganishwa
- Nafasi
- #187
- Jumla ya tokeni za matokeo
- 514,925
- Muda wa majibu (wastani)
- 51.80s
- Jumla ya gharama
- $0.076
Muundo unaopendekezwa
Qwen3.7 Flash (medium)
It has the best score here (6.6), while costing about 5.3x less than KAT-Coder-Pro V2.5 (low).
Ulinganisho wa kina
| Kipimo | KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 low | Qwen3.7 Flash Qwen3.7 Flash medium |
|---|---|---|
| Alama | 6.5 | 6.6 |
| Nafasi | #191 | #187 |
| Uaminifu | 10.0 | 10.0 |
| Uthabiti | 7.1 | 7.3 |
| Majaribio | 69/69 | 69/69 |
| Majaribio sahihi | ||
| Kiwango cha kupita kwa kila jaribio | 65.2% | 62.3% |
| Majaribio yasiyo thabiti | 8 | 8 |
| Jumla ya uendeshaji | 69 | 69 |
| Gharama kwa matokeo | 3.636 | 0.760 |
| Jumla ya gharama | $0.400 | $0.076 |
| Bei ya ingizo | $0.740 / 1M | $0.030 / 1M |
| Bei ya toleo | $2.960 / 1M | $0.130 / 1M |
| Jumla ya tokeni za ingizo | 87,682 | 300,394 |
| Tokeni za matokeo | 7,166 | 14,081 |
| Tokeni za hoja | 106,027 | 500,844 |
| Muda wa majibu (wastani) | 19.40s | 51.80s |
| Muda wa majibu (upeo) | 209.15s | 593.64s |
| Muda wa majibu (jumla) | 446.11s | 1191.42s |
| Vigezo | ~700B jumla (~72B vinavyotumika) | ~35B jumla (~3B vinavyotumika) |
| Upatikanaji | Imefungwa | Imefungwa |
Onyesho la kizazi cha modeli
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#191 KAT-Coder-Pro V2.5
low- Gharama
- $0.016
- Muda
- 47.6s
- Tokeni
- 5,182 tok
#187 Qwen3.7 Flash
medium
Reached the allocated time limit (600 seconds) without receiving showcase output.
- Gharama
- $0.000
- Muda
- 600.0s
- Tokeni
- 0 tok
Modeli bora kwa alama
Alama dhidi ya gharama ya jumla
Muda wa majibu (wastani)
Alama vs Muda wa majibu (wastani)
Jumla ya tokeni za matokeo
Alama vs Jumla ya tokeni za matokeo
Mgawanyo wa kategoria
| Kazi za mawakala | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Pro V2.5 | 3.0 | 10.0 | 0.0% | 0 | 1.75s | 0 | 0 | 0 | |
| Qwen3.7 Flash | 5.2 | 3.2 | 33.3% | 1 | 148.99s | 185,917 | 1,295 | 43,554 |
| Mbinu za kupinga AI | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Pro V2.5 | 6.9 | 5.8 | 75.0% | 2 | 4.20s | 672 | 277 | 4,228 | |
| Qwen3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 9.56s | 672 | 525 | 12,844 |
| Uandishi wa msimbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Pro V2.5 | 7.8 | 10.0 | 66.7% | 0 | 24.87s | 7,893 | 402 | 24,945 | |
| Qwen3.7 Flash | 6.2 | 6.9 | 55.6% | 1 | 46.78s | 7,893 | 563 | 61,902 |
| Mchanganyiko | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Pro V2.5 | 6.4 | 5.8 | 66.7% | 1 | 111.87s | 60,055 | 5,393 | 43,732 | |
| Qwen3.7 Flash | 6.4 | 5.8 | 66.7% | 1 | 314.17s | 87,042 | 10,432 | 296,919 |
| Uchanganuzi na uchimbaji wa data | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Pro V2.5 | 10.0 | 10.0 | 100.0% | 0 | 4.19s | 7,776 | 288 | 1,917 | |
| Qwen3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 15.42s | 7,782 | 270 | 11,588 |
| Mahususi kwa domeni | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Pro V2.5 | 3.5 | 4.4 | 33.3% | 2 | 22.86s | 780 | 35 | 21,430 | |
| Qwen3.7 Flash | 2.9 | 7.2 | 11.1% | 1 | 38.02s | 780 | 59 | 38,977 |
| Akili ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Pro V2.5 | 4.1 | 2.7 | 33.3% | 1 | 2.32s | 516 | 99 | 412 | |
| Qwen3.7 Flash | 5.5 | 10.0 | 0.0% | 0 | 10.18s | 516 | 143 | 3,647 |
| Ufuataji wa maagizo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Pro V2.5 | 10.0 | 10.0 | 100.0% | 0 | 2.53s | 699 | 83 | 1,008 | |
| Qwen3.7 Flash | 5.8 | 2.7 | 66.7% | 2 | 9.27s | 699 | 100 | 7,457 |
| Utatuzi wa mafumbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Pro V2.5 | 6.4 | 4.4 | 77.8% | 2 | 3.11s | 696 | 289 | 1,820 | |
| Qwen3.7 Flash | 7.1 | 5.1 | 77.8% | 2 | 8.30s | 696 | 355 | 9,138 |
| Mwito wa zana | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Pro V2.5 | 10.0 | 10.0 | 100.0% | 0 | 18.45s | 8,391 | 282 | 834 | |
| Qwen3.7 Flash | 10.0 | 10.0 | 100.0% | 0 | 7.80s | 8,193 | 309 | 2,171 |
| Maarifa ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT-Coder-Pro V2.5 | 3.0 | 10.0 | 0.0% | 0 | 17.06s | 204 | 18 | 5,701 | |
| Qwen3.7 Flash | 3.0 | 10.0 | 0.0% | 0 | 29.17s | 204 | 30 | 12,647 |
Ulinganisho wa haraka
Badilisha jozi ya ulinganisho
LongCat 2.0lowvsQwen3.7 FlashmediumKAT-Coder-Pro V2.5lowvsStep 3.7 FlashhighQwen3.7 FlashmediumvsGLM 5.2noneMercury 2mediumvsKAT-Coder-Pro V2.5lowGPT-5.5nonevsQwen3.7 FlashmediumQwen3.7 FlashmediumvsGLM 5.3 FlashlowClaude Sonnet 5.5mediumvsKAT-Coder-Pro V2.5lowQwen3.7 FlashmediumvsStep 3.7 FlashhighKAT-Coder-Pro V2.5lowvsQwen3.6 35B A3BmediumMercury 2.5 PreviewhighvsKAT-Coder-Pro V2.5lowGPT-5.6 SolnonevsQwen3.7 FlashmediumMercury 2.5highvsKAT-Coder-Pro V2.5low