- Nafasi
- #64
- Jumla ya tokeni za matokeo
- 61,650
- Muda wa majibu (wastani)
- 7.51s
- Jumla ya gharama
- $0.061
Claude Haiku 5.5 (low) vs KAT Coder AIR V2.5 (high)
Claude Haiku 5.5 (low) inaongoza kwa average score: 8.6 vs 5.2. Claude Haiku 5.5 (low) ina gharama ya chini ya benchmark: $0.061 vs $0.077. Claude Haiku 5.5 (low) ni ya haraka zaidi: 7.51s vs 15.23s, na pass rates 76.8% vs 40.6%.
Modeli zilizolinganishwa
- Nafasi
- #309
- Jumla ya tokeni za matokeo
- 114,654
- Muda wa majibu (wastani)
- 15.23s
- Jumla ya gharama
- $0.077
Muundo unaopendekezwa
Claude Haiku 5.5 (low)
It has the best score here (8.6), while responding about 2.0x faster than KAT Coder AIR V2.5 (high).
Ulinganisho wa kina
| Kipimo | Claude Haiku 5.5 Claude Haiku 5.5 low | KAT Coder AIR V2.5 KAT Coder AIR V2.5 high |
|---|---|---|
| Alama | 8.6 | 5.2 |
| Nafasi | #64 | #309 |
| Uaminifu | 10.0 | 9.8 |
| Uthabiti | 8.9 | 8.2 |
| Majaribio | 69/69 | 69/69 |
| Majaribio sahihi | ||
| Kiwango cha kupita kwa kila jaribio | 76.8% | 40.6% |
| Majaribio yasiyo thabiti | 3 | 5 |
| Jumla ya uendeshaji | 69 | 69 |
| Gharama kwa matokeo | 0.378 | 1.091 |
| Jumla ya gharama | $0.061 | $0.077 |
| Bei ya ingizo | $0.100 / 1M | $0.150 / 1M |
| Bei ya toleo | $0.500 / 1M | $0.600 / 1M |
| Bei ya kusoma akiba | $0.010 / 1M | Haipo |
| Bei ya kuandika akiba | $0.125 / 1M | Haipo |
| Jumla ya tokeni za ingizo | 296,301 | 50,423 |
| Tokeni za matokeo | 10,672 | 4,144 |
| Tokeni za hoja | 50,978 | 110,510 |
| Muda wa majibu (wastani) | 7.51s | 15.23s |
| Muda wa majibu (upeo) | 44.43s | 118.35s |
| Muda wa majibu (jumla) | 172.74s | 350.26s |
| Vigezo | ~50B | ~35B jumla (~3B vinavyotumika) |
| Upatikanaji | Imefungwa | Imefungwa |
Bei za akiba zinahusu tokeni za ingizo. Kusoma hutumia tena maelekezo yaliyohifadhiwa; kuandika huyahifadhi na kunaweza kuongeza gharama. Tokeni za matokeo hutumia bei ya matokeo.
Onyesho la kizazi cha modeli
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#64 Claude Haiku 5.5
low- Gharama
- $0.001
- Muda
- 7.4s
- Tokeni
- 1,851 tok
#309 KAT Coder AIR V2.5
high
Reached the allocated time limit (300 seconds) without receiving showcase output.
- Gharama
- $0.000
- Muda
- 300.0s
- Tokeni
- 0 tok
Mgawanyo wa kategoria
| Kazi za mawakala | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Haiku 5.5 | 10.0 | 10.0 | 100.0% | 0 | 44.43s | 153,966 | 2,991 | 3,811 | |
| KAT Coder AIR V2.5 | 3.0 | 10.0 | 0.0% | 0 | 1.10s | 0 | 0 | 0 |
| Mbinu za kupinga AI | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Haiku 5.5 | 8.7 | 7.9 | 91.7% | 1 | 2.16s | 858 | 483 | 1,480 | |
| KAT Coder AIR V2.5 | 6.9 | 5.8 | 75.0% | 2 | 2.49s | 615 | 204 | 1,290 |
| Uandishi wa msimbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Haiku 5.5 | 7.9 | 7.5 | 77.8% | 1 | 7.30s | 10,608 | 531 | 11,618 | |
| KAT Coder AIR V2.5 | 4.3 | 7.3 | 11.1% | 1 | 39.07s | 6,948 | 1,166 | 55,883 |
| Mchanganyiko | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Haiku 5.5 | 10.0 | 10.0 | 100.0% | 0 | 23.94s | 104,796 | 4,741 | 19,543 | |
| KAT Coder AIR V2.5 | 6.5 | 10.0 | 50.0% | 0 | 74.48s | 23,854 | 485 | 28,559 |
| Uchanganuzi na uchimbaji wa data | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Haiku 5.5 | 10.0 | 10.0 | 100.0% | 0 | 3.45s | 10,515 | 312 | 1,609 | |
| KAT Coder AIR V2.5 | 6.5 | 10.0 | 50.0% | 0 | 3.59s | 7,776 | 284 | 2,140 |
| Mahususi kwa domeni | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Haiku 5.5 | 5.9 | 7.2 | 55.6% | 1 | 7.35s | 990 | 64 | 9,207 | |
| KAT Coder AIR V2.5 | 3.0 | 10.0 | 0.0% | 0 | 7.28s | 724 | 1,101 | 7,738 |
| Akili ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Haiku 5.5 | 4.6 | 9.8 | 0.0% | 0 | 1.38s | 714 | 319 | 0 | |
| KAT Coder AIR V2.5 | 5.1 | 10.0 | 0.0% | 0 | 7.10s | 516 | 179 | 539 |
| Ufuataji wa maagizo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Haiku 5.5 | 9.8 | 10.0 | 100.0% | 0 | 2.20s | 921 | 94 | 515 | |
| KAT Coder AIR V2.5 | 9.8 | 10.0 | 100.0% | 0 | 1.51s | 699 | 90 | 675 |
| Utatuzi wa mafumbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Haiku 5.5 | 7.7 | 10.0 | 66.7% | 0 | 2.76s | 912 | 611 | 1,783 | |
| KAT Coder AIR V2.5 | 3.5 | 4.4 | 33.3% | 2 | 2.47s | 696 | 285 | 1,576 |
| Mwito wa zana | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Haiku 5.5 | 10.0 | 10.0 | 100.0% | 0 | 4.19s | 11,757 | 354 | 459 | |
| KAT Coder AIR V2.5 | 10.0 | 10.0 | 100.0% | 0 | 4.77s | 8,391 | 330 | 1,082 |
| Maarifa ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Haiku 5.5 | 3.0 | 10.0 | 0.0% | 0 | 2.70s | 264 | 172 | 953 | |
| KAT Coder AIR V2.5 | 3.0 | 10.0 | 0.0% | 0 | 21.72s | 204 | 20 | 11,028 |
Ulinganisho wa haraka
Badilisha jozi ya ulinganisho
Ling 3.0 FlashnonevsKAT Coder AIR V2.5highClaude Haiku 5.5lowvsGrok 4.6highKAT Coder AIR V2.5highvsInkling SmalllowInapatikana bureKAT Coder AIR V2.5highvsMistral Small 4mediumKAT Coder AIR V2.5highvsMistral Small 4noneClaude Haiku 5.5lowvsDeepSeek V4.1 FlashmaxClaude Haiku 5.5lowvsQwen3.7 MaxmediumMercury 2.5lowvsKAT Coder AIR V2.5highKAT Coder AIR V2.5highvsMiMo-V2.5-PrononeClaude Haiku 5.5lowvsSeed 2.1 TurbomediumClaude Haiku 5.5lowvsMiMo-V2.6-PromediumKAT Coder AIR V2.5highvsQwen3.6 35B A3Bnone