- Nafasi
- #386
- Jumla ya tokeni za matokeo
- 114,654
- Muda wa majibu (wastani)
- 15.23s
- Jumla ya gharama
- $0.077
KAT Coder AIR V2.5 (high) vs Mistral Small 4
average score iko karibu sawa: 5.2 vs 5.1. Mistral Small 4 ina gharama ya chini ya benchmark: $0.047 vs $0.077. Mistral Small 4 ni ya haraka zaidi: 3.12s vs 15.23s, na pass rates 40.6% vs 24.6%.
Modeli zilizolinganishwa
- Nafasi
- #390
- Jumla ya tokeni za matokeo
- 10,913
- Muda wa majibu (wastani)
- 3.12s
- Jumla ya gharama
- $0.047
Muundo unaopendekezwa
Mistral Small 4
It has the best score here (5.1), while costing about 1.6x less than KAT Coder AIR V2.5 (high).
Ulinganisho wa kina
| Kipimo | KAT Coder AIR V2.5 KAT Coder AIR V2.5 high | Mistral Small 4 Mistral Small 4 none |
|---|---|---|
| Alama | 5.2 | 5.1 |
| Nafasi | #386 | #390 |
| Uaminifu | 9.8 | 10.0 |
| Uthabiti | 8.2 | 9.6 |
| Majaribio | 69/69 | 69/69 |
| Majaribio sahihi | ||
| Kiwango cha kupita kwa kila jaribio | 40.6% | 24.6% |
| Majaribio yasiyo thabiti | 5 | 1 |
| Jumla ya uendeshaji | 69 | 69 |
| Gharama kwa matokeo | 1.091 | 0.928 |
| Jumla ya gharama | $0.077 | $0.047 |
| Bei ya ingizo | $0.150 / 1M | $0.150 / 1M |
| Bei ya toleo | $0.600 / 1M | $0.600 / 1M |
| Bei ya kusoma akiba | Haipo | $0.015 / 1M |
| Bei ya kuandika akiba | Haipo | Haipo |
| Jumla ya tokeni za ingizo | 50,423 | 265,602 |
| Tokeni za matokeo | 4,144 | 10,913 |
| Tokeni za hoja | 110,510 | 0 |
| Muda wa majibu (wastani) | 15.23s | 3.12s |
| Muda wa majibu (upeo) | 118.35s | 45.46s |
| Muda wa majibu (jumla) | 350.26s | 71.87s |
| Vigezo | ~35B jumla (~3B vinavyotumika) | 119B jumla (6B vinavyotumika) |
| Upatikanaji | Imefungwa | Chanzo huria |
Bei za akiba zinahusu tokeni za ingizo. Kusoma hutumia tena maelekezo yaliyohifadhiwa; kuandika huyahifadhi na kunaweza kuongeza gharama. Tokeni za matokeo hutumia bei ya matokeo.
Onyesho la kizazi cha modeli
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#386 KAT Coder AIR V2.5
high
Reached the allocated time limit (300 seconds) without receiving showcase output.
- Gharama
- $0.000
- Muda
- 300.0s
- Tokeni
- 0 tok
#390 Mistral Small 4
none- Gharama
- $0.002
- Muda
- 10.4s
- Tokeni
- 2,370 tok
Mgawanyo wa kategoria
| Kazi za mawakala | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 3.0 | 10.0 | 0.0% | 0 | 1.10s | 0 | 0 | 0 | |
| Mistral Small 4 | 5.0 | 10.0 | 0.0% | 0 | 45.46s | 160,885 | 1,101 | 0 |
| Mbinu za kupinga AI | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 6.9 | 5.8 | 75.0% | 2 | 2.49s | 615 | 204 | 1,290 | |
| Mistral Small 4 | 3.4 | 7.9 | 16.7% | 1 | 395ms | 708 | 182 | 0 |
| Uandishi wa msimbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 4.3 | 7.3 | 11.1% | 1 | 39.07s | 6,948 | 1,166 | 55,883 | |
| Mistral Small 4 | 3.7 | 9.7 | 0.0% | 0 | 901ms | 7,636 | 619 | 0 |
| Mchanganyiko | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 6.5 | 10.0 | 50.0% | 0 | 74.48s | 23,854 | 485 | 28,559 | |
| Mistral Small 4 | 3.0 | 10.0 | 0.0% | 0 | 7.44s | 79,039 | 8,107 | 0 |
| Uchanganuzi na uchimbaji wa data | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 6.5 | 10.0 | 50.0% | 0 | 3.59s | 7,776 | 284 | 2,140 | |
| Mistral Small 4 | 10.0 | 10.0 | 100.0% | 0 | 822ms | 7,914 | 261 | 0 |
| Mahususi kwa domeni | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 3.0 | 10.0 | 0.0% | 0 | 7.28s | 724 | 1,101 | 7,738 | |
| Mistral Small 4 | 5.3 | 10.0 | 33.3% | 0 | 377ms | 807 | 28 | 0 |
| Akili ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 5.1 | 10.0 | 0.0% | 0 | 7.10s | 516 | 179 | 539 | |
| Mistral Small 4 | 4.0 | 10.0 | 0.0% | 0 | 729ms | 519 | 205 | 0 |
| Ufuataji wa maagizo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 9.8 | 10.0 | 100.0% | 0 | 1.51s | 699 | 90 | 675 | |
| Mistral Small 4 | 6.5 | 10.0 | 50.0% | 0 | 380ms | 729 | 69 | 0 |
| Utatuzi wa mafumbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 3.5 | 4.4 | 33.3% | 2 | 2.47s | 696 | 285 | 1,576 | |
| Mistral Small 4 | 3.1 | 9.9 | 0.0% | 0 | 399ms | 735 | 111 | 0 |
| Mwito wa zana | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 10.0 | 10.0 | 100.0% | 0 | 4.77s | 8,391 | 330 | 1,082 | |
| Mistral Small 4 | 10.0 | 10.0 | 100.0% | 0 | 1.40s | 6,420 | 213 | 0 |
| Maarifa ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| KAT Coder AIR V2.5 | 3.0 | 10.0 | 0.0% | 0 | 21.72s | 204 | 20 | 11,028 | |
| Mistral Small 4 | 3.0 | 10.0 | 0.0% | 0 | 397ms | 210 | 17 | 0 |
Ulinganisho wa haraka
Badilisha jozi ya ulinganisho
Mercury 2.5lowvsMistral Small 4noneKAT Coder AIR V2.5mediumvsMistral Small 4noneLing 3.0 FlashnonevsKAT Coder AIR V2.5highKAT Coder AIR V2.5highvsInkling SmalllowInapatikana bureKAT Coder AIR V2.5highvsMistral Small 4mediumApodex 1.1 MinidefaultInapatikana burevsMistral Small 4noneMistral Small 4nonevsNemotron 3.5 LightninghighInapatikana bureMercury 2.5lowvsKAT Coder AIR V2.5highKAT Coder AIR V2.5highvsMiMo-V2.5-PrononeMistral Small 4nonevsLaguna S 2.1mediumInapatikana bureMistral Small 4nonevsInkling SmalllowInapatikana bureKAT Coder AIR V2.5highvsQwen3.6 35B A3Bnone