- Nafasi
- #167
- Jumla ya tokeni za matokeo
- 24,343
- Muda wa majibu (wastani)
- 7.54s
- Jumla ya gharama
- $2.334
Claude Opus 4.8 vs Mercury 2.5 Preview (medium)
average score iko karibu sawa: 6.9 vs 6.8. Mercury 2.5 Preview (medium) ina gharama ya chini ya benchmark: $0.037 vs $2.334. Mercury 2.5 Preview (medium) ni ya haraka zaidi: 6.66s vs 7.54s, na pass rates 60.9% vs 66.7%.
Modeli zilizolinganishwa
- Nafasi
- #171
- Jumla ya tokeni za matokeo
- 150,107
- Muda wa majibu (wastani)
- 6.66s
- Jumla ya gharama
- $0.037
Muundo unaopendekezwa
Mercury 2.5 Preview (medium)
It has the best score here (6.8), while costing about 63.8x less than Claude Opus 4.8.
Ulinganisho wa kina
| Kipimo | Claude Opus 4.8 Claude Opus 4.8 none | Mercury 2.5 Preview Mercury 2.5 Preview medium |
|---|---|---|
| Alama | 6.9 | 6.8 |
| Nafasi | #167 | #171 |
| Uaminifu | 10.0 | 10.0 |
| Uthabiti | 9.3 | 9.6 |
| Majaribio | 69/69 | 69/69 |
| Majaribio sahihi | ||
| Kiwango cha kupita kwa kila jaribio | 60.9% | 66.7% |
| Majaribio yasiyo thabiti | 2 | 1 |
| Jumla ya uendeshaji | 69 | 69 |
| Gharama kwa matokeo | 17.953 | 0.244 |
| Jumla ya gharama | $2.334 | $0.037 |
| Bei ya ingizo | $5.000 / 1M | $0.000 / 1M |
| Bei ya toleo | $25.000 / 1M | $0.000 / 1M |
| Jumla ya tokeni za ingizo | 345,059 | 397,291 |
| Tokeni za matokeo | 24,343 | 6,355 |
| Tokeni za hoja | 0 | 143,752 |
| Muda wa majibu (wastani) | 7.54s | 6.66s |
| Muda wa majibu (upeo) | 65.07s | 74.63s |
| Muda wa majibu (jumla) | 173.31s | 153.29s |
| Vigezo | ~5T jumla (~500B vinavyotumika) | ~100B |
| Upatikanaji | Imefungwa | Imefungwa |
Onyesho la kizazi cha modeli
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#167 Claude Opus 4.8
none- Gharama
- $0.053
- Muda
- 22.0s
- Tokeni
- 2,253 tok
#171 Mercury 2.5 Preview
medium- Gharama
- $0.001
- Muda
- 2.7s
- Tokeni
- 2,241 tok
Modeli bora kwa alama
Alama dhidi ya gharama ya jumla
Muda wa majibu (wastani)
Alama vs Muda wa majibu (wastani)
Jumla ya tokeni za matokeo
Alama vs Jumla ya tokeni za matokeo
Mgawanyo wa kategoria
| Kazi za mawakala | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 4.8 | 5.0 | 10.0 | 0.0% | 0 | 65.07s | 195,856 | 7,546 | 0 | |
| Mercury 2.5 Preview | 3.9 | 9.6 | 0.0% | 0 | 74.63s | 284,578 | 919 | 22,154 |
| Mbinu za kupinga AI | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 4.8 | 6.5 | 10.0 | 50.0% | 0 | 3.40s | 834 | 1,472 | 0 | |
| Mercury 2.5 Preview | 10.0 | 10.0 | 100.0% | 0 | 1.43s | 781 | 203 | 7,921 |
| Uandishi wa msimbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 4.8 | 5.5 | 10.0 | 33.3% | 0 | 3.29s | 10,590 | 1,332 | 0 | |
| Mercury 2.5 Preview | 7.8 | 10.0 | 66.7% | 0 | 3.86s | 7,839 | 552 | 22,126 |
| Mchanganyiko | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 4.8 | 9.8 | 10.0 | 100.0% | 0 | 26.38s | 111,760 | 11,949 | 0 | |
| Mercury 2.5 Preview | 6.5 | 10.0 | 50.0% | 0 | 13.86s | 92,663 | 3,607 | 41,588 |
| Uchanganuzi na uchimbaji wa data | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 4.8 | 7.3 | 5.8 | 83.3% | 1 | 1.77s | 10,503 | 308 | 0 | |
| Mercury 2.5 Preview | 10.0 | 10.0 | 100.0% | 0 | 2.77s | 8,292 | 514 | 11,354 |
| Mahususi kwa domeni | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 4.8 | 5.3 | 7.2 | 44.4% | 1 | 1.76s | 972 | 61 | 0 | |
| Mercury 2.5 Preview | 5.3 | 7.2 | 44.4% | 1 | 3.72s | 853 | 62 | 17,120 |
| Akili ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 4.8 | 10.0 | 10.0 | 100.0% | 0 | 3.48s | 708 | 230 | 0 | |
| Mercury 2.5 Preview | 5.0 | 10.0 | 0.0% | 0 | 2.09s | 538 | 99 | 3,375 |
| Ufuataji wa maagizo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 4.8 | 9.9 | 10.0 | 100.0% | 0 | 1.37s | 909 | 95 | 0 | |
| Mercury 2.5 Preview | 9.8 | 10.0 | 100.0% | 0 | 1.35s | 744 | 96 | 3,987 |
| Utatuzi wa mafumbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 4.8 | 7.7 | 10.0 | 66.7% | 0 | 2.74s | 894 | 783 | 0 | |
| Mercury 2.5 Preview | 10.0 | 10.0 | 100.0% | 0 | 1.87s | 771 | 274 | 7,323 |
| Mwito wa zana | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 4.8 | 10.0 | 10.0 | 100.0% | 0 | 5.35s | 11,775 | 355 | 0 | |
| Mercury 2.5 Preview | 3.0 | 10.0 | 0.0% | 0 | 2.37s | 0 | 0 | 0 |
| Maarifa ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 4.8 | 3.0 | 10.0 | 0.0% | 0 | 3.41s | 258 | 212 | 0 | |
| Mercury 2.5 Preview | 3.0 | 10.0 | 0.0% | 0 | 4.13s | 232 | 29 | 6,804 |
Ulinganisho wa haraka
Badilisha jozi ya ulinganisho
Mercury 2.5 PreviewmediumvsInklinglowInapatikana bureClaude Opus 4.8nonevsGPT-5.6 LunalowClaude Opus 4.8nonevsGemma 4 31BmediumInapatikana bureMercury 2.5 PreviewmediumvsGPT-6 SolnoneClaude Opus 4.8nonevsEmber-1highClaude Opus 4.8nonevsKimi K2.6mediumClaude Opus 4.8nonevsGemini 3.1 Flash LitemediumClaude Opus 4.8nonevsQwen3.5-FlashmediumClaude Opus 4.8nonevsInklinglowInapatikana bureClaude Sonnet 5.5lowvsMercury 2.5 PreviewmediumMercury 2.5 PreviewmediumvsGPT-5.6 LunalowEmber-1highvsMercury 2.5 Previewmedium