- Nafasi
- #166
- Jumla ya tokeni za matokeo
- 32,443
- Muda wa majibu (wastani)
- 7.46s
- Jumla ya gharama
- $0.909
Claude Sonnet 5.5 (low) vs Mercury 2.5 Preview (medium)
average score iko karibu sawa: 6.9 vs 6.8. Mercury 2.5 Preview (medium) ina gharama ya chini ya benchmark: $0.037 vs $0.909. Mercury 2.5 Preview (medium) ni ya haraka zaidi: 6.66s vs 7.46s, na pass rates 46.4% vs 66.7%.
Modeli zilizolinganishwa
- Nafasi
- #171
- Jumla ya tokeni za matokeo
- 150,107
- Muda wa majibu (wastani)
- 6.66s
- Jumla ya gharama
- $0.037
Muundo unaopendekezwa
Mercury 2.5 Preview (medium)
It has the best score here (6.8), while costing about 24.8x less than Claude Sonnet 5.5 (low).
Ulinganisho wa kina
| Kipimo | Claude Sonnet 5.5 Claude Sonnet 5.5 low | Mercury 2.5 Preview Mercury 2.5 Preview medium |
|---|---|---|
| Alama | 6.9 | 6.8 |
| Nafasi | #166 | #171 |
| Uaminifu | 10.0 | 10.0 |
| Uthabiti | 9.4 | 9.6 |
| Majaribio | 69/69 | 69/69 |
| Majaribio sahihi | ||
| Kiwango cha kupita kwa kila jaribio | 46.4% | 66.7% |
| Majaribio yasiyo thabiti | 2 | 1 |
| Jumla ya uendeshaji | 69 | 69 |
| Gharama kwa matokeo | 9.082 | 0.244 |
| Jumla ya gharama | $0.909 | $0.037 |
| Bei ya ingizo | $2.000 / 1M | $0.000 / 1M |
| Bei ya toleo | $10.000 / 1M | $0.000 / 1M |
| Jumla ya tokeni za ingizo | 291,853 | 397,291 |
| Tokeni za matokeo | 24,116 | 6,355 |
| Tokeni za hoja | 8,327 | 143,752 |
| Muda wa majibu (wastani) | 7.46s | 6.66s |
| Muda wa majibu (upeo) | 46.61s | 74.63s |
| Muda wa majibu (jumla) | 171.47s | 153.29s |
| Vigezo | ~1T jumla (~100B vinavyotumika) | ~100B |
| Upatikanaji | Imefungwa | Imefungwa |
Onyesho la kizazi cha modeli
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#166 Claude Sonnet 5.5
low- Gharama
- $0.020
- Muda
- 15.3s
- Tokeni
- 2,077 tok
#171 Mercury 2.5 Preview
medium- Gharama
- $0.001
- Muda
- 2.7s
- Tokeni
- 2,241 tok
Modeli bora kwa alama
Alama dhidi ya gharama ya jumla
Muda wa majibu (wastani)
Alama vs Muda wa majibu (wastani)
Jumla ya tokeni za matokeo
Alama vs Jumla ya tokeni za matokeo
Mgawanyo wa kategoria
| Kazi za mawakala | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 10.0 | 10.0 | 100.0% | 0 | 46.61s | 125,435 | 2,660 | 1,153 | |
| Mercury 2.5 Preview | 3.9 | 9.6 | 0.0% | 0 | 74.63s | 284,578 | 919 | 22,154 |
| Mbinu za kupinga AI | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 6.5 | 10.0 | 50.0% | 0 | 2.55s | 858 | 1,736 | 0 | |
| Mercury 2.5 Preview | 10.0 | 10.0 | 100.0% | 0 | 1.43s | 781 | 203 | 7,921 |
| Uandishi wa msimbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 3.2 | 9.7 | 0.0% | 0 | 5.81s | 10,608 | 5,903 | 0 | |
| Mercury 2.5 Preview | 7.8 | 10.0 | 66.7% | 0 | 3.86s | 7,839 | 552 | 22,126 |
| Mchanganyiko | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 7.9 | 6.9 | 66.7% | 1 | 22.50s | 128,879 | 7,220 | 4,027 | |
| Mercury 2.5 Preview | 6.5 | 10.0 | 50.0% | 0 | 13.86s | 92,663 | 3,607 | 41,588 |
| Uchanganuzi na uchimbaji wa data | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 10.0 | 10.0 | 100.0% | 0 | 2.31s | 10,515 | 312 | 0 | |
| Mercury 2.5 Preview | 10.0 | 10.0 | 100.0% | 0 | 2.77s | 8,292 | 514 | 11,354 |
| Mahususi kwa domeni | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 3.0 | 10.0 | 0.0% | 0 | 8.09s | 990 | 3,974 | 2,570 | |
| Mercury 2.5 Preview | 5.3 | 7.2 | 44.4% | 1 | 3.72s | 853 | 62 | 17,120 |
| Akili ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 4.8 | 3.2 | 33.3% | 1 | 2.33s | 714 | 374 | 0 | |
| Mercury 2.5 Preview | 5.0 | 10.0 | 0.0% | 0 | 2.09s | 538 | 99 | 3,375 |
| Ufuataji wa maagizo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 6.3 | 10.0 | 50.0% | 0 | 1.91s | 921 | 357 | 0 | |
| Mercury 2.5 Preview | 9.8 | 10.0 | 100.0% | 0 | 1.35s | 744 | 96 | 3,987 |
| Utatuzi wa mafumbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 7.7 | 10.0 | 66.7% | 0 | 2.50s | 912 | 892 | 0 | |
| Mercury 2.5 Preview | 10.0 | 10.0 | 100.0% | 0 | 1.87s | 771 | 274 | 7,323 |
| Mwito wa zana | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 10.0 | 10.0 | 100.0% | 0 | 4.67s | 11,757 | 354 | 0 | |
| Mercury 2.5 Preview | 3.0 | 10.0 | 0.0% | 0 | 2.37s | 0 | 0 | 0 |
| Maarifa ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Claude Sonnet 5.5 | 3.0 | 10.0 | 0.0% | 0 | 4.97s | 264 | 334 | 577 | |
| Mercury 2.5 Preview | 3.0 | 10.0 | 0.0% | 0 | 4.13s | 232 | 29 | 6,804 |
Ulinganisho wa haraka
Badilisha jozi ya ulinganisho
Mercury 2.5 PreviewmediumvsInklinglowInapatikana bureClaude Sonnet 5.5lowvsGemma 4 31BmediumInapatikana bureMercury 2.5 PreviewmediumvsGPT-6 SolnoneClaude Sonnet 5.5lowvsEmber-1highClaude Sonnet 5.5lowvsKimi K2.6mediumClaude Sonnet 5.5lowvsGemini 3.1 Flash LitemediumClaude Sonnet 5.5lowvsQwen3.5-FlashmediumClaude Opus 4.8nonevsMercury 2.5 PreviewmediumMercury 2.5 PreviewmediumvsGPT-5.6 LunalowClaude Sonnet 5.5lowvsGPT-6 SolnoneEmber-1highvsMercury 2.5 PreviewmediumMercury 2.5 PreviewmediumvsSpace Bunny Alphamax