- Nafasi
- #193
- Jumla ya tokeni za matokeo
- 180,597
- Muda wa majibu (wastani)
- 7.61s
- Jumla ya gharama
- $0.039
Mercury 2.5 Preview (high) vs GLM 5.1
average score iko karibu sawa: 6.5 vs 6.5. Mercury 2.5 Preview (high) ina gharama ya chini ya benchmark: $0.039 vs $0.311. Mercury 2.5 Preview (high) ni ya haraka zaidi: 7.61s vs 11.10s, na pass rates 65.2% vs 47.8%.
Modeli zilizolinganishwa
- Nafasi
- #196
- Jumla ya tokeni za matokeo
- 20,076
- Muda wa majibu (wastani)
- 11.10s
- Jumla ya gharama
- $0.311
Muundo unaopendekezwa
Mercury 2.5 Preview (high)
It has the best score here (6.5), while costing about 8.1x less than GLM 5.1.
Ulinganisho wa kina
| Kipimo | Mercury 2.5 Preview Mercury 2.5 Preview high | GLM 5.1 GLM 5.1 none |
|---|---|---|
| Alama | 6.5 | 6.5 |
| Nafasi | #193 | #196 |
| Uaminifu | 9.9 | 10.0 |
| Uthabiti | 8.0 | 8.2 |
| Majaribio | 69/69 | 69/69 |
| Majaribio sahihi | ||
| Kiwango cha kupita kwa kila jaribio | 65.2% | 47.8% |
| Majaribio yasiyo thabiti | 6 | 5 |
| Jumla ya uendeshaji | 69 | 69 |
| Gharama kwa matokeo | 0.319 | 3.478 |
| Jumla ya gharama | $0.039 | $0.311 |
| Bei ya ingizo | $0.000 / 1M | $0.965 / 1M |
| Bei ya toleo | $0.000 / 1M | $3.032 / 1M |
| Jumla ya tokeni za ingizo | 298,512 | 258,956 |
| Tokeni za matokeo | 3,178 | 20,076 |
| Tokeni za hoja | 177,419 | 0 |
| Muda wa majibu (wastani) | 7.61s | 11.10s |
| Muda wa majibu (upeo) | 86.84s | 107.19s |
| Muda wa majibu (jumla) | 175.08s | 255.39s |
| Vigezo | ~100B | 744B jumla (40B vinavyotumika) |
| Upatikanaji | Imefungwa | Chanzo huria |
Onyesho la kizazi cha modeli
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#193 Mercury 2.5 Preview
high- Gharama
- $0.001
- Muda
- 4.5s
- Tokeni
- 3,851 tok
#196 GLM 5.1
none
Reached the allocated time limit (300 seconds) without receiving showcase output.
- Gharama
- $0.000
- Muda
- 300.0s
- Tokeni
- 0 tok
Modeli bora kwa alama
Alama dhidi ya gharama ya jumla
Muda wa majibu (wastani)
Alama vs Muda wa majibu (wastani)
Jumla ya tokeni za matokeo
Alama vs Jumla ya tokeni za matokeo
Mgawanyo wa kategoria
| Kazi za mawakala | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 6.1 | 3.1 | 66.7% | 1 | 86.84s | 182,753 | 616 | 16,476 | |
| GLM 5.1 | 10.0 | 10.0 | 100.0% | 0 | 107.19s | 134,737 | 5,683 | 0 |
| Mbinu za kupinga AI | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 10.0 | 10.0 | 100.0% | 0 | 1.09s | 785 | 181 | 7,008 | |
| GLM 5.1 | 4.0 | 6.3 | 25.0% | 2 | 2.11s | 555 | 305 | 0 |
| Uandishi wa msimbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 6.7 | 7.8 | 55.6% | 1 | 6.13s | 7,751 | 485 | 42,569 | |
| GLM 5.1 | 3.9 | 9.7 | 0.0% | 0 | 4.96s | 7,256 | 525 | 0 |
| Mchanganyiko | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 3.8 | 1.6 | 50.0% | 2 | 14.36s | 95,789 | 765 | 54,789 | |
| GLM 5.1 | 2.8 | 1.8 | 33.3% | 2 | 46.88s | 99,907 | 12,768 | 0 |
| Uchanganuzi na uchimbaji wa data | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 10.0 | 10.0 | 100.0% | 0 | 2.24s | 8,292 | 560 | 8,522 | |
| GLM 5.1 | 10.0 | 10.0 | 100.0% | 0 | 1.08s | 7,107 | 204 | 0 |
| Mahususi kwa domeni | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 2.9 | 4.4 | 22.2% | 2 | 5.68s | 857 | 67 | 25,958 | |
| GLM 5.1 | 5.3 | 7.2 | 44.4% | 1 | 2.27s | 697 | 24 | 0 |
| Akili ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 5.1 | 10.0 | 0.0% | 0 | 1.88s | 542 | 94 | 3,300 | |
| GLM 5.1 | 5.0 | 10.0 | 0.0% | 0 | 790ms | 477 | 39 | 0 |
| Ufuataji wa maagizo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 9.8 | 10.0 | 100.0% | 0 | 1.05s | 741 | 94 | 3,777 | |
| GLM 5.1 | 9.8 | 10.0 | 100.0% | 0 | 1.98s | 636 | 66 | 0 |
| Utatuzi wa mafumbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 10.0 | 10.0 | 100.0% | 0 | 1.21s | 774 | 292 | 6,066 | |
| GLM 5.1 | 7.7 | 10.0 | 66.7% | 0 | 1.45s | 609 | 151 | 0 |
| Mwito wa zana | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 3.0 | 10.0 | 0.0% | 0 | 2.25s | 0 | 0 | 0 | |
| GLM 5.1 | 10.0 | 10.0 | 100.0% | 0 | 10.68s | 6,789 | 300 | 0 |
| Maarifa ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 Preview | 3.0 | 10.0 | 0.0% | 0 | 5.41s | 228 | 24 | 8,954 | |
| GLM 5.1 | 3.0 | 10.0 | 0.0% | 0 | 2.34s | 186 | 11 | 0 |
Ulinganisho wa haraka
Badilisha jozi ya ulinganisho
KAT-Coder-Pro V2.5highvsGLM 5.1noneGrok 4.3mediumvsGLM 5.1noneMercury 2.5 PreviewhighvsQwen3.6 35B A3BmediumLaguna XS 2.1mediumInapatikana burevsGLM 5.1noneMercury 2.5 PreviewhighvsGLM 5.3lowClaude Sonnet 5.5mediumvsMercury 2.5 PreviewhighMercury 2.5highvsGLM 5.1noneMercury 2.5 PreviewhighvsGLM 5.2noneMercury 2.5 PreviewhighvsGrok 4.3mediumQwen3.6 35B A3BmediumvsGLM 5.1noneSolar Pro 4mediumvsGLM 5.1noneMercury 2.5 PreviewhighvsLaguna XS 2.1mediumInapatikana bure