- Nafasi
- #195
- Jumla ya tokeni za matokeo
- 193,676
- Muda wa majibu (wastani)
- 7.62s
- Jumla ya gharama
- $0.044
Mercury 2.5 (high) vs Qwen3.6 35B A3B (medium)
average score iko karibu sawa: 6.5 vs 6.5. Mercury 2.5 (high) ina gharama ya chini ya benchmark: $0.044 vs $0.812. Mercury 2.5 (high) ni ya haraka zaidi: 7.62s vs 59.92s, na pass rates 59.4% vs 58.0%.
Modeli zilizolinganishwa
- Nafasi
- #193
- Jumla ya tokeni za matokeo
- 776,174
- Muda wa majibu (wastani)
- 59.92s
- Jumla ya gharama
- $0.812
Muundo unaopendekezwa
Mercury 2.5 (high)
It has the best score here (6.5), while costing about 18.7x less than Qwen3.6 35B A3B (medium).
Ulinganisho wa kina
| Kipimo | Mercury 2.5 Mercury 2.5 high | Qwen3.6 35B A3B Qwen3.6 35B A3B medium |
|---|---|---|
| Alama | 6.5 | 6.5 |
| Nafasi | #195 | #193 |
| Uaminifu | 9.8 | 10.0 |
| Uthabiti | 8.7 | 9.0 |
| Majaribio | 69/69 | 69/69 |
| Majaribio sahihi | ||
| Kiwango cha kupita kwa kila jaribio | 59.4% | 58.0% |
| Majaribio yasiyo thabiti | 4 | 3 |
| Jumla ya uendeshaji | 69 | 69 |
| Gharama kwa matokeo | 0.362 | 6.732 |
| Jumla ya gharama | $0.044 | $0.812 |
| Bei ya ingizo | $0.040 / 1M | $0.150 / 1M |
| Bei ya toleo | $0.150 / 1M | $1.000 / 1M |
| Jumla ya tokeni za ingizo | 358,562 | 282,192 |
| Tokeni za matokeo | 4,266 | 75,306 |
| Tokeni za hoja | 189,410 | 700,868 |
| Muda wa majibu (wastani) | 7.62s | 59.92s |
| Muda wa majibu (upeo) | 80.30s | 817.57s |
| Muda wa majibu (jumla) | 175.36s | 1258.32s |
| Vigezo | ~100B | 35B jumla (3B vinavyotumika) |
| Upatikanaji | Imefungwa | Chanzo huria |
Onyesho la kizazi cha modeli
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#195 Mercury 2.5
high- Gharama
- $0.001
- Muda
- 3.5s
- Tokeni
- 2,447 tok
#193 Qwen3.6 35B A3B
medium
Reached the allocated time limit (300 seconds) without receiving showcase output.
- Gharama
- $0.000
- Muda
- 300.0s
- Tokeni
- 0 tok
Modeli bora kwa alama
Alama dhidi ya gharama ya jumla
Muda wa majibu (wastani)
Alama vs Muda wa majibu (wastani)
Jumla ya tokeni za matokeo
Alama vs Jumla ya tokeni za matokeo
Mgawanyo wa kategoria
| Kazi za mawakala | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 | 3.9 | 9.6 | 0.0% | 0 | 80.30s | 238,494 | 864 | 18,265 | |
| Qwen3.6 35B A3B | 6.1 | 3.1 | 66.7% | 1 | 88.48s | 197,044 | 13,570 | 19,312 |
| Mbinu za kupinga AI | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 | 10.0 | 10.0 | 100.0% | 0 | 1.33s | 782 | 218 | 7,913 | |
| Qwen3.6 35B A3B | 10.0 | 10.0 | 100.0% | 0 | 6.02s | 672 | 1,154 | 12,385 |
| Uandishi wa msimbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 | 6.4 | 7.8 | 44.4% | 1 | 6.58s | 7,757 | 415 | 44,012 | |
| Qwen3.6 35B A3B | 7.7 | 10.0 | 66.7% | 0 | 50.55s | 5,051 | 7,929 | 37,223 |
| Mchanganyiko | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 | 6.4 | 5.8 | 66.7% | 1 | 16.00s | 91,255 | 1,478 | 62,200 | |
| Qwen3.6 35B A3B | 3.0 | 10.0 | 0.0% | 0 | 817.57s | 68,754 | 42,187 | 548,547 |
| Uchanganuzi na uchimbaji wa data | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 | 10.0 | 10.0 | 100.0% | 0 | 3.08s | 8,355 | 557 | 9,430 | |
| Qwen3.6 35B A3B | 10.0 | 10.0 | 100.0% | 0 | 12.99s | 7,776 | 2,591 | 9,968 |
| Mahususi kwa domeni | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 | 2.9 | 7.2 | 11.1% | 1 | 4.86s | 857 | 78 | 22,452 | |
| Qwen3.6 35B A3B | 2.9 | 4.4 | 22.2% | 2 | 25.39s | 780 | 6,110 | 41,906 |
| Akili ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 | 5.0 | 10.0 | 0.0% | 0 | 2.69s | 528 | 93 | 3,609 | |
| Qwen3.6 35B A3B | 4.4 | 9.9 | 0.0% | 0 | 8.66s | 516 | 129 | 4,569 |
| Ufuataji wa maagizo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 | 6.5 | 10.0 | 50.0% | 0 | 934ms | 401 | 27 | 1,770 | |
| Qwen3.6 35B A3B | 10.0 | 10.0 | 100.0% | 0 | 7.50s | 699 | 219 | 7,404 |
| Utatuzi wa mafumbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 | 8.7 | 7.7 | 88.9% | 1 | 1.39s | 771 | 227 | 5,812 | |
| Qwen3.6 35B A3B | 8.0 | 10.0 | 66.7% | 0 | 5.95s | 696 | 655 | 9,228 |
| Mwito wa zana | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 | 10.0 | 10.0 | 100.0% | 0 | 3.06s | 9,130 | 283 | 4,484 | |
| Qwen3.6 35B A3B | 3.0 | 10.0 | 0.0% | 0 | 0ms | 0 | 0 | 0 |
| Maarifa ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Mercury 2.5 | 3.0 | 10.0 | 0.0% | 0 | 5.48s | 232 | 26 | 9,463 | |
| Qwen3.6 35B A3B | 3.0 | 10.0 | 0.0% | 0 | 32.90s | 204 | 762 | 10,326 |
Ulinganisho wa haraka
Badilisha jozi ya ulinganisho
Mercury 2.5highvsGLM 5.3lowMercury 2.5 PreviewhighvsQwen3.6 35B A3BmediumMercury 2.5highvsGLM 5.1noneQwen3.6 35B A3BmediumvsGLM 5.3lowClaude Sonnet 5.5mediumvsMercury 2.5highMercury 2.5highvsGrok 4.3mediumMercury 2.5highvsLaguna XS 2.1mediumInapatikana bureQwen3.6 35B A3BmediumvsGLM 5.1noneKAT-Coder-Pro V2.5lowvsQwen3.6 35B A3BmediumMercury 2.5highvsQwen3.5-122B-A10BnoneKAT-Coder-Pro V2.5highvsQwen3.6 35B A3BmediumGemini 3 Flash PreviewnonevsMercury 2.5high