- Nafasi
- #164
- Jumla ya tokeni za matokeo
- 277,315
- Muda wa majibu (wastani)
- 78.76s
- Jumla ya gharama
- $0.144
Gemma 4 31B (medium) vs Mercury 2.5 Preview (medium)
Gemma 4 31B (medium) inaongoza kwa average score: 6.9 vs 6.8. Mercury 2.5 Preview (medium) ina gharama ya chini ya benchmark: $0.039 vs $0.144. Mercury 2.5 Preview (medium) ni ya haraka zaidi: 6.66s vs 78.76s, na pass rates 66.7% vs 66.7%.
Modeli zilizolinganishwa
- Nafasi
- #171
- Jumla ya tokeni za matokeo
- 150,107
- Muda wa majibu (wastani)
- 6.66s
- Jumla ya gharama
- $0.039
Muundo unaopendekezwa
Mercury 2.5 Preview (medium)
Its score stays close to the best score here (6.8 vs 6.9), while costing about 3.7x less than Gemma 4 31B (medium).
Ulinganisho wa kina
| Kipimo | Gemma 4 31B Gemma 4 31B medium Inapatikana bure | Mercury 2.5 Preview Mercury 2.5 Preview medium |
|---|---|---|
| Alama | 6.9 | 6.8 |
| Nafasi | #164 | #171 |
| Uaminifu | 10.0 | 10.0 |
| Uthabiti | 8.7 | 9.6 |
| Majaribio | 69/69 | 69/69 |
| Majaribio sahihi | ||
| Kiwango cha kupita kwa kila jaribio | 66.7% | 66.7% |
| Majaribio yasiyo thabiti | 3 | 1 |
| Jumla ya uendeshaji | 69 | 69 |
| Gharama kwa matokeo | 1.195 | 0.244 |
| Jumla ya gharama | $0.144 | $0.039 |
| Bei ya ingizo | $0.090 / 1M | $0.040 / 1M |
| Bei ya toleo | $0.340 / 1M | $0.150 / 1M |
| Bei ya kusoma akiba | $0.050 / 1M | Haipo |
| Bei ya kuandika akiba | Haipo | Haipo |
| Jumla ya tokeni za ingizo | 251,164 | 397,291 |
| Tokeni za matokeo | 36,112 | 6,355 |
| Tokeni za hoja | 241,203 | 143,752 |
| Muda wa majibu (wastani) | 78.76s | 6.66s |
| Muda wa majibu (upeo) | 437.40s | 74.63s |
| Muda wa majibu (jumla) | 1653.96s | 153.29s |
| Vigezo | 30.7B | ~100B |
| Upatikanaji | Chanzo huria | Imefungwa |
Bei za akiba zinahusu tokeni za ingizo. Kusoma hutumia tena maelekezo yaliyohifadhiwa; kuandika huyahifadhi na kunaweza kuongeza gharama. Tokeni za matokeo hutumia bei ya matokeo.
Onyesho la kizazi cha modeli
Hamster playing table tennis
Prompt: Create a detailed SVG illustration of a hamster playing table tennis.
#164 Gemma 4 31B
medium- Gharama
- $0.002
- Muda
- 45.7s
- Tokeni
- 2,696 tok
#171 Mercury 2.5 Preview
medium- Gharama
- $0.001
- Muda
- 2.7s
- Tokeni
- 2,241 tok
Modeli bora kwa alama
Alama dhidi ya gharama ya jumla
Muda wa majibu (wastani)
Alama vs Muda wa majibu (wastani)
Jumla ya tokeni za matokeo
Alama vs Jumla ya tokeni za matokeo
Mgawanyo wa kategoria
| Kazi za mawakala | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Gemma 4 31B | 10.0 | 10.0 | 100.0% | 0 | 82.13s | 156,195 | 1,713 | 8,181 | |
| Mercury 2.5 Preview | 3.9 | 9.6 | 0.0% | 0 | 74.63s | 284,578 | 919 | 22,154 |
| Mbinu za kupinga AI | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Gemma 4 31B | 10.0 | 10.0 | 100.0% | 0 | 12.89s | 816 | 962 | 2,046 | |
| Mercury 2.5 Preview | 10.0 | 10.0 | 100.0% | 0 | 1.43s | 781 | 203 | 7,921 |
| Uandishi wa msimbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Gemma 4 31B | 4.3 | 5.8 | 22.2% | 1 | 219.76s | 5,568 | 11,098 | 33,212 | |
| Mercury 2.5 Preview | 7.8 | 10.0 | 66.7% | 0 | 3.86s | 7,839 | 552 | 22,126 |
| Mchanganyiko | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Gemma 4 31B | 2.9 | 5.8 | 16.7% | 1 | 433.11s | 77,035 | 12,112 | 157,552 | |
| Mercury 2.5 Preview | 6.5 | 10.0 | 50.0% | 0 | 13.86s | 92,663 | 3,607 | 41,588 |
| Uchanganuzi na uchimbaji wa data | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Gemma 4 31B | 10.0 | 10.0 | 100.0% | 0 | 21.11s | 8,334 | 1,822 | 2,951 | |
| Mercury 2.5 Preview | 10.0 | 10.0 | 100.0% | 0 | 2.77s | 8,292 | 514 | 11,354 |
| Mahususi kwa domeni | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Gemma 4 31B | 5.3 | 7.2 | 44.4% | 1 | 59.92s | 853 | 4,280 | 18,729 | |
| Mercury 2.5 Preview | 5.3 | 7.2 | 44.4% | 1 | 3.72s | 853 | 62 | 17,120 |
| Akili ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Gemma 4 31B | 10.0 | 10.0 | 100.0% | 0 | 9.57s | 567 | 105 | 888 | |
| Mercury 2.5 Preview | 5.0 | 10.0 | 0.0% | 0 | 2.09s | 538 | 99 | 3,375 |
| Ufuataji wa maagizo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Gemma 4 31B | 10.0 | 10.0 | 100.0% | 0 | 12.76s | 777 | 533 | 2,035 | |
| Mercury 2.5 Preview | 9.8 | 10.0 | 100.0% | 0 | 1.35s | 744 | 96 | 3,987 |
| Utatuzi wa mafumbo | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Gemma 4 31B | 9.9 | 10.0 | 100.0% | 0 | 26.91s | 801 | 1,795 | 5,595 | |
| Mercury 2.5 Preview | 10.0 | 10.0 | 100.0% | 0 | 1.87s | 771 | 274 | 7,323 |
| Mwito wa zana | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Gemma 4 31B | 3.0 | 10.0 | 0.0% | 0 | 0ms | 0 | 0 | 0 | |
| Mercury 2.5 Preview | 3.0 | 10.0 | 0.0% | 0 | 2.37s | 0 | 0 | 0 |
| Maarifa ya jumla | Alama | Uthabiti | Kiwango cha kupita kwa kila jaribio | Majaribio yasiyo thabiti | Majaribio sahihi | Muda wa majibu (wastani) | Tokeni za ingizo | Tokeni za matokeo | Tokeni za hoja |
|---|---|---|---|---|---|---|---|---|---|
| Gemma 4 31B | 3.0 | 10.0 | 0.0% | 0 | 90.14s | 218 | 1,692 | 10,014 | |
| Mercury 2.5 Preview | 3.0 | 10.0 | 0.0% | 0 | 4.13s | 232 | 29 | 6,804 |
Ulinganisho wa haraka
Badilisha jozi ya ulinganisho
Mercury 2.5 PreviewmediumvsInklinglowInapatikana bureGemma 4 31BmediumInapatikana burevsGPT-5.6 LunalowClaude Sonnet 5.5lowvsGemma 4 31BmediumInapatikana bureClaude Opus 4.8nonevsGemma 4 31BmediumInapatikana bureEmber-1highvsGemma 4 31BmediumInapatikana bureMercury 2.5 PreviewmediumvsGPT-6 SolnoneClaude Opus 4.8nonevsMercury 2.5 PreviewmediumClaude Sonnet 5.5lowvsMercury 2.5 PreviewmediumMercury 2.5 PreviewmediumvsGPT-5.6 LunalowGemma 4 31BmediumInapatikana burevsInklinglowInapatikana bureEmber-1highvsMercury 2.5 PreviewmediumMercury 2.5 PreviewmediumvsSpace Bunny Alphamax