Urambazaji
AI BENCHY
Advertise here

Gemini 3.1 Flash Lite Preview (medium) vs Mercury 2.5 Preview (medium)

average score iko karibu sawa: 7.4 vs 7.5. Mercury 2.5 Preview (medium) ina gharama ya chini ya benchmark: $0.024 vs $0.117. Mercury 2.5 Preview (medium) ni ya haraka zaidi: 3.58s vs 4.59s, na pass rates 63.6% vs 69.7%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-09-02

Nafasi
#94
Jumla ya tokeni za matokeo
57,778
Muda wa majibu (wastani)
4.59s
Jumla ya gharama
$0.117
Nafasi
#91
Jumla ya tokeni za matokeo
127,034
Muda wa majibu (wastani)
3.58s
Jumla ya gharama
$0.024
Muundo unaopendekezwa Mercury 2.5 Preview (medium)

It has the best score here (7.5), while costing about 4.9x less than Gemini 3.1 Flash Lite Preview (medium).

Ulinganisho wa kina

Kipimo Gemini 3.1 Flash Lite Preview Gemini 3.1 Flash Lite Preview medium Toleo: 2026-03-03 Mercury 2.5 Preview Mercury 2.5 Preview medium Toleo: 2026-09-02
Alama 7.4 7.5
Nafasi #94 #91
Uaminifu 10.0 10.0
Uthabiti 9.9 9.6
Majaribio 66/66 66/66
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 63.6% 69.7%
Majaribio yasiyo thabiti 0 1
Jumla ya uendeshaji 66 66
Gharama kwa matokeo 0.829 0.158
Jumla ya gharama $0.117 $0.024
Bei ya ingizo $0.250 / 1M $0.040 / 1M
Bei ya toleo $1.500 / 1M $0.150 / 1M
Jumla ya tokeni za ingizo 117,493 112,713
Tokeni za matokeo 10,589 5,436
Tokeni za hoja 47,189 121,598
Muda wa majibu (wastani) 4.59s 3.58s
Muda wa majibu (upeo) 18.34s 17.84s
Muda wa majibu (jumla) 101.04s 78.66s
Vigezo ~150B jumla (~10B vinavyotumika) ~100B
Upatikanaji Imefungwa Imefungwa

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#94 Gemini 3.1 Flash Lite Preview

medium
Gharama
$0.003
Muda
5.2s
Tokeni
1,944 tok

#91 Mercury 2.5 Preview

medium
Gharama
$0.001
Muda
2.7s
Tokeni
2,241 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Gemini 3.1 Flash Lite Preview 5.5 10.0 33.3% 0 4.09s 8,126 461 8,597
Mercury 2.5 Preview 7.8 10.0 66.7% 0 3.86s 7,839 552 22,126

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

Gemini 3.1 Flash Lite PreviewmediumvsQwen3.7 MaxnoneMercury 2.5 PreviewmediumvsGPT 5.3 ChatnoneMercury 2.5 PreviewmediumvsGPT-5.6 TerralowMercury 2.5 PreviewmediumvsQwen3.7 MaxnoneGemini 3.1 Flash Lite PreviewmediumvsGPT 5.3 ChatnoneGemini 3.1 Flash Lite PreviewmediumvsGPT-5.6 TerralowGemini 3.1 Flash Lite PreviewmediumvsQwen3.8 2.4T A95BhighGemini 3.1 Flash Lite PreviewmediumvsGrok 4.6lowMercury 2.5 PreviewmediumvsQwen3.8 2.4T A95BhighClaude Opus 5nonevsMercury 2.5 PreviewmediumMercury 2.5 PreviewmediumvsSolar Pro 4xhighMercury 2.5 PreviewmediumvsGrok 4.6low