Urambazaji
AI BENCHY
Advertise here

AI BENCHY Compare

Inception: Mercury 2 vs OpenAI: GPT-5.4 Nano

Muhtasari

Ulinganisho wa benchmark Mercury 2 vs GPT-5.4 Nano: average score iko karibu sawa: 7.5 vs 7.5. Mercury 2 ina gharama ya chini ya benchmark: $0.058 vs $0.107. Mercury 2 ni ya haraka zaidi: 2.24s vs 11.95s, na pass rates 54.0% vs 63.5%.

Muundo unaopendekezwa: Mercury 2 - It has the best score here (7.5), while costing about 1.8x less than GPT-5.4 Nano.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-06-12

Kipimo Mercury 2 Mercury 2 medium Toleo: 2026-02-24 GPT-5.4 Nano GPT-5.4 Nano medium Toleo: 2026-03-17
Alama 7.5 7.5
Nafasi #46 #48
Uaminifu 10.0 10.0
Uthabiti 8.8 8.4
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 54.0% 63.5%
Majaribio yasiyo thabiti 3 4
Jumla ya uendeshaji 63 63
Gharama kwa matokeo 0.578 0.969
Jumla ya gharama $0.058 $0.107
Bei ya ingizo $0.250 / 1M $0.200 / 1M
Bei ya toleo $0.750 / 1M $1.250 / 1M
Jumla ya tokeni za ingizo 35,116 35,434
Tokeni za matokeo 4,048 3,014
Tokeni za hoja 61,219 76,520
Muda wa majibu (wastani) 2.24s 11.95s
Muda wa majibu (upeo) 14.63s 94.06s
Muda wa majibu (jumla) 44.72s 250.98s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#46 Mercury 2

medium
Cost
$0.002
Time
2.1s
Tokens
1,702 tok

#48 GPT-5.4 Nano

medium
Cost
$0.007
Time
24.6s
Tokens
4,943 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Mercury 2 6.9 9.9 50.0% 0 1.12s 554 2,546 2,609
GPT-5.4 Nano 8.3 10.0 75.0% 0 4.52s 606 683 2,254
Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Mercury 2 8.2 7.7 77.8% 1 2.04s 7,065 296 11,328
GPT-5.4 Nano 6.1 4.7 66.7% 2 19.12s 7,305 516 20,778
Mchanganyiko Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Mercury 2 10.0 10.0 100.0% 0 3.28s 12,909 268 4,887
GPT-5.4 Nano 9.8 10.0 100.0% 0 24.13s 12,345 349 5,719
Uchanganuzi na uchimbaji wa data Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Mercury 2 7.3 5.9 83.3% 1 1.11s 6,234 183 1,656
GPT-5.4 Nano 10.0 10.0 100.0% 0 2.54s 7,140 234 516
Mahususi kwa domeni Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Mercury 2 2.9 7.2 11.1% 1 6.48s 695 41 30,754
GPT-5.4 Nano 5.9 7.2 55.6% 1 38.18s 619 60 43,325
Akili ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Mercury 2 4.8 10.0 0.0% 0 821ms 456 137 542
GPT-5.4 Nano 4.5 10.0 0.0% 0 4.15s 477 179 443
Ufuataji wa maagizo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Mercury 2 10.0 10.0 100.0% 0 1.07s 340 14 958
GPT-5.4 Nano 9.8 10.0 100.0% 0 1.88s 660 95 521
Utatuzi wa mafumbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Mercury 2 5.4 10.0 33.3% 0 949ms 601 361 2,781
GPT-5.4 Nano 4.1 7.2 22.2% 1 3.79s 642 594 1,408
Mwito wa zana Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Mercury 2 10.0 10.0 100.0% 0 1.89s 6,080 180 1,956
GPT-5.4 Nano 10.0 10.0 100.0% 0 7.71s 5,445 234 382
Maarifa ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Mercury 2 3.0 10.0 0.0% 0 2.58s 182 22 3,748
GPT-5.4 Nano 3.0 10.0 0.0% 0 4.81s 195 70 1,174

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

Mercury 2mediumvsGPT-5.3 ChatnoneGemini 3 Flash PreviewlowvsGPT-5.4 NanomediumMercury 2mediumvsStep 3.7 FlashlowGemini 3 Flash PreviewlowvsMercury 2mediumGPT-5.4 NanomediumvsStep 3.7 FlashlowClaude Sonnet 4.6nonevsGPT-5.4 NanomediumClaude Sonnet 4.6nonevsMercury 2mediumClaude Opus 4.8nonevsGPT-5.4 NanomediumClaude Opus 4.8nonevsMercury 2mediumGPT-5.4 NanomediumvsQwen3.7 PlusnoneMercury 2mediumvsQwen3.7 PlusnoneGPT-5.4 NanomediumvsStep 3.7 Flashhigh