Urambazaji
AI BENCHY
Advertise here

AI BENCHY Compare

Inception: Mercury 2 vs OpenAI: gpt-oss-120b

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-05-22

Kipimo Mercury 2 Mercury 2 medium Toleo: 2026-02-24 gpt-oss-120b gpt-oss-120b none Toleo: 2025-08-05 Inapatikana bure
Alama 6.3 5.2
Nafasi #90 #129
Uaminifu 10.0 10.0
Uthabiti 8.4 8.7
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 50.0% 36.8%
Majaribio yasiyo thabiti 4 3
Jumla ya uendeshaji 60 57
Gharama kwa matokeo 0.687 0.201
Jumla ya gharama $0.055 $0.011
Bei ya ingizo $0.250 / 1M $0.000 / 1M
Bei ya toleo $0.750 / 1M $0.000 / 1M
Tokeni za matokeo 4,015 51,505
Tokeni za hoja 58,382 0
Muda wa majibu (wastani) 2.27s 21.86s
Muda wa majibu (upeo) 14.63s 113.71s
Muda wa majibu (jumla) 43.15s 349.78s

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Mercury 2 6.9 9.9 50.0% 0 1.12s 2,546 2,609
gpt-oss-120b 6.5 10.0 50.0% 0 32.84s 8,676 0
Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Mercury 2 7.2 6.5 66.7% 1 2.29s 270 8,514
gpt-oss-120b 4.3 1.1 66.7% 1 9.57s 3,232 0
Mchanganyiko Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Mercury 2 10.0 10.0 100.0% 0 3.28s 268 4,887
gpt-oss-120b 3.0 10.0 0.0% 0 0ms 0 0
Uchanganuzi na uchimbaji wa data Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Mercury 2 7.3 5.9 83.3% 1 1.11s 183 1,656
gpt-oss-120b 6.5 10.0 50.0% 0 7.12s 598 0
Mahususi kwa domeni Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Mercury 2 2.9 7.2 11.1% 1 6.48s 41 30,754
gpt-oss-120b 3.0 10.0 0.0% 0 34.98s 29,483 0
Akili ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Mercury 2 4.8 10.0 0.0% 0 821ms 137 542
gpt-oss-120b 4.8 10.0 0.0% 0 10.79s 615 0
Ufuataji wa maagizo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Mercury 2 10.0 10.0 100.0% 0 1.07s 14 958
gpt-oss-120b 9.8 10.0 100.0% 0 5.10s 1,982 0
Utatuzi wa mafumbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Mercury 2 3.8 7.3 22.2% 1 934ms 354 2,758
gpt-oss-120b 4.4 4.5 44.5% 2 9.51s 3,781 0
Mwito wa zana Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Mercury 2 10.0 10.0 100.0% 0 1.89s 180 1,956
gpt-oss-120b 3.0 10.0 0.0% 0 0ms 0 0
Maarifa ya jumla Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za matokeo Tokeni za hoja
Mercury 2 3.0 10.0 0.0% 0 2.58s 22 3,748
gpt-oss-120b 3.0 10.0 0.0% 0 47.29s 3,138 0

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

Mercury 2mediumvsGLM 5noneGemma 4 26B A4BnoneInapatikana burevsMercury 2mediumGemini 2.5 FlashnonevsMercury 2mediumMercury 2mediumvsMiMo-V2-OmninoneMercury 2mediumvsQwen3.5 Plus 2026-02-15noneMiniMax M2.7mediumvsgpt-oss-120bnoneInapatikana buregpt-oss-120bnoneInapatikana burevsElephant AlphamediumMistral Small 4mediumvsgpt-oss-120bnoneInapatikana bureDeepSeek V4 PrononevsMercury 2mediumMiniMax M2.5mediumInapatikana burevsgpt-oss-120bnoneInapatikana bureMercury 2mediumvsGPT-5.5noneGemini 3.1 Flash LitenonevsMercury 2medium