AI BENCHY Compare

Inception: Mercury 2 vs OpenAI: GPT-5 Nano

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-04-16

Kipimo	Mercury 2 Mercury 2 none Toleo: 2026-02-24	GPT-5 Nano GPT-5 Nano medium Toleo: 2025-08-07

Kipimo	Mercury 2 Mercury 2 none Toleo: 2026-02-24	GPT-5 Nano GPT-5 Nano medium Toleo: 2025-08-07
Alama	4.8	6.3
Nafasi	#89	#56
Uthabiti	9.0	6.5
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio	27.8%	59.3%
Majaribio yasiyo thabiti	2	8
Jumla ya uendeshaji	54	54
Gharama kwa matokeo	0.165	0.942
Jumla ya gharama	$0.007	$0.066
Bei ya ingizo	$0.250 / 1M	$0.050 / 1M
Bei ya toleo	$0.750 / 1M	$0.400 / 1M
Tokeni za matokeo	1,625	4,980
Tokeni za hoja	0	156,288
Muda wa majibu (wastani)	613ms	44.13s
Muda wa majibu (upeo)	1.27s	204.02s
Muda wa majibu (jumla)	11.04s	485.47s

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mercury 2	3.0	10.0	0.0%	0		483ms	286	0
GPT-5 Nano	6.5	7.9	58.3%	1		25.50s	1,221	21,184

Uandishi wa msimbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mercury 2	3.6	8.9	0.0%	0		969ms	310	0
GPT-5 Nano	6.7	3.5	66.7%	1		40.73s	480	12,992

Mchanganyiko	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mercury 2	3.0	10.0	0.0%	0		606ms	131	0
GPT-5 Nano	10.0	10.0	100.0%	0		65.96s	578	17,984

Uchanganuzi na uchimbaji wa data	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mercury 2	7.3	5.9	83.3%	1		667ms	180	0
GPT-5 Nano	3.7	1.7	50.0%	2		21.42s	453	10,560

Mahususi kwa domeni	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mercury 2	5.3	7.2	44.4%	1		534ms	46	0
GPT-5 Nano	5.2	4.4	55.6%	2		204.02s	237	64,448

Akili ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mercury 2	4.8	10.0	0.0%	0		628ms	159	0
GPT-5 Nano	4.1	10.0	0.0%	0		17.51s	202	4,608

Ufuataji wa maagizo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mercury 2	6.5	10.0	50.0%	0		551ms	82	0
GPT-5 Nano	8.5	6.8	83.3%	1		11.90s	382	4,096

Utatuzi wa mafumbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mercury 2	3.1	10.0	0.0%	0		533ms	234	0
GPT-5 Nano	5.3	7.2	44.4%	1		19.81s	869	13,440

Mwito wa zana	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mercury 2	10.0	10.0	100.0%	0		1.27s	197	0
GPT-5 Nano	10.0	10.0	100.0%	0		33.30s	558	6,976

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

GPT-5 NanomediumvsGLM 5V Turbonone GPT-5 NanomediumvsQwen3.5-Flashnone Mercury 2nonevsQwen3 Coder Nextmedium Gemma 4 26B A4BnoneInapatikana burevsGPT-5 Nanomedium Seed-2.0-LitenonevsGPT-5 Nanomedium Gemini 2.5 FlashnonevsGPT-5 Nanomedium GPT-5 NanomediumvsQwen3.5-35B-A3Bnone DeepSeek V3.2nonevsGPT-5 Nanomedium Mercury 2nonevsGLM 4.7 Flashmedium GPT-5 NanomediumvsMiMo-V2-Omninone GPT-5 NanomediumvsMiMo-V2-Pronone GPT-5 NanomediumvsQwen3.5-27Bnone