Inception: Mercury 2 vs Qwen: Qwen3.5-9B

Mercury 2 inaongoza kwa average score: 4.6 vs 3.8. Mercury 2 ina gharama ya chini ya benchmark: $0.030 vs $0.036. Mercury 2 ni ya haraka zaidi: 829ms vs 82.24s, na pass rates 22.7% vs 25.8%.

Muundo unaopendekezwaMercury 2It has the best score here (4.6), while responding about 99.2x faster than Qwen3.5-9B (medium).

Nafasi: #204
Kiwango cha kupita kwa kila jaribio: 22.7%
Jumla ya tokeni za matokeo: 9,564
Muda wa majibu (wastani): 829ms
Jumla ya gharama: $0.030

Nafasi: #220
Kiwango cha kupita kwa kila jaribio: 25.8%
Jumla ya tokeni za matokeo: 238,561
Muda wa majibu (wastani): 82.24s
Jumla ya gharama: $0.036

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-07-25

Kipimo	Mercury 2 Mercury 2 none Toleo: 2026-02-24	Qwen3.5-9B Qwen3.5-9B medium Toleo: 2026-03-02

Kipimo	Mercury 2 Mercury 2 none Toleo: 2026-02-24	Qwen3.5-9B Qwen3.5-9B medium Toleo: 2026-03-02
Alama	4.6	3.8
Nafasi	#204	#220
Uaminifu	10.0	5.0
Uthabiti	9.2	8.1
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio	22.7%	25.8%
Majaribio yasiyo thabiti	2	5
Jumla ya uendeshaji	66	66
Gharama kwa matokeo	0.734	1.187
Jumla ya gharama	$0.030	$0.036
Bei ya ingizo	$0.250 / 1M	$0.100 / 1M
Bei ya toleo	$0.750 / 1M	$0.150 / 1M
Jumla ya tokeni za ingizo	88,704	17,070
Tokeni za matokeo	9,564	29,045
Tokeni za hoja	0	209,516
Muda wa majibu (wastani)	829ms	82.24s
Muda wa majibu (upeo)	4.52s	226.38s
Muda wa majibu (jumla)	18.24s	1315.88s

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#204 Mercury 2

none

Gharama: $0.002
Muda: 1.8s
Tokeni: 1,514 tok

#220 Qwen3.5-9B

medium

Gharama: $0.001
Muda: 35.9s
Tokeni: 3,030 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Kategoria:

Mbinu za kupinga AI	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mercury 2	3.0	10.0	0.0%	0		483ms	631	286	0
Qwen3.5-9B	5.1	5.8	50.0%	2		34.44s	369	2,621	12,411

Uandishi wa msimbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mercury 2	3.4	9.6	0.0%	0		1.03s	7,229	3,088	0
Qwen3.5-9B	2.9	10.0	0.0%	0		100.88s	2,396	7,890	41,129

Mchanganyiko	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mercury 2	3.0	10.0	0.0%	0		2.56s	65,412	5,256	0
Qwen3.5-9B	3.0	10.0	0.0%	0		0ms	0	0	0

Uchanganuzi na uchimbaji wa data	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mercury 2	7.3	5.9	83.3%	1		667ms	6,362	180	0
Qwen3.5-9B	3.6	5.6	33.3%	1		87.31s	4,722	1,383	32,113

Mahususi kwa domeni	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mercury 2	5.3	7.2	44.4%	1		534ms	784	46	0
Qwen3.5-9B	3.6	7.2	22.2%	1		137.75s	295	11,549	48,475

Akili ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mercury 2	4.8	10.0	0.0%	0		628ms	495	159	0
Qwen3.5-9B	2.8	1.6	33.3%	1		226.38s	180	0	30,695

Ufuataji wa maagizo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mercury 2	6.5	10.0	50.0%	0		551ms	691	82	0
Qwen3.5-9B	6.5	10.0	50.0%	0		5.75s	381	491	1,824

Utatuzi wa mafumbo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mercury 2	3.1	10.0	0.0%	0		535ms	694	251	0
Qwen3.5-9B	3.0	10.0	0.0%	0		32.27s	376	1,593	12,026

Mwito wa zana	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mercury 2	10.0	10.0	100.0%	0		1.27s	6,193	197	0
Qwen3.5-9B	10.0	10.0	100.0%	0		4.31s	8,283	444	1,149

Maarifa ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za ingizo	Tokeni za matokeo	Tokeni za hoja
Mercury 2	3.0	10.0	0.0%	0		548ms	213	19	0
Qwen3.5-9B	3.0	10.0	0.0%	0		177.02s	68	3,074	29,694

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

gpt-oss-120bnoneInapatikana burevsQwen3.5-9Bmedium CobuddymediumvsMercury 2none Mercury 2nonevsQwen3 Coder Nextmedium Mercury 2nonevsMiniMax M2.5medium Granite 4.1 8BnonevsQwen3.5-9Bmedium Mercury 2nonevsGLM 4.7 Flashmedium Qwen3.5-9BmediumvsGrok 4.20none Mercury 2nonevsLaguna S 2.1lowInapatikana bure Mercury 2nonevsMiniMax M2.7medium Mercury 2nonevsMistral Small 4medium Mercury 2nonevsLaguna S 2.1highInapatikana bure Laguna S 2.1noneInapatikana burevsQwen3.5-9Bmedium