AI BENCHY Compare

Inception: Mercury 2 vs Qwen: Qwen3.5-9B

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-03-12

Kipimo	Mercury 2 Mercury 2 none Toleo: 2026-02-24	Qwen3.5-9B Qwen3.5-9B medium Toleo: 2026-03-02

Kipimo	Mercury 2 Mercury 2 none Toleo: 2026-02-24	Qwen3.5-9B Qwen3.5-9B medium Toleo: 2026-03-02
Nafasi	#61	#66
Wastani wa alama	3.4	2.6
Uthabiti	9.0	7.4
Gharama kwa matokeo	0.153	0.779
Jumla ya gharama	$0.007	$0.024
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio	31.3%	35.4%
Majaribio yasiyo thabiti	2	5
Jumla ya uendeshaji	48	48
Tokeni za matokeo	1,303	17,930
Tokeni za hoja	0	139,706
Muda wa majibu (wastani)	596ms	71.44s
Muda wa majibu (upeo)	1.27s	226.38s
Muda wa majibu (jumla)	9.54s	928.77s

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Wastani wa alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Wastani wa alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Mbinu za kupinga AI	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mercury 2	10.0	10.0	0.0%	0		466ms	274	0
Qwen3.5-9B	4.0	7.2	55.6%	1		31.54s	2,410	10,913

Mchanganyiko	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mercury 2	10.0	10.0	0.0%	0		606ms	131	0
Qwen3.5-9B	10.0	10.0	0.0%	0		0ms	0	0

Uchanganuzi na uchimbaji wa data	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mercury 2	5.5	5.9	83.3%	1		667ms	180	0
Qwen3.5-9B	5.0	5.6	33.3%	1		87.31s	1,383	32,113

Mahususi kwa domeni	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mercury 2	4.0	7.2	44.4%	1		534ms	46	0
Qwen3.5-9B	10.0	7.2	22.2%	1		137.75s	11,549	48,475

Akili ya jumla	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mercury 2	4.0	10.0	0.0%	0		628ms	159	0
Qwen3.5-9B	10.0	1.6	33.3%	1		226.38s	0	30,695

Ufuataji wa maagizo	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mercury 2	5.5	10.0	50.0%	0		551ms	82	0
Qwen3.5-9B	5.5	5.8	66.7%	1		17.15s	599	4,517

Puzzle Solving	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mercury 2	10.0	10.0	0.0%	0		533ms	234	0
Qwen3.5-9B	10.0	10.0	0.0%	0		33.38s	1,545	11,844

Mwito wa zana	Alama	Uthabiti	Kiwango cha kupita kwa kila jaribio	Majaribio yasiyo thabiti	Majaribio sahihi	Muda wa majibu (wastani)	Tokeni za matokeo	Tokeni za hoja
Mercury 2	10.0	10.0	100.0%	0		1.27s	197	0
Qwen3.5-9B	10.0	10.0	100.0%	0		4.31s	444	1,149

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho

Mercury 2nonevsQwen3 Coder Nextmedium Mercury 2nonevsGLM 4.7 Flashmedium Qwen3.5-9BmediumvsMiMo-V2-Flashnone Qwen3.5-9BmediumvsGrok 4.1 Fastnone Nemotron 3 Super 120b A12bnoneInapatikana burevsQwen3.5-9Bmedium Qwen3.5-9BmediumvsGLM 4.7 Flashnone Mercury 2nonevsMiniMax M2.5medium GPT-4o-mininonevsQwen3.5-9Bmedium Kimi K2.5nonevsQwen3.5-9Bmedium Mercury 2nonevsGrok 4.20 Multi-Agent Betamedium Trinity Large PreviewnoneInapatikana burevsQwen3.5-9Bmedium Mercury 2nonevsgpt-oss-120bmediumInapatikana bure