#40

Mercury 2

Inception · Toleo: 2026-02-24 · inception/mercury-2::medium

Wastani wa alama

48

Gharama kwa matokeo

0.726

Uthabiti

83

Jumla ya gharama

$0.044

Majaribio sahihi

6

Jaribio huhesabiwa kuwa limepita kikamilifu tu ikiwa run zake zote zimepita.

Majaribio yenye makosa

9

Kiwango cha kupita kwa kila jaribio: 51.1%

Majaribio yasiyo thabiti

3

Muda wa majibu: wastani 2.47s · jumla 34.56s · upeo 14.63s

Jibu lisilo sahihi: 5 Hakufuata maelekezo: 3 Hitilafu ya API: 1

Modeli bora kwa alama

Chagua modeli ya kwanza, kisha bofya modeli ya pili kufungua ukurasa wa kulinganisha bega kwa bega.

#34 GPT-5 Nano 54

#35 gpt-oss-120b 51

#36 Gemini 2.5 Flash 51

#37 Qwen3.5-27B 49

#38 DeepSeek V3.2 49

#39 Qwen3.5-122B-A10B 49

#40 Mercury 2 48

#41 Qwen3.5-Flash 47

#42 MiniMax M2.5 46

#43 Qwen3.5-35B-A3B 45

#44 GPT-5.4 45

#45 Trinity Large Preview (free) 41

#46 GPT-4o-mini 41

Kategoria	Wastani wa alama	Uthabiti	Majaribio sahihi
Anti-AI Tricks	73	98	2/3
Combined	100	100	1/1
Data parsing and extraction	55	59	1/2
Domain specific	100	72	0/3
Instructions following	55	100	1/2
Puzzle Solving	17	75	0/3
Tool Calling	100	100	1/1