Urambazaji
Advertise here

Mercury 2.5 Preview (high) vs KAT-Coder-Pro V2.5 (low)

KAT-Coder-Pro V2.5 (low) inaongoza kwa average score: 6.5 vs 6.5. Mercury 2.5 Preview (high) ina gharama ya chini ya benchmark: $0.039 vs $0.400. Mercury 2.5 Preview (high) ni ya haraka zaidi: 7.61s vs 19.40s, na pass rates 65.2% vs 65.2%.

Benchmark zimetengenezwa kutoka seti za majaribio za AI BENCHY tarehe: 2026-10-01

Modeli zilizolinganishwa

Nafasi
#194
Jumla ya tokeni za matokeo
180,597
Muda wa majibu (wastani)
7.61s
Jumla ya gharama
$0.039
Nafasi
#191
Jumla ya tokeni za matokeo
113,193
Muda wa majibu (wastani)
19.40s
Jumla ya gharama
$0.400
Muundo unaopendekezwa Mercury 2.5 Preview (high)

Its score stays close to the best score here (6.5 vs 6.5), while costing about 10.5x less than KAT-Coder-Pro V2.5 (low).

Ulinganisho wa kina

Kipimo Mercury 2.5 Preview Mercury 2.5 Preview high Toleo: 2026-09-02 KAT-Coder-Pro V2.5 KAT-Coder-Pro V2.5 low Toleo: 2026-07-14
Alama 6.5 6.5
Nafasi #194 #191
Uaminifu 9.9 10.0
Uthabiti 8.0 7.1
Majaribio 69/69 69/69
Majaribio sahihi
Kiwango cha kupita kwa kila jaribio 65.2% 65.2%
Majaribio yasiyo thabiti 6 8
Jumla ya uendeshaji 69 69
Gharama kwa matokeo 0.319 3.636
Jumla ya gharama $0.039 $0.400
Bei ya ingizo $0.000 / 1M $0.740 / 1M
Bei ya toleo $0.000 / 1M $2.960 / 1M
Jumla ya tokeni za ingizo 298,512 87,682
Tokeni za matokeo 3,178 7,166
Tokeni za hoja 177,419 106,027
Muda wa majibu (wastani) 7.61s 19.40s
Muda wa majibu (upeo) 86.84s 209.15s
Muda wa majibu (jumla) 175.08s 446.11s
Vigezo ~100B ~700B jumla (~72B vinavyotumika)
Upatikanaji Imefungwa Imefungwa

Onyesho la kizazi cha modeli

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#194 Mercury 2.5 Preview

high
Gharama
$0.001
Muda
4.5s
Tokeni
3,851 tok

#191 KAT-Coder-Pro V2.5

low
Gharama
$0.016
Muda
47.6s
Tokeni
5,182 tok

Modeli bora kwa alama

Alama dhidi ya gharama ya jumla

Muda wa majibu (wastani)

Alama vs Muda wa majibu (wastani)

Jumla ya tokeni za matokeo

Alama vs Jumla ya tokeni za matokeo

Mgawanyo wa kategoria

Uandishi wa msimbo Alama Uthabiti Kiwango cha kupita kwa kila jaribio Majaribio yasiyo thabiti Majaribio sahihi Muda wa majibu (wastani) Tokeni za ingizo Tokeni za matokeo Tokeni za hoja
Mercury 2.5 Preview 6.7 7.8 55.6% 1 6.13s 7,751 485 42,569
KAT-Coder-Pro V2.5 7.8 10.0 66.7% 0 24.87s 7,893 402 24,945

Ulinganisho wa haraka

Badilisha jozi ya ulinganisho