Navigate
Advertise here

Cobuddy (medium) vs Mercury 2

The average score is effectively tied at 4.4 vs 4.4. Cobuddy (medium) has the lower benchmark cost at $0.000 vs $0.033. Mercury 2 is faster at 1.18s vs 38.01s, with pass rates of 43.5% vs 23.2%.

Last updated at: 2026-10-17

Compared models

Rank
#381
Total Output Tokens
118,380
Response Time (avg)
38.01s
Total Cost
$0.000
Rank
#382
Total Output Tokens
9,709
Response Time (avg)
1.18s
Total Cost
$0.033
Recommended model Mercury 2

It has the best score here (4.4), while responding about 32.2x faster than Cobuddy (medium).

Detailed comparison

Metric Cobuddy Cobuddy medium Release: 2026-05-06 Free Available Mercury 2 Mercury 2 none Release: 2026-02-24
Score 4.4 4.4
Rank #381 #382
Reliability 10.0 10.0
Consistency 7.3 9.2
Attempts 66/69 69/69
Tests Correct
Attempt pass rate 43.5% 23.2%
Flaky tests 6 2
Total Runs 66 69
Cost per result 0.000 0.812
Total Cost $0.000 $0.033
Input Price $0.000 / 1M $0.250 / 1M
Output Price $0.000 / 1M $0.750 / 1M
Cache Read Price N/A $0.025 / 1M
Cache Write Price N/A N/A
Total Input Tokens 37,449 100,634
Output Tokens 1,677 9,609
Reasoning Tokens 116,703 100
Response Time (avg) 38.01s 1.18s
Response Time (max) 309.02s 9.00s
Response Time (total) 798.15s 27.14s
Parameters ~21B total (~3B active) ~100B
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#381 Cobuddy

medium
No endpoints found for baidu/cobuddy:free.
Cost
$0.000
Time
0.1s
Tokens
0 tok

#382 Mercury 2

none
Cost
$0.002
Time
1.8s
Tokens
1,514 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Cobuddy 3.7 6.7 22.2% 1 79.17s 4,726 358 30,138
Mercury 2 3.4 9.6 0.0% 0 1.03s 7,229 3,088 0

Switch Comparison Pair