Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Cobuddy vs Inception: Mercury 2

Last updated at: 2026-05-22

Metric Cobuddy Cobuddy medium Release: 2026-05-06 Free Available Mercury 2 Mercury 2 medium Release: 2026-02-24
Score 5.7 6.3
Rank #105 #90
Reliability 9.9 10.0
Consistency 7.0 8.4
Tests Correct
Attempt pass rate 51.7% 50.0%
Flaky tests 7 4
Total Runs 60 60
Cost per result 0.000 0.687
Total Cost $0.000 $0.055
Input Price $0.000 / 1M $0.250 / 1M
Output Price $0.000 / 1M $0.750 / 1M
Output Tokens 1,663 4,015
Reasoning Tokens 116,522 58,382
Response Time (avg) 39.91s 2.27s
Response Time (max) 309.02s 14.63s
Response Time (total) 798.21s 43.15s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 8.7 7.9 91.7% 1 10.00s 98 4,666
Mercury 2 6.9 9.9 50.0% 0 1.12s 2,546 2,609
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 4.1 5.1 33.3% 1 79.17s 358 30,138
Mercury 2 7.2 6.5 66.7% 1 2.29s 270 8,514
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 3.0 10.0 0.0% 0 47.38s 465 7,265
Mercury 2 10.0 10.0 100.0% 0 3.28s 268 4,887
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 6.3 5.8 66.7% 1 17.36s 275 5,591
Mercury 2 7.3 5.9 83.3% 1 1.11s 183 1,656
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 2.9 4.4 22.2% 2 128.15s 10 49,454
Mercury 2 2.9 7.2 11.1% 1 6.48s 41 30,754
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 4.2 9.9 0.0% 0 23.23s 76 3,782
Mercury 2 4.8 10.0 0.0% 0 821ms 137 542
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 9.8 10.0 100.0% 0 11.60s 64 2,842
Mercury 2 10.0 10.0 100.0% 0 1.07s 14 958
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 3.5 4.4 33.3% 2 12.91s 175 5,627
Mercury 2 3.8 7.3 22.2% 1 934ms 354 2,758
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 10.0 10.0 100.0% 0 11.19s 133 294
Mercury 2 10.0 10.0 100.0% 0 1.89s 180 1,956
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Cobuddy 3.0 10.0 0.0% 0 36.98s 9 6,863
Mercury 2 3.0 10.0 0.0% 0 2.58s 22 3,748

Quick Compare

Switch Comparison Pair

CobuddymediumFree AvailablevsOwl AlphanoneCobuddymediumFree AvailablevsQwen3.6 27BnoneCobuddymediumFree AvailablevsQwen3.5-27BnoneCobuddymediumFree AvailablevsMiMo-V2-PrononeMercury 2mediumvsGLM 5noneCobuddymediumFree AvailablevsQwen3.5-35B-A3BnoneCobuddymediumFree AvailablevsQwen3.5 Plus 2026-04-20noneGemma 4 26B A4BnoneFree AvailablevsMercury 2mediumGemini 2.5 FlashnonevsMercury 2mediumMercury 2mediumvsMiMo-V2-OmninoneCobuddymediumFree AvailablevsGLM 4.7 FlashnoneMercury 2mediumvsQwen3.5 Plus 2026-02-15none