Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Inception: Mercury 2 vs Elephant

Last updated at: 2026-04-14

Metric Mercury 2 Mercury 2 medium Release: 2026-02-24 Elephant Elephant none Release: 2026-04-14
Score 6.5 5.2
Rank #51 #81
Consistency 8.6 9.6
Tests Correct
Attempt pass rate 53.7% 31.5%
Flaky tests 3 1
Total Runs 54 54
Cost per result 0.580 0.000
Total Cost $0.047 $0.000
Input Price $0.250 / 1M $0.000 / 1M
Output Price $0.750 / 1M $0.000 / 1M
Output Tokens 3,972 2,573
Reasoning Tokens 48,333 0
Response Time (avg) 2.21s 1.23s
Response Time (max) 14.63s 3.81s
Response Time (total) 37.51s 22.16s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 6.9 9.9 50.0% 0 1.12s 2,546 2,609
Elephant 6.6 10.0 50.0% 0 963ms 610 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 10.0 10.0 100.0% 0 1.53s 249 2,213
Elephant 6.4 3.3 66.7% 1 1.39s 375 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 10.0 10.0 100.0% 0 3.28s 268 4,887
Elephant 3.0 10.0 0.0% 0 3.81s 731 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 7.3 5.9 83.3% 1 1.11s 183 1,656
Elephant 6.5 10.0 50.0% 0 1.04s 246 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 2.9 7.2 11.1% 1 6.48s 41 30,754
Elephant 3.0 10.0 0.0% 0 927ms 24 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 4.8 10.0 0.0% 0 821ms 137 542
Elephant 4.0 10.0 0.0% 0 854ms 106 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 10.0 10.0 100.0% 0 1.07s 14 958
Elephant 9.8 10.0 100.0% 0 1.03s 81 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 3.9 7.5 22.2% 1 934ms 354 2,758
Elephant 3.3 10.0 0.0% 0 849ms 170 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 10.0 10.0 100.0% 0 1.89s 180 1,956
Elephant 3.0 10.0 0.0% 0 2.79s 230 0

Quick Compare

Switch Comparison Pair

Mercury 2mediumvsMiMo-V2-OmninoneMiniMax M2.7mediumvsElephantnoneMercury 2mediumvsGLM 5noneMercury 2mediumvsQwen3.5 Plus 2026-02-15noneMercury 2mediumvsGLM 5V TurbononeMercury 2mediumvsQwen3.5-FlashnoneGemma 4 26B A4BnoneFree AvailablevsMercury 2mediumSeed-2.0-LitenonevsMercury 2mediumGemini 2.5 FlashnonevsMercury 2mediumMercury 2mediumvsQwen3.5-35B-A3BnoneDeepSeek V3.2nonevsMercury 2mediumGemma 4 31BnoneFree AvailablevsMercury 2medium