Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Inception: Mercury 2 vs Elephant

Last updated at: 2026-04-16

Metric Mercury 2 Mercury 2 none Release: 2026-02-24 Elephant Elephant medium Release: 2026-04-14
Score 4.8 5.2
Rank #89 #79
Consistency 9.0 9.6
Tests Correct
Attempt pass rate 27.8% 29.6%
Flaky tests 2 1
Total Runs 54 54
Cost per result 0.165 0.000
Total Cost $0.007 $0.000
Input Price $0.250 / 1M $0.000 / 1M
Output Price $0.750 / 1M $0.000 / 1M
Output Tokens 1,625 2,596
Reasoning Tokens 0 0
Response Time (avg) 613ms 1.27s
Response Time (max) 1.27s 3.70s
Response Time (total) 11.04s 22.82s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 3.0 10.0 0.0% 0 483ms 286 0
Elephant 6.6 10.0 50.0% 0 1.19s 815 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 3.6 8.9 0.0% 0 969ms 310 0
Elephant 5.1 3.3 33.3% 1 1.30s 365 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 3.0 10.0 0.0% 0 606ms 131 0
Elephant 3.0 10.0 0.0% 0 3.70s 562 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 7.3 5.9 83.3% 1 667ms 180 0
Elephant 6.5 10.0 50.0% 0 979ms 246 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 5.3 7.2 44.4% 1 534ms 46 0
Elephant 3.0 10.0 0.0% 0 925ms 24 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 4.8 10.0 0.0% 0 628ms 159 0
Elephant 4.3 10.0 0.0% 0 920ms 105 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 6.5 10.0 50.0% 0 551ms 82 0
Elephant 9.8 10.0 100.0% 0 987ms 82 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 3.1 10.0 0.0% 0 533ms 234 0
Elephant 3.7 10.0 0.0% 0 867ms 166 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 10.0 10.0 100.0% 0 1.27s 197 0
Elephant 3.0 10.0 0.0% 0 2.83s 231 0

Quick Compare

Switch Comparison Pair

ElephantmediumvsGrok 4.20noneMistral Small 4nonevsElephantmediumgpt-oss-120bnoneFree AvailablevsElephantmediumMercury 2nonevsQwen3 Coder NextmediumTrinity Large PreviewnoneFree AvailablevsElephantmediumGPT-5.4 MininonevsElephantmediumElephantmediumvsQwen3 Coder NextnoneNemotron 3 SupernoneFree AvailablevsElephantmediumMercury 2nonevsGLM 4.7 FlashmediumElephantmediumvsGLM 5 TurbononeKimi K2.5nonevsElephantmediumElephantmediumvsGLM 5.1none