Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Inception: Mercury 2 vs OpenAI: GPT-5.5

Summary

Mercury 2 vs GPT-5.5 benchmark comparison: GPT-5.5 leads on average score with 9.3 vs 7.5. Mercury 2 has the lower benchmark cost at $0.058 vs $0.907. Mercury 2 is faster at 2.24s vs 9.76s, with pass rates of 54.0% vs 85.7%.

Recommended model: GPT-5.5 - It has the strongest score in this comparison (9.3) and the best overall balance of cost and response time across all 2 models.

Last updated at: 2026-06-18

Metric Mercury 2 Mercury 2 medium Release: 2026-02-24 GPT-5.5 GPT-5.5 low Release: 2026-04-24
Score 7.5 9.3
Rank #44 #4
Reliability 10.0 10.0
Consistency 8.8 10.0
Tests Correct
Attempt pass rate 54.0% 85.7%
Flaky tests 3 0
Total Runs 63 63
Cost per result 0.578 5.035
Total Cost $0.058 $0.907
Input Price $0.250 / 1M $5.000 / 1M
Output Price $0.750 / 1M $30.000 / 1M
Total Input Tokens 35,116 34,209
Output Tokens 4,048 2,046
Reasoning Tokens 61,219 22,460
Response Time (avg) 2.24s 9.76s
Response Time (max) 14.63s 56.19s
Response Time (total) 44.72s 204.92s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#44 Mercury 2

medium
Cost
$0.002
Time
2.1s
Tokens
1,702 tok

#4 GPT-5.5

low
Cost
$0.068
Time
37.0s
Tokens
2,339 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 6.9 9.9 50.0% 0 1.12s 554 2,546 2,609
GPT-5.5 10.0 10.0 100.0% 0 4.41s 606 238 1,020
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 8.2 7.7 77.8% 1 2.04s 7,065 296 11,328
GPT-5.5 10.0 10.0 100.0% 0 15.04s 7,302 423 6,402
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 10.0 10.0 100.0% 0 3.28s 12,909 268 4,887
GPT-5.5 10.0 10.0 100.0% 0 9.56s 11,019 303 717
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 7.3 5.9 83.3% 1 1.11s 6,234 183 1,656
GPT-5.5 10.0 10.0 100.0% 0 3.28s 7,140 228 157
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 2.9 7.2 11.1% 1 6.48s 695 41 30,754
GPT-5.5 5.3 10.0 33.3% 0 28.05s 723 69 11,609
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 4.8 10.0 0.0% 0 821ms 456 137 542
GPT-5.5 10.0 10.0 100.0% 0 5.17s 477 133 245
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 10.0 10.0 100.0% 0 1.07s 340 14 958
GPT-5.5 9.9 10.0 100.0% 0 3.74s 660 93 415
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 5.4 10.0 33.3% 0 949ms 601 361 2,781
GPT-5.5 10.0 10.0 100.0% 0 4.74s 642 279 954
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 10.0 10.0 100.0% 0 1.89s 6,080 180 1,956
GPT-5.5 10.0 10.0 100.0% 0 4.96s 5,445 250 101
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 3.0 10.0 0.0% 0 2.58s 182 22 3,748
GPT-5.5 3.0 10.0 0.0% 0 10.06s 195 30 840

Quick Compare

Switch Comparison Pair

Mercury 2mediumvsGPT-5.3 ChatnoneGPT-5.5lowvsQwen3.7 MaxmediumDeepSeek V4 ProhighvsMercury 2mediumClaude Fable 5mediumvsGPT-5.5lowGemini 3.1 Pro PreviewmediumvsGPT-5.5lowMercury 2mediumvsStep 3.7 FlashlowGemini 3 Flash PreviewlowvsMercury 2mediumGemini 3.5 FlashmediumvsGPT-5.5lowClaude Sonnet 4.6nonevsMercury 2mediumGemini 3 Flash PreviewmediumvsGPT-5.5lowClaude Opus 4.8nonevsMercury 2mediumDeepSeek V4 PrononevsMercury 2medium