Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Inception: Mercury 2 vs Qwen: Qwen3.5-9B

Last updated at: 2026-04-26

Metric Mercury 2 Mercury 2 medium Release: 2026-02-24 Qwen3.5-9B Qwen3.5-9B none Release: 2026-03-02
Score 6.5 4.8
Rank #65 #105
Reliability N/A N/A
Consistency 8.6 9.6
Tests Correct
Attempt pass rate 53.7% 24.1%
Flaky tests 3 1
Total Runs 54 54
Cost per result 0.580 0.116
Total Cost $0.047 $0.005
Input Price $0.250 / 1M $0.100 / 1M
Output Price $0.750 / 1M $0.150 / 1M
Output Tokens 3,972 3,951
Reasoning Tokens 48,333 0
Response Time (avg) 2.21s 1.47s
Response Time (max) 14.63s 5.91s
Response Time (total) 37.51s 26.43s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 6.9 9.9 50.0% 0 1.12s 2,546 2,609
Qwen3.5-9B 3.1 9.9 0.0% 0 1.71s 582 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 10.0 10.0 100.0% 0 1.53s 249 2,213
Qwen3.5-9B 5.2 3.4 33.3% 1 5.69s 1,006 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 10.0 10.0 100.0% 0 3.28s 268 4,887
Qwen3.5-9B 3.0 10.0 0.0% 0 5.91s 1,255 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 7.3 5.9 83.3% 1 1.11s 183 1,656
Qwen3.5-9B 10.0 10.0 100.0% 0 847ms 249 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 2.9 7.2 11.1% 1 6.48s 41 30,754
Qwen3.5-9B 3.0 10.0 0.0% 0 464ms 24 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 4.8 10.0 0.0% 0 821ms 137 542
Qwen3.5-9B 4.4 9.9 0.0% 0 552ms 99 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 10.0 10.0 100.0% 0 1.07s 14 958
Qwen3.5-9B 6.5 10.0 50.0% 0 514ms 75 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 3.9 7.5 22.2% 1 934ms 354 2,758
Qwen3.5-9B 3.2 9.9 0.0% 0 683ms 388 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 10.0 10.0 100.0% 0 1.89s 180 1,956
Qwen3.5-9B 10.0 10.0 100.0% 0 1.27s 273 0

Quick Compare

Switch Comparison Pair

Mercury 2mediumvsMiMo-V2-OmninoneMercury 2mediumvsGLM 5noneDeepSeek V4 PrononevsMercury 2mediumQwen3.5-9BnonevsGLM 4.7 FlashmediumMercury 2mediumvsGPT-5.5noneMercury 2mediumvsQwen3.5 Plus 2026-02-15noneMercury 2mediumvsGLM 5V TurbononeMercury 2mediumvsQwen3.5-FlashnoneDeepSeek V4 ProhighvsMercury 2mediumGemma 4 26B A4BnoneFree AvailablevsMercury 2mediumSeed-2.0-LitenonevsMercury 2mediumGemini 2.5 FlashnonevsMercury 2medium