Mercury 2.5 vs Qwen3.5-9B (medium)

Compared models

Rank: #397
Total Output Tokens: 89,958
Response Time (avg): 5.10s
Total Cost: $0.026

Rank: #399
Total Output Tokens: 447,247
Response Time (avg): 110.18s
Total Cost: $0.106

Recommended model Mercury 2.5

It has the best score here (4.1), while costing about 4.1x less than Qwen3.5-9B (medium).

Detailed comparison

Metric	Mercury 2.5 Mercury 2.5 none Release: 2026-09-08	Qwen3.5-9B Qwen3.5-9B medium Release: 2026-03-02

Metric	Mercury 2.5 Mercury 2.5 none Release: 2026-09-08	Qwen3.5-9B Qwen3.5-9B medium Release: 2026-03-02
Score	4.1	4.0
Rank	#397	#399
Reliability	10.0	8.7
Consistency	7.6	7.9
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	24.6%	26.1%
Flaky tests	7	6
Total Runs	69	69
Cost per result	1.298	3.523
Total Cost	$0.026	$0.106
Input Price	$0.040 / 1M	$0.100 / 1M
Output Price	$0.150 / 1M	$0.150 / 1M
Cache Read Price	$0.004 / 1M	N/A
Cache Write Price	N/A	N/A
Total Input Tokens	311,488	387,323
Output Tokens	89,958	48,562
Reasoning Tokens	0	410,431
Response Time (avg)	5.10s	110.18s
Response Time (max)	63.41s	569.97s
Response Time (total)	117.24s	1873.00s
Parameters	~100B	9B
Availability	Closed	Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#397 Mercury 2.5

none

Cost: $0.001
Time: 2.7s
Tokens: 2,749 tok

#399 Qwen3.5-9B

medium

Cost: $0.001
Time: 35.9s
Tokens: 3,030 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mercury 2.5	5.0	10.0	0.0%	0		63.41s	187,748	18,815	0
Qwen3.5-9B	5.2	3.2	33.3%	1		152.85s	370,128	1,827	43,724

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mercury 2.5	3.8	8.3	16.7%	1		469ms	808	310	0
Qwen3.5-9B	5.1	5.8	50.0%	2		34.44s	369	2,621	12,411

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mercury 2.5	3.7	7.0	22.2%	1		12.50s	7,888	61,297	0
Qwen3.5-9B	2.9	10.0	0.0%	0		100.88s	2,396	7,890	41,129

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mercury 2.5	3.0	10.0	0.0%	0		3.24s	94,347	7,982	0
Qwen3.5-9B	3.0	10.0	0.0%	0		0ms	0	0	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mercury 2.5	2.8	1.7	33.3%	2		885ms	8,352	754	0
Qwen3.5-9B	3.6	5.6	33.3%	1		87.31s	4,722	1,383	32,113

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mercury 2.5	5.3	7.2	44.4%	1		533ms	872	49	0
Qwen3.5-9B	3.6	7.2	22.2%	1		272.50s	420	29,239	205,666

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mercury 2.5	4.3	9.9	0.0%	0		438ms	540	138	0
Qwen3.5-9B	2.8	1.6	33.3%	1		226.38s	180	0	30,695

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mercury 2.5	4.9	6.9	33.3%	1		493ms	758	69	0
Qwen3.5-9B	6.5	10.0	50.0%	0		5.75s	381	491	1,824

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mercury 2.5	3.7	7.2	22.2%	1		515ms	788	250	0
Qwen3.5-9B	3.0	10.0	0.0%	0		32.27s	376	1,593	12,026

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mercury 2.5	10.0	10.0	100.0%	0		1.23s	9,150	275	0
Qwen3.5-9B	10.0	10.0	100.0%	0		4.31s	8,283	444	1,149

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Mercury 2.5	3.0	10.0	0.0%	0		384ms	237	19	0
Qwen3.5-9B	3.0	10.0	0.0%	0		177.02s	68	3,074	29,694

Switch Comparison Pair

Mercury 2.5nonevsGLM 4.7 Flashmedium gpt-oss-120bnonevsQwen3.5-9Bmedium Mercury 2.5nonevsMiniMax M2.5medium Ling 3.0 TinydefaultvsQwen3.5-9Bmedium Granite 4.1 8bdefaultvsQwen3.5-9Bmedium Nemotron 3.5 LightningnoneFree AvailablevsQwen3.5-9Bmedium CobuddymediumFree AvailablevsMercury 2.5none Mercury 2.5nonevsLing 3.0 Tinydefault Granite 4.1 8bdefaultvsMercury 2.5none Trinity Large PreviewdefaultFree AvailablevsMercury 2.5none Mercury 2.5nonevsKAT Coder AIR V2.5default Mercury 2nonevsQwen3.5-9Bmedium