Navigate
Advertise here

Mercury 2.5 vs GLM 4.7 Flash (medium)

GLM 4.7 Flash (medium) leads on average score with 4.2 vs 4.1. Mercury 2.5 has the lower benchmark cost at $0.026 vs $0.193. Mercury 2.5 is faster at 5.10s vs 150.90s, with pass rates of 24.6% vs 30.4%.

Last updated at: 2026-10-19

Compared models

Rank
#397
Total Output Tokens
89,958
Response Time (avg)
5.10s
Total Cost
$0.026
Rank
#394
Total Output Tokens
447,599
Response Time (avg)
150.90s
Total Cost
$0.193
Recommended model Mercury 2.5

Its score stays close to the best score here (4.1 vs 4.2), while costing about 7.4x less than GLM 4.7 Flash (medium).

Detailed comparison

Metric Mercury 2.5 Mercury 2.5 none Release: 2026-09-08 GLM 4.7 Flash GLM 4.7 Flash medium Release: 2026-01-19
Score 4.1 4.2
Rank #397 #394
Reliability 10.0 9.4
Consistency 7.6 7.1
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 24.6% 30.4%
Flaky tests 7 8
Total Runs 69 69
Cost per result 1.298 4.822
Total Cost $0.026 $0.193
Input Price $0.040 / 1M $0.061 / 1M
Output Price $0.150 / 1M $0.400 / 1M
Cache Read Price $0.004 / 1M N/A
Cache Write Price N/A N/A
Total Input Tokens 311,488 228,711
Output Tokens 89,958 42,254
Reasoning Tokens 0 422,121
Response Time (avg) 5.10s 150.90s
Response Time (max) 63.41s 1539.97s
Response Time (total) 117.24s 2414.33s
Parameters ~100B 30B total (3B active)
Availability Closed Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#397 Mercury 2.5

none
Cost
$0.001
Time
2.7s
Tokens
2,749 tok

#394 GLM 4.7 Flash

medium
No output was saved. The original provider response or failure reason is unavailable.
Cost
$0.000
Time
186.2s
Tokens
12,112 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2.5 3.7 7.0 22.2% 1 12.50s 7,888 61,297 0
GLM 4.7 Flash 3.2 7.4 11.1% 1 55.33s 3,106 4,981 22,387

Switch Comparison Pair