Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Inception: Mercury 2 vs Z.ai: GLM 5

Last updated at: 2026-04-16

Metric Mercury 2 Mercury 2 medium Release: 2026-02-24 GLM 5 GLM 5 none Release: 2026-02-12
Score 6.5 6.6
Rank #53 #52
Consistency 8.6 9.6
Tests Correct
Attempt pass rate 53.7% 51.9%
Flaky tests 3 1
Total Runs 54 54
Cost per result 0.580 0.217
Total Cost $0.047 $0.020
Input Price $0.250 / 1M $0.720 / 1M
Output Price $0.750 / 1M $2.300 / 1M
Output Tokens 3,972 1,959
Reasoning Tokens 48,333 0
Response Time (avg) 2.21s 4.23s
Response Time (max) 14.63s 11.07s
Response Time (total) 37.51s 46.51s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 6.9 9.9 50.0% 0 1.12s 2,546 2,609
GLM 5 4.8 10.0 25.0% 0 2.37s 275 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 10.0 10.0 100.0% 0 1.53s 249 2,213
GLM 5 5.6 3.5 33.3% 1 8.84s 408 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 10.0 10.0 100.0% 0 3.28s 268 4,887
GLM 5 3.0 10.0 0.0% 0 4.98s 406 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 7.3 5.9 83.3% 1 1.11s 183 1,656
GLM 5 10.0 10.0 100.0% 0 5.78s 203 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 2.9 7.2 11.1% 1 6.48s 41 30,754
GLM 5 3.0 10.0 0.0% 0 2.24s 19 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 4.8 10.0 0.0% 0 821ms 137 542
GLM 5 10.0 10.0 100.0% 0 3.27s 103 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 10.0 10.0 100.0% 0 1.07s 14 958
GLM 5 10.0 10.0 100.0% 0 1.48s 61 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 3.9 7.5 22.2% 1 934ms 354 2,758
GLM 5 7.7 10.0 66.7% 0 2.05s 264 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Mercury 2 10.0 10.0 100.0% 0 1.89s 180 1,956
GLM 5 10.0 10.0 100.0% 0 11.07s 220 0

Quick Compare

Switch Comparison Pair

Grok 4.1 FastmediumvsGLM 5noneMercury 2mediumvsMiMo-V2-OmninoneNemotron 3 SupermediumFree AvailablevsGLM 5noneMercury 2mediumvsQwen3.5 Plus 2026-02-15noneMercury 2mediumvsGLM 5V TurbononeMercury 2mediumvsQwen3.5-FlashnoneGemma 4 26B A4BnoneFree AvailablevsMercury 2mediumGrok 4.20mediumvsGLM 5noneSeed-2.0-LitenonevsMercury 2mediumGemini 2.5 FlashnonevsMercury 2mediumKimi K2.5mediumvsGLM 5noneMercury 2mediumvsQwen3.5-35B-A3Bnone