Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Inception: Mercury 2 vs Z.ai: GLM 4.7 Flash

Last updated at: 2026-06-03

Metric Mercury 2 Mercury 2 none Release: 2026-02-24 GLM 4.7 Flash GLM 4.7 Flash medium Release: 2026-01-19
Score 4.6 4.5
Rank #153 #155
Reliability 10.0 10.0
Consistency 9.1 6.7
Tests Correct
Attempt pass rate 25.0% 35.0%
Flaky tests 2 8
Total Runs 60 60
Cost per result 0.216 1.337
Total Cost $0.009 $0.054
Input Price $0.250 / 1M $0.060 / 1M
Output Price $0.750 / 1M $0.400 / 1M
Total Input Tokens 25,515 37,206
Output Tokens 3,001 43,754
Reasoning Tokens 0 89,079
Response Time (avg) 614ms 35.10s
Response Time (max) 1.27s 174.55s
Response Time (total) 12.28s 456.24s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 3.0 10.0 0.0% 0 483ms 631 286 0
GLM 4.7 Flash 4.7 5.9 41.7% 2 14.95s 555 1,122 6,110
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 3.5 9.4 0.0% 0 831ms 4,631 1,650 0
GLM 4.7 Flash 3.4 6.0 16.7% 1 55.33s 3,106 4,981 22,387
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 3.0 10.0 0.0% 0 606ms 4,821 131 0
GLM 4.7 Flash 2.8 2.1 33.3% 1 65.57s 17,185 2,585 20,648
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 7.3 5.9 83.3% 1 667ms 6,362 180 0
GLM 4.7 Flash 6.3 10.0 50.0% 0 1.51s 7,107 584 2,755
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 5.3 7.2 44.4% 1 534ms 784 46 0
GLM 4.7 Flash 3.5 4.4 33.3% 2 174.55s 643 33,000 25,394
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 4.8 10.0 0.0% 0 628ms 495 159 0
GLM 4.7 Flash 3.6 9.7 0.0% 0 18.14s 318 18 2,138
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 6.5 10.0 50.0% 0 551ms 691 82 0
GLM 4.7 Flash 6.2 5.8 66.7% 1 2.97s 636 388 2,181
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 3.1 10.0 0.0% 0 535ms 694 251 0
GLM 4.7 Flash 2.9 7.2 11.1% 1 12.93s 521 781 5,255
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 10.0 10.0 100.0% 0 1.27s 6,193 197 0
GLM 4.7 Flash 10.0 10.0 100.0% 0 15.95s 6,949 224 1,014
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Mercury 2 3.0 10.0 0.0% 0 548ms 213 19 0
GLM 4.7 Flash 3.0 10.0 0.0% 0 11.13s 186 71 1,197

Quick Compare

Switch Comparison Pair

Ling-2.6-1TnonevsGLM 4.7 FlashmediumMercury 2nonevsQwen3 Coder NextmediumQwen3.6 35B A3BnonevsGLM 4.7 FlashmediumMiMo-V2-FlashnonevsGLM 4.7 FlashmediumQwen3.5-9BnonevsGLM 4.7 FlashmediumTrinity Large PreviewnonevsGLM 4.7 FlashmediumGPT-5.4 NanononevsGLM 4.7 FlashmediumGranite 4.1 8BnonevsGLM 4.7 FlashmediumMercury 2nonevsQwen3.5-9BmediumGPT-4o-mininonevsGLM 4.7 FlashmediumGPT-5.4 MininonevsGLM 4.7 FlashmediumMiMo-V2.5nonevsGLM 4.7 Flashmedium