Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Qwen: Qwen3.7 Max vs Z.ai: GLM 5.1

Last updated at: 2026-05-22

Metric Qwen3.7 Max Qwen3.7 Max none Release: 2026-05-22 GLM 5.1 GLM 5.1 medium Release: 2026-04-07
Score 7.9 7.4
Rank #26 #51
Reliability 10.0 3.3
Consistency 10.0 8.3
Tests Correct
Attempt pass rate 70.0% 71.7%
Flaky tests 0 4
Total Runs 60 60
Cost per result 0.719 2.379
Total Cost $0.101 $0.286
Input Price $2.500 / 1M $0.980 / 1M
Output Price $7.500 / 1M $3.080 / 1M
Output Tokens 1,988 11,475
Reasoning Tokens 0 71,876
Response Time (avg) 1.30s 32.22s
Response Time (max) 3.92s 172.60s
Response Time (total) 25.95s 612.25s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 6.5 10.0 50.0% 0 1.08s 242 0
GLM 5.1 10.0 10.0 100.0% 0 8.31s 401 5,122
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 6.8 10.0 50.0% 0 1.39s 576 0
GLM 5.1 4.7 1.6 66.7% 2 145.56s 4,727 34,384
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 3.0 10.0 0.0% 0 2.17s 171 0
GLM 5.1 9.5 10.0 100.0% 0 43.11s 327 4,206
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 10.0 10.0 100.0% 0 1.35s 243 0
GLM 5.1 10.0 10.0 100.0% 0 9.33s 991 4,552
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 7.7 10.0 66.7% 0 975ms 15 0
GLM 5.1 5.3 10.0 33.3% 0 29.77s 969 11,314
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 10.0 10.0 100.0% 0 1.04s 120 0
GLM 5.1 10.0 10.0 100.0% 0 20.95s 2,875 2,875
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 10.0 10.0 100.0% 0 943ms 72 0
GLM 5.1 6.4 5.8 66.7% 1 7.47s 204 1,617
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 10.0 10.0 100.0% 0 1.13s 314 0
GLM 5.1 8.2 7.2 88.9% 1 23.85s 899 5,627
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 10.0 10.0 100.0% 0 3.92s 222 0
GLM 5.1 3.0 10.0 0.0% 0 0ms 0 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.7 Max 3.0 10.0 0.0% 0 856ms 13 0
GLM 5.1 3.0 10.0 0.0% 0 29.40s 82 2,179

Quick Compare

Switch Comparison Pair

GPT-5.4mediumvsQwen3.7 MaxnoneGemini 3.1 Flash LitelowvsGLM 5.1mediumQwen3.7 MaxnonevsGLM 5 TurbomediumGPT-5.3 ChatnonevsGLM 5.1mediumDeepSeek V4 FlashhighFree AvailablevsGLM 5.1mediumGemini 3.1 Flash Lite PreviewnonevsGLM 5.1mediumGemini 3.5 FlashminimalvsQwen3.7 MaxnoneGemma 4 31BmediumFree AvailablevsQwen3.7 MaxnoneQwen3.7 MaxnonevsGrok 4.3mediumSeed-2.0-LitemediumvsQwen3.7 MaxnoneGemini 3.1 Flash Lite PreviewmediumvsQwen3.7 MaxnoneRing-2.6-1TnonevsGLM 5.1medium