Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

DeepSeek: DeepSeek V4 Pro vs Z.ai: GLM 5.1

Summary

DeepSeek V4 Pro vs GLM 5.1 benchmark comparison: DeepSeek V4 Pro leads on average score with 7.2 vs 7.1. DeepSeek V4 Pro has the lower benchmark cost at $0.030 vs $0.292. DeepSeek V4 Pro is faster at 5.30s vs 33.67s, with pass rates of 52.4% vs 68.3%.

Recommended model: DeepSeek V4 Pro - It has the best score here (7.2), while costing about 10.0x less than GLM 5.1.

Last updated at: 2026-06-12

Metric DeepSeek V4 Pro DeepSeek V4 Pro none Release: 2026-04-24 GLM 5.1 GLM 5.1 medium Release: 2026-04-07
Score 7.2 7.1
Rank #61 #66
Reliability 9.9 6.7
Consistency 8.8 8.3
Tests Correct
Attempt pass rate 52.4% 68.3%
Flaky tests 3 4
Total Runs 61 63
Cost per result 0.293 2.496
Total Cost $0.030 $0.292
Input Price $0.435 / 1M $0.980 / 1M
Output Price $0.870 / 1M $3.080 / 1M
Total Input Tokens 53,078 32,995
Output Tokens 7,047 11,655
Reasoning Tokens 0 75,421
Response Time (avg) 5.30s 33.67s
Response Time (max) 23.74s 172.60s
Response Time (total) 111.39s 673.41s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#61 DeepSeek V4 Pro

none
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

#66 GLM 5.1

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 3.2 6.1 16.7% 2 4.02s 540 1,168 0
GLM 5.1 10.0 10.0 100.0% 0 8.31s 555 401 5,122
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 5.6 10.0 33.3% 0 5.62s 6,795 1,123 0
GLM 5.1 4.6 3.7 44.5% 2 109.63s 5,702 4,871 37,826
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 9.5 10.0 100.0% 0 23.74s 27,529 2,235 0
GLM 5.1 9.5 10.0 100.0% 0 43.11s 17,298 327 4,206
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 10.0 10.0 100.0% 0 4.61s 7,568 200 0
GLM 5.1 10.0 10.0 100.0% 0 9.33s 7,107 991 4,552
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 5.3 10.0 33.3% 0 3.72s 666 24 0
GLM 5.1 5.3 10.0 33.3% 0 29.77s 489 969 11,314
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 5.0 10.0 0.0% 0 2.05s 471 126 0
GLM 5.1 10.0 10.0 100.0% 0 20.95s 477 2,875 2,875
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 6.3 5.8 66.7% 1 4.12s 627 713 0
GLM 5.1 6.4 5.8 66.7% 1 7.47s 634 204 1,617
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 10.0 10.0 100.0% 0 3.61s 594 442 0
GLM 5.1 8.2 7.2 88.9% 1 31.64s 609 935 5,730
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 10.0 10.0 100.0% 0 7.40s 8,105 328 0
GLM 5.1 3.0 10.0 0.0% 0 0ms 0 0 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 3.0 10.0 0.0% 0 5.76s 183 688 0
GLM 5.1 3.0 10.0 0.0% 0 29.40s 124 82 2,179

Quick Compare

Switch Comparison Pair

Step 3.7 FlashhighvsGLM 5.1mediumDeepSeek V4 PrononevsGemma 4 26B A4BmediumFree AvailableQwen3.7 PlusnonevsGLM 5.1mediumDeepSeek V4 PrononevsGLM 5V TurbomediumDeepSeek V4 PrononevsMiMo-V2-FlashmediumDeepSeek V4 PrononevsStep 3.7 FlashhighGemini 3.5 FlashnonevsGLM 5.1mediumClaude Opus 4.8nonevsGLM 5.1mediumDeepSeek V4 PrononevsKimi K2.7 CodemediumDeepSeek V4 PrononevsGrok 4.20mediumGemini 3 Flash PreviewnonevsGLM 5.1mediumDeepSeek V4 PrononevsGemini 3 Flash Previewlow