Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

DeepSeek: DeepSeek V4 Pro vs Z.ai: GLM 5V Turbo

Summary

DeepSeek V4 Pro vs GLM 5V Turbo benchmark comparison: DeepSeek V4 Pro leads on average score with 7.2 vs 5.9. DeepSeek V4 Pro has the lower benchmark cost at $0.034 vs $0.052. GLM 5V Turbo is faster at 2.99s vs 6.41s, with pass rates of 52.4% vs 38.1%.

Recommended model: DeepSeek V4 Pro - It has the best score here (7.2), while costing about 1.6x less than GLM 5V Turbo.

Last updated at: 2026-06-18

Metric DeepSeek V4 Pro DeepSeek V4 Pro none Release: 2026-04-24 GLM 5V Turbo GLM 5V Turbo none Release: 2026-04-01
Score 7.2 5.9
Rank #58 #105
Reliability 9.9 10.0
Consistency 8.8 10.0
Tests Correct
Attempt pass rate 52.4% 38.1%
Flaky tests 3 0
Total Runs 63 63
Cost per result 0.333 0.645
Total Cost $0.034 $0.052
Input Price $0.435 / 1M $1.200 / 1M
Output Price $0.870 / 1M $4.000 / 1M
Total Input Tokens 53,558 37,100
Output Tokens 11,424 1,766
Reasoning Tokens 0 0
Response Time (avg) 6.41s 2.99s
Response Time (max) 30.09s 6.51s
Response Time (total) 134.66s 62.74s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#58 DeepSeek V4 Pro

none
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

#105 GLM 5V Turbo

none
Cost
$0.042
Time
177.3s
Tokens
10,434 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 3.2 6.1 16.7% 2 4.02s 540 1,168 0
GLM 5V Turbo 4.8 10.0 25.0% 0 3.13s 555 281 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 5.6 10.0 33.3% 0 13.38s 7,275 5,500 0
GLM 5V Turbo 5.5 10.0 33.3% 0 3.13s 7,256 360 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 9.5 10.0 100.0% 0 23.74s 27,529 2,235 0
GLM 5V Turbo 3.0 10.0 0.0% 0 6.51s 12,708 276 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 10.0 10.0 100.0% 0 4.61s 7,568 200 0
GLM 5V Turbo 10.0 10.0 100.0% 0 3.81s 7,107 204 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 5.3 10.0 33.3% 0 3.72s 666 24 0
GLM 5V Turbo 5.3 10.0 33.3% 0 2.09s 687 24 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 5.0 10.0 0.0% 0 2.05s 471 126 0
GLM 5V Turbo 4.6 10.0 0.0% 0 2.22s 477 114 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 6.3 5.8 66.7% 1 4.12s 627 713 0
GLM 5V Turbo 6.5 10.0 50.0% 0 1.97s 636 60 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 10.0 10.0 100.0% 0 3.61s 594 442 0
GLM 5V Turbo 5.3 10.0 33.3% 0 2.40s 609 210 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 10.0 10.0 100.0% 0 7.40s 8,105 328 0
GLM 5V Turbo 10.0 10.0 100.0% 0 4.86s 6,879 222 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
DeepSeek V4 Pro 3.0 10.0 0.0% 0 5.76s 183 688 0
GLM 5V Turbo 3.0 10.0 0.0% 0 2.23s 186 15 0

Quick Compare

Switch Comparison Pair