Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Anthropic: Claude Opus 4.6 vs DeepSeek: DeepSeek V4 Pro

Summary

Claude Opus 4.6 vs DeepSeek V4 Pro benchmark comparison: Claude Opus 4.6 leads on average score with 7.7 vs 7.2. DeepSeek V4 Pro has the lower benchmark cost at $0.034 vs $2.053. DeepSeek V4 Pro is faster at 6.41s vs 25.89s, with pass rates of 61.9% vs 52.4%.

Recommended model: DeepSeek V4 Pro - Its score stays close to the best score here (7.2 vs 7.7), while costing about 61.7x less than Claude Opus 4.6.

Last updated at: 2026-06-18

Metric Claude Opus 4.6 Claude Opus 4.6 medium Release: 2026-02-05 DeepSeek V4 Pro DeepSeek V4 Pro none Release: 2026-04-24
Score 7.7 7.2
Rank #38 #58
Reliability 10.0 9.9
Consistency 8.8 8.8
Tests Correct
Attempt pass rate 61.9% 52.4%
Flaky tests 3 3
Total Runs 63 63
Cost per result 17.103 0.333
Total Cost $2.053 $0.034
Input Price $5.000 / 1M $0.435 / 1M
Output Price $25.000 / 1M $0.870 / 1M
Total Input Tokens 53,227 53,558
Output Tokens 47,446 11,424
Reasoning Tokens 24,000 0
Response Time (avg) 25.89s 6.41s
Response Time (max) 83.40s 30.09s
Response Time (total) 362.49s 134.66s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#38 Claude Opus 4.6

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

#58 DeepSeek V4 Pro

none
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Opus 4.6 6.4 5.8 66.7% 2 7.45s 840 986 1,071
DeepSeek V4 Pro 3.2 6.1 16.7% 2 4.02s 540 1,168 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Opus 4.6 5.7 7.1 44.4% 1 30.10s 8,522 13,057 4,121
DeepSeek V4 Pro 5.6 10.0 33.3% 0 13.38s 7,275 5,500 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Opus 4.6 10.0 10.0 100.0% 0 76.66s 20,685 8,178 5,194
DeepSeek V4 Pro 9.5 10.0 100.0% 0 23.74s 27,529 2,235 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Opus 4.6 10.0 10.0 100.0% 0 7.37s 8,676 691 757
DeepSeek V4 Pro 10.0 10.0 100.0% 0 4.61s 7,568 200 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Opus 4.6 3.0 10.0 0.0% 0 83.40s 674 14,642 8,687
DeepSeek V4 Pro 5.3 10.0 33.3% 0 3.72s 666 24 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Opus 4.6 10.0 10.0 100.0% 0 5.04s 564 188 292
DeepSeek V4 Pro 5.0 10.0 0.0% 0 2.05s 471 126 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Opus 4.6 10.0 10.0 100.0% 0 2.43s 792 266 467
DeepSeek V4 Pro 6.3 5.8 66.7% 1 4.12s 627 713 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Opus 4.6 7.7 10.0 66.7% 0 4.71s 816 532 630
DeepSeek V4 Pro 10.0 10.0 100.0% 0 3.61s 594 442 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Opus 4.6 10.0 10.0 100.0% 0 9.73s 11,454 861 329
DeepSeek V4 Pro 10.0 10.0 100.0% 0 7.40s 8,105 328 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Opus 4.6 3.0 10.0 0.0% 0 63.24s 204 8,045 2,452
DeepSeek V4 Pro 3.0 10.0 0.0% 0 5.76s 183 688 0

Quick Compare

Switch Comparison Pair

Claude Opus 4.6mediumvsStep 3.7 FlashlowDeepSeek V4 PrononevsGemma 4 26B A4BmediumFree AvailableDeepSeek V4 PrononevsStep 3.7 FlashhighDeepSeek V4 PrononevsGLM 5.1mediumClaude Opus 4.6mediumvsDeepSeek V4 ProhighDeepSeek V4 PrononevsKimi K2.7 CodemediumDeepSeek V4 PrononevsGrok 4.20mediumClaude Opus 4.6mediumvsGPT-5.3 ChatnoneDeepSeek V4 PrononevsGemini 3 Flash PreviewlowDeepSeek V4 PrononevsMiMo-V2.5-PromediumSeed-2.0-MinimediumvsDeepSeek V4 PrononeDeepSeek V4 PrononevsQwen3.6 Flashmedium