Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Anthropic: Claude Sonnet 4.6 vs DeepSeek: DeepSeek V4 Pro

Summary

Claude Sonnet 4.6 vs DeepSeek V4 Pro benchmark comparison: Claude Sonnet 4.6 leads on average score with 7.8 vs 7.2. DeepSeek V4 Pro has the lower benchmark cost at $0.034 vs $1.418. DeepSeek V4 Pro is faster at 6.41s vs 17.06s, with pass rates of 65.1% vs 52.4%.

Recommended model: DeepSeek V4 Pro - Its score stays close to the best score here (7.2 vs 7.8), while costing about 42.6x less than Claude Sonnet 4.6.

Last updated at: 2026-06-30

Metric Claude Sonnet 4.6 Claude Sonnet 4.6 medium Release: 2026-02-17 DeepSeek V4 Pro DeepSeek V4 Pro none Release: 2026-04-24
Score 7.8 7.2
Rank #32 #60
Reliability 10.0 9.9
Consistency 9.1 8.8
Tests Correct
Attempt pass rate 65.1% 52.4%
Flaky tests 2 3
Total Runs 63 63
Cost per result 10.904 0.333
Total Cost $1.418 $0.034
Input Price $3.000 / 1M $0.435 / 1M
Output Price $15.000 / 1M $0.870 / 1M
Total Input Tokens 49,112 53,558
Output Tokens 54,703 11,424
Reasoning Tokens 29,970 0
Response Time (avg) 17.06s 6.41s
Response Time (max) 46.35s 30.09s
Response Time (total) 221.83s 134.66s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#32 Claude Sonnet 4.6

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

#60 DeepSeek V4 Pro

none
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Sonnet 4.6 6.5 10.0 50.0% 0 2.98s 789 1,046 1,093
DeepSeek V4 Pro 3.2 6.1 16.7% 2 4.02s 540 1,168 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Sonnet 4.6 5.7 6.6 44.4% 1 33.29s 6,995 16,089 3,686
DeepSeek V4 Pro 5.6 10.0 33.3% 0 13.38s 7,275 5,500 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Sonnet 4.6 10.0 10.0 100.0% 0 46.35s 18,351 5,871 3,962
DeepSeek V4 Pro 9.5 10.0 100.0% 0 23.74s 27,529 2,235 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Sonnet 4.6 10.0 10.0 100.0% 0 13.90s 8,676 649 742
DeepSeek V4 Pro 10.0 10.0 100.0% 0 4.61s 7,568 200 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Sonnet 4.6 2.9 7.2 11.1% 1 0ms 471 25,790 16,919
DeepSeek V4 Pro 5.3 10.0 33.3% 0 3.72s 666 24 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Sonnet 4.6 10.0 10.0 100.0% 0 4.94s 564 256 433
DeepSeek V4 Pro 5.0 10.0 0.0% 0 2.05s 471 126 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Sonnet 4.6 10.0 10.0 100.0% 0 2.61s 792 318 552
DeepSeek V4 Pro 6.3 5.8 66.7% 1 4.12s 627 713 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Sonnet 4.6 10.0 10.0 100.0% 0 5.31s 816 592 646
DeepSeek V4 Pro 10.0 10.0 100.0% 0 3.61s 594 442 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Sonnet 4.6 10.0 10.0 100.0% 0 7.48s 11,454 655 351
DeepSeek V4 Pro 10.0 10.0 100.0% 0 7.40s 8,105 328 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Sonnet 4.6 3.0 10.0 0.0% 0 30.09s 204 3,437 1,586
DeepSeek V4 Pro 3.0 10.0 0.0% 0 5.76s 183 688 0

Quick Compare

Switch Comparison Pair

DeepSeek V4 PrononevsGemma 4 26B A4BmediumFree AvailableDeepSeek V4 PrononevsStep 3.7 FlashhighDeepSeek V4 PrononevsGLM 5.1mediumClaude Sonnet 4.6mediumvsStep 3.7 FlashlowDeepSeek V4 PrononevsKimi K2.7 CodemediumDeepSeek V4 PrononevsGrok 4.20mediumDeepSeek V4 PrononevsGemini 3 Flash PreviewlowClaude Sonnet 4.6mediumvsDeepSeek V4 ProhighDeepSeek V4 PrononevsMiMo-V2.5-PromediumSeed-2.0-MinimediumvsDeepSeek V4 PrononeDeepSeek V4 PrononevsQwen3.6 FlashmediumClaude Sonnet 4.6mediumvsGPT-5.3 Chatnone