Navigate
Advertise here

Claude Sonnet 5 (medium) vs DeepSeek V4.1 Flash (max)

DeepSeek V4.1 Flash (max) leads on average score with 8.6 vs 8.5. DeepSeek V4.1 Flash (max) has the lower benchmark cost at $1.204 vs $1.438. Claude Sonnet 5 (medium) is faster at 15.01s vs 61.58s, with pass rates of 76.8% vs 69.6%.

Last updated at: 2026-11-17

Compared models

Rank
#121
Total Output Tokens
73,018
Response Time (avg)
15.01s
Total Cost
$1.438
Rank
#108
Total Output Tokens
908,171
Response Time (avg)
61.58s
Total Cost
$1.204
Recommended model Claude Sonnet 5 (medium)

Its score stays close to the best score here (8.5 vs 8.6), while responding about 4.1x faster than DeepSeek V4.1 Flash (max).

Detailed comparison

Metric Claude Sonnet 5 Claude Sonnet 5 medium Release: 2026-06-30 DeepSeek V4.1 Flash DeepSeek V4.1 Flash max Release: 2026-09-10
Score 8.5 8.6
Rank #121 #108
Reliability 10.0 9.4
Consistency 9.1 9.3
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 76.8% 69.6%
Flaky tests 3 2
Total Runs 69 69
Cost per result 8.985 3.715
Total Cost $1.438 $1.204
Input Price $2.000 / 1M $0.013 / 1M
Output Price $10.000 / 1M $1.320 / 1M
Cache Read Price $0.200 / 1M $0.013 / 1M
Cache Write Price $2.500 / 1M N/A
Total Input Tokens 353,658 414,054
Output Tokens 54,891 7,635
Reasoning Tokens 18,370 900,536
Response Time (avg) 15.01s 61.58s
Response Time (max) 69.26s 335.08s
Response Time (total) 345.16s 1416.24s
Parameters ~1T total (~100B active) 748B total (16B active)
Availability Closed Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#121 Claude Sonnet 5

medium
Cost
$0.007
Time
6.4s
Tokens
832 tok

#108 DeepSeek V4.1 Flash

max
Cost
$0.066
Time
211.0s
Tokens
54,712 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Sonnet 5 9.0 7.9 88.9% 1 17.28s 10,590 13,153 2,379
DeepSeek V4.1 Flash 10.0 10.0 100.0% 0 62.50s 7,509 373 132,357

Switch Comparison Pair