Copy from single file: 2-4 - Copy from multiple files: 2-256 depending on the number and size of the files For example, if you copy data from a folder with 4 large files, the max effective DIU is 16. Copy from and to multiple files: 2-256 depending on the number and size of the filesįor example, if you copy data from a folder with 4 large files and choose to preserve hierarchy, the max effective DIU is 16 when you choose to merge file, the max effective DIU is 4.īetween 4 and 32 depending on the number and size of the files The following table lists the supported DIU ranges and default behavior in different copy scenarios: Copy scenario If not specified or you choose "Auto" on the UI, the service dynamically applies the optimal DIU setting based on your source-sink pair and data pattern. The allowed DIUs to empower a copy activity run is between 2 and 256. Data Integration Unit only applies to Azure integration runtime, but not self-hosted integration runtime. When you select a Copy activity on the pipeline editor canvas and choose the Settings tab in the activity configuration area below the canvas, you will see options to configure all of the performance features detailed below.Ī Data Integration Unit is a measure that represents the power (a combination of CPU, memory, and network resource allocation) of a single unit within the service. This article outlines the copy activity performance optimization features that you can leverage in Azure Data Factory and Synapse pipelines.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |