DCS for Azure Dataflows
Dataflows are visual data transformation and processing capabilities in Azure Data Factory. They enable us to transform and process data at scale without writing code.
The table below shows Dataflow names and their purpose in supporting masking and data discovery. Click on a name for navigation to the documentation.
| Dataflow Name | Purpose |
|---|---|
|
Copies unmasked data from a source location to a sink location. The dataflow usage is configured via pipeline parameters. |
|
|
Consumes unmasked data from a source, applies a data filter, masks the data, and prepares it to be written to the sink. |
|
|
Computes parameters by reading the Azure SQL metadata store to execute the masking dataflow. Used when conditional algorithms are applied to a table. |
|
|
Consumes unmasked data from a source, masks the data, and prepares it to be written to the sink. |
|
|
Computes parameters by reading the Azure SQL metadata store to execute the masking dataflow. |
|
|
Utility to help write ADF-approved filter conditions and validate that the returned data is as expected. |