Examples of how to automate data cleansing and data prep in Microsoft Azure Synapse using Data Flows

1. Data Cleansing and Prep
with Azure Synapse Analytics
Data Flows
Mark Kromer @kromerbigdata
Azure Data Governance
Principal PM

4. https://techcommunity.microsoft.com/t5/azure-data-
factory/how-to-save-your-data-profiler-summary-stats-in-adf-data-flows/ba-p/1243251

5. • iif (length(title) == 0,toString(null()),title)

9. https://docs.microsoft.com/en-us/azure/data-factory/how-to-data-flow-dedupe-nulls-snippets

11. https://www.youtube.com/watch?v=E_UD3R-VpYE
https://mssqldude.wordpress.com/2020/08/31/adf-data-flow-metadata-functions-explained/

12. • https://www.youtube.com/watch?v=wjsi9g3ffco
• https://docs.microsoft.com/en-us/azure/data-factory/how-to-data-flow-dedupe-nulls-snippets
• https://www.youtube.com/watch?v=O8gmv5-lXhs
• https://www.youtube.com/watch?v=7gdwExjHBbw
• https://www.youtube.com/watch?v=ryYo8UFUgTI
• https://www.youtube.com/watch?v=E_UD3R-VpYE
• ADF Metafunctions explained
• https://mssqldude.wordpress.com/2020/08/31/adf-data-flow-metadata-functions-explained/
• This slide deck
• https://www.slideshare.net/kromerm/data-cleansing-and-data-prep-with-synapse-data-flows
• Tutorial
• https://github.com/kromerm/adfdataflowdocs/blob/master/sampledata/synapse-dataflows-tutorial-
001.docx