Ce diaporama a bien été signalé.
Nous utilisons votre profil LinkedIn et vos données d’activité pour vous proposer des publicités personnalisées et pertinentes. Vous pouvez changer vos préférences de publicités à tout moment.

Azure Purview Data Toboggan Erwin de Kreuk

Azure Purview
Microsoft's answer to Data Governance and Data Lineage

  • Soyez le premier à commenter

Azure Purview Data Toboggan Erwin de Kreuk

  1. 1. InSpark Erwin de Kreuk Lead Data and AI Azure Purview Microsoft's answer to Data Governance and Data Lineage @erwindekreuk https://erwindekreuk.com
  2. 2. InSpark Azure Purview Microsoft's answer to Data Governance and Data Lineage Erwin de Kreuk Lead Data and AI @erwindekreuk https://erwindekreuk.com
  3. 3. InSpark We help organizations accelerating their digital transformation with impactful Microsoft solutions & expertise We Are InSpark
  4. 4. InSpark Unified data governance to maximize the business value of data Azure Purview
  5. 5. InSpark History Private Previews Azure Purview (Public Preview) BlueTalon Acquisition ADC Gen 2 ADC Gen 1
  6. 6. InSpark Data governance is becoming increasingly interdisciplinary What data do I have? Where did the data originate? Can I trust it? DISCOVERY What’s my exposure to risk? Is my usage compliant? How do I control access & use? What is required by regulation X? COMPLIANCE ChiefDataOfficer
  7. 7. InSpark Manage growing data landscape Elements of successful data governance Overcome operational silos Increase data agility Comply with industry regulations
  8. 8. InSpark Data Map Multicloud On-prem Data Insights Azure Purview Data Catalog SaaS Data Map  Automate and manage metadata at scale Data Catalog  Enable effortless discovery for data consumers Data Insights  Assess data usage across your organization
  9. 9. InSpark Unified data governance to maximize the business value of data Azure Purview Reimagine data governance in the cloud Set the foundation for effective data governance Maximize business value of data for data consumers Gain insight into data use across the estate
  10. 10. InSpark  Manage and govern operational, transactional and analytical data  Cloud-native, purpose-built service to address discovery and compliance needs  Fully managed, serverless, PaaS service  Eliminate manual, ad-hoc and homegrown solutions Reimagine data governance in the cloud
  11. 11. InSpark  Automate discovery of data in on- premises, multicloud and SaaS sources  Classify data at scale to specify sensitivity, compliance, industry, business and company-specific value  Know where data came from and what was derived from it with data lineage Set the foundation for effective data governance
  12. 12. InSpark  Connect business and technical data analysts, data scientists, and data engineers to a trusted data catalog  Enable users to quickly find data and view its lineage and sensitivity  Deliver a curated and consistent glossary of business terms and definitions Maximize business value of data for data consumers
  13. 13. InSpark  Understand at a glance how data is being created and used across your data estate  Visually assess the state of data assets, scans, business glossary and sensitive data Gain insight into data use across the estate
  14. 14. InSpark Azure Purview Features Azure Purview Azure Purview Platform Azure Purview Studio Automated Scanning & Classification • Dedicated per customer on shared infra • Provisioned default capacity with option to add-on capacity Data Map • Serverless, pay per use • Includes connectors, scanning of sources, processing into data assets, lineage capture, classification • Search, browse, asset details • Automated meta-data and lineage extraction • Automated classification based on content inspection • Private Endpoint • Management center On-prem & Multi-cloud Operational, Analytical, SaaS Azure Purview Catalog included with Platform (C0) Power BI SQL Server on-prem Azure Synapse Azure Data Services M365 Compliance Cen Open APIs (Apache Atlas 2.0)
  15. 15. InSpark Azure Purview Features Azure Purview Azure Purview Platform Azure Purview Studio Azure Purview Catalog (C1) Automated Scanning & Classification • Dedicated per customer on shared infra • Provisioned default capacity with option to add-on capacity Data Map • Serverless, pay per use • Includes connectors, scanning of sources, processing into data assets, lineage capture, classification • Search, browse, asset details • Automated meta-data and lineage extraction • Automated classification based on content inspection • Private Endpoint • Management center On-prem & Multi-cloud Operational, Analytical, SaaS • Business Glossary templates • Lineage visualization & workflows Azure Purview Catalog included with Platform (C0) Data Producers & Consumers Open APIs (Apache Atlas 2.0) Power BI SQL Server on-prem Azure Synapse Azure Data Services M365 Compliance Cen
  16. 16. InSpark Azure Purview Features Azure Purview Azure Purview Platform Azure Purview Studio Azure Purview Catalog (C1) Automated Scanning & Classification • Dedicated per customer on shared infra • Provisioned default capacity with option to add-on capacity Data Map • Serverless, pay per use • Includes connectors, scanning of sources, processing into data assets, lineage capture, classification • Search, browse, asset details • Automated meta-data and lineage extraction • Automated classification based on content inspection • Private Endpoint • Management center On-prem & Multi-cloud Operational, Analytical, SaaS Azure Purview Data Insights (D1) • Business Glossary templates • Lineage visualization & workflows Azure Purview Catalog included with Platform (C0) • Catalog Insights (Asset, Scan, Glossary) • Sensitive Information Types & Labeling insights Data Producers & Consumers Data Officers & Security Officers Open APIs (Apache Atlas 2.0) Power BI SQL Server on-prem Azure Synapse Azure Data Services M365 Compliance Cen
  17. 17. InSpark • No access to Purview Portal • Can Manage all aspects of Scanning • Ideal role for programmatic processes, such as service principals • Can register Data Sources Azure Purview - Roles Data Source Administrator
  18. 18. InSpark • Has access to Purview Portal • Can read all content in Azure Purview Azure Purview - Roles Data Reader Data Source Administrator
  19. 19. InSpark • Has access to Purview Portal • Can read all content in Azure Purview • Can edit assets, classification and glossary terms • Can apply classifications and glossary terms to assets. • Can not Register Data Sources, only read Azure Purview - Roles Data Reader Data Curator Data Source Administrator
  20. 20. InSpark Azure Purview - Roles Data Source Administrator Data Reader Data Curator
  21. 21. InSpark Azure Purview Studio Updates Accounts Notifications Feedback Metrics Search Bar Usefull Links Recently Accessed Entities Search Bar Key Actvities
  22. 22. InSpark • Quick Actions, recently accessed items, owned Items, search bar and Documentation Azure Purview Studio - Activity hubs • Create collections, register data sources and setup Scans • Manage Glossary Items, search, manage terms templates and custom attributes, import and export Terms using csv • Insights on your data • Meta Data Management-classifications-resource sets, data sources, integration runtime, Alerts, Security, ADF and data share Connections
  23. 23. InSpark
  24. 24. InSpark DEMO
  25. 25. InSpark Innovate to accelerate
  26. 26. InSpark Purview Data Map Unify and make data meaningful  Automated metadata scanning and lineage identification of hybrid data stores  100+ built-in and custom classifiers  Microsoft Information Protection sensitivity labels
  27. 27. InSpark Purview Data Map  Automated metadata scanning and lineage identification of hybrid data stores  100+ built-in and custom classifiers  Microsoft Information Protection sensitivity labels Unify and make data meaningful
  28. 28. InSpark Azure Purview Data Catalog Enable effortless discovery  Semantic search and browse  Business glossary and workflows  Data lineage with sources, owners, transformations, and lifecycle
  29. 29. InSpark Azure Purview Data Catalog Unify and make data meaningful
  30. 30. InSpark Azure Purview Data Catalog Unify and make data meaningful
  31. 31. InSpark Azure Purview Data Catalog Lineage Future Unify and make data meaningful
  32. 32. InSpark Insights  Reports on Assets, Scans, Glossary, Classification, and Labeling Get a bird’s-eye view of sensitive data
  33. 33. InSpark Integrate Azure Purview in Azure Synapse Analytics Discover data registered and scanned by Azure Purview  In Preview
  34. 34. InSpark
  35. 35. InSpark DEMO
  36. 36. InSpark Innovate to accelerate
  37. 37. InSpark Azure Purview  Features in Public Preview Purview Data Map Available Now Coming Soon Automated scanning of hybrid sources AWS S3 Classification Microsoft Information Protection Sensitivity Labels support Apache Atlas API support Purview Data Catalog Semantic Search and Browse Business Glossary Hierarchical Data Lineage Purview in Azure Synapse workspaces Purview data insights Assets and Scans Reports Glossary reports Classification and Labelling Reports Asset-level drill down by sensitivity Data Sources  Azure Synapse  Azure DataBricks  SAP EEC / Hana  Teradata  Hive Metastore Data Lineage  Notebook support  Delta Lake Support
  38. 38. InSpark Roadmap  Data Quality  Data Privacy  Master Data Management
  39. 39. InSpark
  40. 40. InSpark @erwindekreuk https://www.linkedin.com/in/erwindekreuk/ https://erwindekreuk.com Slides will be available on my blog Use Slack
  41. 41. InSpark

×