Ce diaporama a bien été signalé.
Nous utilisons votre profil LinkedIn et vos données d’activité pour vous proposer des publicités personnalisées et pertinentes. Vous pouvez changer vos préférences de publicités à tout moment.

5 Major Trends in Data You Should Know

8 135 vues

Publié le

This is a presentation delivered of the Dremio Subsurface Conference on cloud data legs. The presentation covers five key trends within the data world.

Publié dans : Données & analyses
  • Soyez le premier à commenter

5 Major Trends in Data You Should Know

  1. FiveDataTrends You Should Know Tomasz Tunguz, Managing Director, Redpoint Ventures @ttunguz & tomtunguz.com
  2. Metatrend: Rise of Data Engineering as Craft
  3. Rise of Data Engineering as Craft Why has Data Become So Ubiquitous?
  4. Rise of Data Engineering as Craft Aggregated into EDW Output Oracle SAP Logs TX Actions Cognos Tableau Data Produced When a Single Monolithic Pipeline Worked, It Looked Like This
  5. Rise of Data Engineering as CraftBut Everyone Wanted One Exec Team Marketing Product Sales
  6. Rise of Data Engineering as CraftAnd They Each Need Data from the Others Exec Team Marketing Product Sales
  7. Rise of Data Engineering as Craft This is a Data Mesh: A Network of Data Producers & Consumers
  8. Centralize and Move it to a Cloud Data Lake
  9. Rise of Data Engineering as Craft Without the right tooling, you have a Data Mess
  10. Rise of Data Engineering as CraftBut You Could Have a Breathtaking Machine, When It All Comes Together?
  11. Who Will Come to Save the Day?
  12. Rise of Data Engineering as CraftWhat is a Data Engineer? Data Engineers: the people who move, shape, and transform data from where it is generated to where it is needed, and do it 1.Consistently 2.Efficiently 3.Scalably 4.Accurately 5.Compliantly
  13. Rise of Data Engineering as Craft aka Software Engineers Deep in Data
  14. Insight: Software Engineers Have Experience, Tools, and Patterns Writing Code
  15. Ex: the Software Development Lifecycle
  16. Rise of Data Engineering as Craft What is the Data Engineering Equivalent?
  17. Rise of Data Engineering as Craft The Data Engineering Lifecycle
  18. Rise of Data Engineering as Craft Each Step of the DELC Needs New Tools
  19. Rise of Data Engineering as CraftData Pipelines: Watermains of Data Code in a modern language to repeatably move data around Innovators Airflow, Elementl, Prefect
  20. Data Pipelines: Watermains of Data
  21. Rise of Data Engineering as CraftCompute Engines: Access Cloud Data Query data in the cloud, without moving it. Key insight: separation of data and compute. Innovators Dremio, Databricks
  22. Rise of Data Engineering as CraftData Modeling: Universal Metrics Library Define metrics once for the entire organization Innovators Transform Data, Looker
  23. Rise of Data Engineering as CraftData Products: Stand on the Shoulders of Gigabytes Build and deploy data products internally and externally Innovators BI: Preset ML: Streamlit, Tecton
  24. Rise of Data Engineering as CraftData Quality: Harness & Tame Error Develop tests and monitor data flows to ensure data integrity Innovators Monte Carlo, Great Expectations, Soda Data, Data Gravity
  25. 5 Data Trends You Should Know 1.Data Pipelines – move data with code 2.Compute Engines – query cloud data 3.Modeling – defines metrics once 4.Data Products – squeeze insight from data 5.Data Quality – keep data accurate
  26. The Future Depends on You
  27. FiveDataTrends You Should Know Tomasz Tunguz, Managing Director, Redpoint Ventures @ttunguz & tomtunguz.com

×