Data-Driven @ Netflix

•

26 j'aime•8,041 vues

Michelle Ufford is a Principal Architect at Netflix who leads their Data Engineering and Analytics team. Netflix has over 86 million members who watch over 125 million hours of content daily on over 1000 supported devices. The data team manages a 40 petabyte data warehouse with 4 petabyte daily reads and 300 terabyte daily writes, processing over 700 billion events. The data is used to predict content value, optimize the user experience, analyze news and PR, monitor global service delivery, and power experimentation.

Technologie

Data-Driven @ Netflix
Michelle Ufford
Principal Architect
Data Engineering & Analytics

Michelle Ufford
Highlights
● Principal Architect at Netflix
Data Engineering & Analytics
● Prev. Engineering Manager at GoDaddy
Data Platform
● Microsoft Data Platform MVP
● 10+ years building web-scale analytics &
data engineering infrastructure
● advises on Big Data topics
Microsoft, Hortonworks, Teradata, etc.
Gratuitous picture of my kids

The business numbers.
86.7 million
members
1000+ devices
supported
125+ million
hours watched
launched
19 years ago
every. day.

Any device. Anywhere.*
* Well, almost anywhere.

The data numbers.
4 petabyte
DW reads
300 terabyte
DW writes
40 petabyte
data warehouse
700+ billion
events written

Predicting Value for
Licensed Content.
Feature Engineering Predictive Models License Terms Content Efficiency

Predicting Value for
Licensed Content.
● past performance of similar content on Netflix
● broadcast & Box Office performance
● talent (writers, actors, directors, etc.)
● critic & user reviews
● awards & accolades
Feature Engineering Predictive Models License Terms Content Efficiency

Predicting Value for
Licensed Content.
● terms (length, exclusivity, etc.)
● bid amount
● negotiations
Feature Engineering Predictive Models License Terms Content Efficiency

Predicting Value for
Licensed Content.
● value / cost
● if efficient, license
Feature Engineering Predictive Models License Terms Content Efficiency

“ last year our original content overall
was some of our most efficient content.
”

“ We are building a studio in the cloud
and pioneering new approaches to movie
production, optimizing pitches, production
schedules, subtitling, and digital asset
management for our Original content. ”

There are 86 million different
versions of Netflix.

billboard
rows, row order
titles, title order
title artwork

Public Relations.
Analytics of news.Analytics is news.

Content Delivery.
Monitoring a global service.

YouTube video of Vizceral demo
https://youtu.be/JctsPpgEsVs

data access
AWS
S3
Big Data Platform
Amazon
Redshift
data processing
fast storage data viz
METACA
T
data services
events data
operational data
elastic storage Apache Pig

Data Engineering & Analytics
MarketingProduct PlaybackContent Finance
105 talented engineers & analysts
data viz engineers
analytics engineers
data engineers
Big Data
Platform
analysts

Experimentation Platform
Batch &
Ad Hoc
Analysis

Thank you
for attending!
Michelle Ufford
linkedin.com/in/mufford
@sqlfool
Data @
Netflix
@NetflixData
hadoopsie.com techblog.netflix.com
tinyurl.com/NetflixData

Contenu connexe

Tendances

In this conference session we share how we are using Tableau “out of the box” and also describe how it fits into our overall data environment. In addition, we’ll describe how we expect to use the Data Catalog and Object Model, our explorations of large-scale data stores, and challenges we are working on including governance and data lineage. Video of session can be viewed here: https://youtu.be/Nr24tw3dmZQ

Tableau Conference 2018: Binging on Data - Enabling Analytics at Netflix

Blake Irvine

Netflix

Sapir Tal

Group case study assignment

OlgaKovalchuk15

Spark at Zillow

Steven Hoelscher

The Netflix Way to deal with Big Data Problems

Monal Daxini

Learning is an analytic process of exploring the past in order to predict the future. Hence, being able to travel back in time to create features is critical for machine learning projects to be successful. To enable this, we built a time machine that computes features for any arbitrary time in the recent past for offline experimentation. We also built a real-time stream processing system to capture the interests of members during different times of the day and to quickly adapt to changes in the collective interests of members as it happens in case of real-world events. Building the time machine for offline experimentation and the real-time infrastructure for online recommendations with Apache Spark (Streaming) and Apache Cassandra empowered us to both scale up the data size by an order of magnitude and train and validate the models in less time. We will delve into the architecture, use case details, data models used for cassandra and share our learnings. About the Speakers Prasanna Padmanabhan Engineering Manager, Netflix Prasanna leads the Data Systems for Personalization team at Netflix. His primary focus is on building various big data infrastructure components that help their algorithmic engineers to innovate faster and improve personalization for Netflix members. In the past, he has built distributed data systems that leverages both batch and stream processing. Roopa Tangirala Engineering Manager, Netflix Roopa Tangirala is an experienced engineering leader with extensive background in databases, be they distributed or relational. She manages the database engineering team at Netflix responsible for operating cloud persistent and semipersistent runtime stores for Netflix, which includes Cassandra, Elasticsearch, Dynomite and MySQL databases, by ensuring data availability, durability, and scalability to meet the growing business needs.

Netflix Recommendations Using Spark + Cassandra (Prasanna Padmanabhan & Roopa...

DataStax

Slides from JupyterCon 2018 in NYC on 8/23/2018. Notebooks have moved beyond a niche solution at Netflix; they are now the critical path for how everyone runs jobs against the company’s data platform. From creating original content to delivering bufferless streaming, Netflix relies on notebooks to inform decisions and fuel experiments across the company. Netflix also uses notebooks to power its machine learning infrastructure and run over 150,000 jobs against its 100 PB cloud-based data warehouse every day. The goal is to deliver a compelling notebooks experience that simplifies end-to-end workflows for every type of user. To enable this, Netflix is investing deeply in notebook infrastructure and open source projects such as nteract. In this talk, Michelle Ufford and Kyle Kelley share interesting ways Netflix uses data and some of the big bets the company is making on notebooks. Topics will include architecture, kernels, UIs, and Netflix’s open source collaborations with projects such as Jupyter, nteract, pandas, and Spark.

Notebooks @ Netflix: From analytics to engineering with Jupyter notebooks

Michelle Ufford

Netflix Case Study

CharlieMcGregor1

Recommendations are at the core of digital transformation in retail today. Whether you’re building features such as product recommendations, promotion recommendations, personalized customer experience, or re-imagining your supply chain to meet customer demands for same day delivery — you’re facing challenges that require the ability to leverage connections from many different data sources, in real-time. There’s no better technology to meet these challenges than a native graphDB technology such as Neo4j.

How to Design Retail Recommendation Engines with Neo4j

Neo4j

Personalized Playlists at Spotify

Rohan Agrawal

Netflix-Case Study-- When a Pioneer Has to Reinvent Itself

James Rothaar

Pinot: Realtime Distributed OLAP datastore

Kishore Gopalakrishna

This session describes the roles and skill sets required when building a Data Science team, and starting a data science initiative, including how to develop Data Science capabilities, select suitable organizational models for Data Science teams, and understand the role of executive engagement for enhancing analytical maturity at an organization. Objective 1: Understand the knowledge and skills needed for a Data Science team and how to acquire them. After this session you will be able to: Objective 2: Learn about the different organizational models for forming a Data Science team and how to choose the best for your organization. Objective 3: Understand the importance of Executive support for Data Science initiatives and role it plays in their successful deployment.

Building Data Science Teams

EMC

Company Presentation - Netflix

CaroleenChang

The deep learning AI revolution has been sweeping the world for a decade now. Deep neural nets are routinely used for tasks like translation, fraud detection, and image classification. PwC estimates that they will create $15.7 trillion/year of value by 2030. But most current networks are "discriminative" in that they directly map inputs to predictions. This type of model requires lots of training examples, doesn't generalize well outside of its training set, creates inscrutable representations, is subject to adversarial examples, and makes knowledge transfer difficult. People, in contrast, can learn from just a few examples, generalize far beyond their experience, and can easily transfer and reuse knowledge. In recent years, new kinds of "generative" AI models have begun to exhibit these desirable human characteristics. They represent the causal generative processes by which the data is created and can be compositional, compact, and directly interpretable. Generative AI systems that assist people can model their needs and desires and interact with empathy. Their adaptability to changing circumstances will likely be required by rapidly changing AI-driven business and social systems. Generative AI will be the engine of future AI innovation.

The Future of AI is Generative not Discriminative 5/26/2021

Steve Omohundro

Netflix’s unique DVD rental service has revolutionized the industry. They successfully took the best of traditional conventions (like physical media, the U.S. Postal Service) and mixed them with new world internet-conventions. They have also effectively managed to discourage competition from both more established businesses and new entrants. The future growth of Netflix as it expands into streaming media, poses challenges in legal, infrastructure/technology, and through additional costs. In order to remain competitive, it is imperative that Netflix partner with companies with global reach to overcome these challenges. This presentation was part of an MBA class assignment to audit and industry in the the technology sector. The presentation has multiple authors listed on the title page. If you would like copies of the executive summary, complete S.W.O.T. analysis, and/or the transcript of the presentation please PRIVATE MESSAGE ME and I will email it to you.

Netflix Case Study

Kikuyu Daniels

Airbyte - Series-B deck

Airbyte

Personalization at Netflix - Making Stories Travel

Sudeep Das, Ph.D.

The Evolution of Big Data at Spotify

Josh Baer

Democratizing Data at Airbnb

Neo4j

Tendances (20)

Tableau Conference 2018: Binging on Data - Enabling Analytics at Netflix

Netflix

Group case study assignment

Spark at Zillow

The Netflix Way to deal with Big Data Problems

Netflix Recommendations Using Spark + Cassandra (Prasanna Padmanabhan & Roopa...

Notebooks @ Netflix: From analytics to engineering with Jupyter notebooks

Netflix Case Study

How to Design Retail Recommendation Engines with Neo4j

Personalized Playlists at Spotify

Netflix-Case Study-- When a Pioneer Has to Reinvent Itself

Pinot: Realtime Distributed OLAP datastore

Building Data Science Teams

Company Presentation - Netflix

The Future of AI is Generative not Discriminative 5/26/2021

Netflix Case Study

Airbyte - Series-B deck

Personalization at Netflix - Making Stories Travel

The Evolution of Big Data at Spotify

Democratizing Data at Airbnb

Similaire à Data-Driven @ Netflix

Abstract:- Netflix has a growing presence in Hollywood, with technical teams working on everything from high-speed video editing pipelines to machine learning methods for categorizing films. Data is foundational across these efforts and in this talk Josh will take a tour through why we invest so much in data about content, what data engineering challenges we tackle, and the style in which we do it.

Data engineering at the interface of art and analytics: the why, what, and ho...

Data Con LA

AI Solutions with Macnica.ai - AI Expo 2018 Tokyo Japan

Avkash Chauhan

This session will begin with an introduction to non-relational (NoSQL) databases and compare them with relational (SQL) databases. We will also explain the fundamentals of Amazon DynamoDB, a fully managed NoSQL database service. Learn the fundamentals of DynamoDB and see the new DynamoDB console first-hand as we discuss common use cases and benefits of this high-performance key-value and JSON document store.

Getting Started with Amazon DynamoDB

Amazon Web Services

BigDL-enabled Deep Learning analysis of photos attached to property listings in Multiple Listings Services database allowed us to extract image features and identify similar-looking properties. We leveraged this information to in real-time property search application to improve the relevancy of user search results. Imagine identifying a property listing photo you like and having the system suggest other listings you should also review. Traditional real-estate MLS (multiple-listings services) search methods rely on SQL-type queries to search and serve real-estate listings results. However, using BigDL in conjunction with MLSLinstings standard APIs allows users to include photos as search parameters in real-time, based both on image similarities and semantic feature search. The information extracted from listing’s images is used to improve the relevancy of the search results. To enable this use-case, we implemented several CNNs using BigDL framework on Microsoft’s Azure hosted Apache Spark: – Image feature extraction and tagging. Extracts features from real estate images and classifies them according to Real Estates Standards Organization rules, such as overall house style, interior and exterior attributes, etc. – Image similarity network which allows for comparing images that belong to different properties based on their extracted features and create a similarity score to be used in search results. We’ll discuss the above networks in details as well as run a live demo of real-estate search results. Key takeaways: a) Why invest into Spark BigDL from the start. b) Why choose cloud-based solution from the start. c) Choice of Scala vs Python.

Using BigDL on Apache Spark to Improve the MLS Real Estate Search Experience ...

Databricks

[Public] 7 archetipi della tecnologia moderna [italy]

Nicolas Bortolotti

This was presented by the Yongsheng Wu, head of big data and ML platform at Pinterest, at the Alluxio bay area meetup. Yongsheng shares Pinterest's journey to build a fast and scalable big data and ML platform in AWS for Pinterest to handle the requests and complexity in data at scale. In this talk, he will cover different aspects from the requirements of the platform, the challenges encountered, the technologies chosen, and the tradeoffs that were made.

Pinterest - Big Data Machine Learning Platform at Pinterest

Alluxio, Inc.

Big Data LDN 2017: How Big Data Insights Become Easily Accessible With Workfl...

Matt Stubbs

When you have to say ""YES"" to everything, what does that really mean? The Boston Consulting Group (BCG) is a global management consulting firm that advises industry leading companies on value creation strategies, innovation, transformation, supply chain management and much more. BCG provides recommendations and analytics that are custom tailored to the needs of each client. To do this BCG is transforming what used to be presentations and manual models into software that is prototyped and distributed to their client to run on their infrastructure - in effect changing the way BCG delivers value. However the productization process poses unique challenges and opportunities. Their clients have every type of infrastructure and application stack within their IT environments, how can BCG ensure that the custom built analytics applications will operate well at scale in their client's production environment - especially when it is an environment that they don't control? The bespoke nature of the BCG business led the team to embark on an engineering led journey to containerization with Docker. Attend this session to learn more about the approach, challenges and how BCG is enabling transformation with Docker Enterprise Edition.

The Complexity to "Yes" in Analytics Software and the Possibilities with Dock...

Docker, Inc.

At H2O.ai we see a world where all software will incorporate AI, and we’re focused on bringing AI to business through software. H2O.ai is the maker behind H2O, the leading open source machine and deep learning platform for smarter applications and data products. H2O operationalizes data science by developing and deploying algorithms and models for R, Python and the Sparkling Water API for Spark. In this webinar, you will learn about the scalable H2O core platform and the distributed algorithms it supports. H2O integrates seamlessly with the R and the Python environments. We will show you how to leverage the power of H2O algorithms in R, Python and H2O Flow interface. Come with an open mind and some high level knowledge of machine learning, and you will take away a stream of knowledge for your next ML/DL project. Amy Wang is a math hacker at H2O, as well as the Sales Engineering Lead. She graduated from Hunter College in NYC with a Masters in Applied Mathematics and Statistics with a heavy concentration on numerical analysis and financial mathematics. Her interest in applicable math eventually lead her to big data and finding the appropriate mediums for data analysis. Desmond is a Senior Director of Marketing at H2O.ai. In his 15+ years of career in Enterprise Software, Desmond worked in Distributed Systems, Storage, Virtualization, MPP databases, Streaming Analytics Platform, and most recently Machine Learning. He obtained his Master’s degree in Computer Science from Stanford University and MBA degree from UC Berkeley, Haas School of Business.

Start Getting Your Feet Wet in Open Source Machine and Deep Learning

Ian Gomez

There was a time when the Enterprise Data Warehouse (EDW) was the only way to provide a 360-degree analytical view of the business. In recent years many organizations have deployed disparate analytics alternatives to the EDW, including: cloud data warehouses, machine learning frameworks, graph databases, geospatial tools, and other technologies. Often these new deployments have resulted in the creation of analytical silos that are too complex to integrate, seriously limiting global insights and innovation. Join guest speaker, 451 Research’s Jim Curtis and Pivotal’s Jacque Istok for an interactive discussion about some of the overarching trends affecting the data warehousing market, as well as how to build a next generation data platform to accelerate business innovation. During this webinar you will learn: - The significance of a multi-cloud, infrastructure-agnostic analytics - What is working and what isn’t, when it comes to analytics integration - The importance of seamlessly integrating all your analytics in one platform - How to innovate faster, taking advantage of open source and agile software Speakers: James Curtis, Senior Analyst, Data Platforms & Analytics, 451 Research & Jacque Istok, Head of Data, Pivotal

Analytical Innovation: How to Build the Next Generation Data Platform

VMware Tanzu

Applying R in BI and Real Time applications EARL London 2015

Lou Bajuk

Today’s complex data is not only big, but also semi-structured and densely connected. In this session we’ll look at how size, structure and connectedness have converged to transform the data landscape. We’ll then go on to look at some of the new opportunities for creating end-user value that have emerged in a world of connected data, illustrated with practical examples drawn from the telecommunications, social media and logistics sectors.

New Opportunities for Connected Data - Emil Eifrem @ GraphConnect Boston + Ch...

Neo4j

Big Data LDN 2017: Big Impact with Big Data

Matt Stubbs

Applying the R Language to BI and Real Time Applications

Lou Bajuk

******** Abstract: ******** Not long ago the question was whether your organization had big data. Did you have the volume, the velocity, the technology. Now those basics are largely given for most of the people attending this event. The path to success is still fuzzy, however, with so many technologies to choose from – and so many ways to use them. This presentation triangulates in a holistic manner on the modern business dilemma: how can we leverage technology to improve revenue, profit, market share, and numerous other success criteria. That said, this is not about the analytics or KPIs -- although it is about measurable improvement. It’s about lining up the right technologies and using them in effective, proven ways to maximize Return on Investment (ROI). Since the slant here is holistic, we’ll show how to blend infrastructure, tools, methods, and talent to avoid and constantly trim technical debt… and to produce success stories that are consistently repeatable, not a byproduct of individual heroics.

Maximize Big Data ROI via Best of Breed Patterns and Practices

Jeff Bertman

TIBCO Jaspersoft® empowers millions of people every day to make faster business decisions by bringing them timely data via applications and business processes. Get the answers you need, with Jaspersoft. See how you can improve your reporting and analytics solution and get access to actionable data. Join us for one hour and watch how Jaspersoft can transform your business with reporting and analytics. Topics Covered: -Provide a general product overview of Jaspersoft BI -Showcase the broad capabilities of Jaspersoft including: dashboards, data visualization, ad-hoc reporting and production reporting -Demonstrate the user experience from an end-user perspective as well as a BI Builder -Conduct a Q & A session

JASPERSOFT LIVE DEMO - NAM

TIBCO Jaspersoft

Comparison of Data Preparation vs. Data Wrangling Programming Languages, Frameworks and Tools in Machine Learning / Deep Learning Projects. A key task to create appropriate analytic models in machine learning or deep learning is the integration and preparation of data sets from various sources like files, databases, big data storages, sensors or social networks. This step can take up to 80% of the whole project. This session compares different alternative techniques to prepare data, including extract-transform-load (ETL) batch processing (like Talend, Pentaho), streaming analytics ingestion (like Apache Storm, Flink, Apex, TIBCO StreamBase, IBM Streams, Software AG Apama), and data wrangling (DataWrangler, Trifacta) within visual analytics. Various options and their trade-offs are shown in live demos using different advanced analytics technologies and open source frameworks such as R, Python, Apache Hadoop, Spark, KNIME or RapidMiner. The session also discusses how this is related to visual analytics tools (like TIBCO Spotfire), and best practices for how the data scientist and business user should work together to build good analytic models. Key takeaways for the audience: - Learn various options for preparing data sets to build analytic models - Understand the pros and cons and the targeted persona for each option - See different technologies and open source frameworks for data preparation - Understand the relation to visual analytics and streaming analytics, and how these concepts are actually leveraged to build the analytic model after data preparation Video Recording / Screencast of this Slide Deck: https://youtu.be/2MR5UynQocs

Data Preparation vs. Inline Data Wrangling in Data Science and Machine Learning

Kai Wähner

The Briefing Room with Dean Abbott and Tableau Software Live Webcast July 23, 2013 http://www.insideanalysis.com Today’s desire for analytics extends well beyond the traditional domain of Business Intelligence. That’s partly because business users are realizing the value of mixing and matching all kinds of data, from all kinds of sources. One emerging market driver is Cloud-based data, and the desire companies have to analyze this data cohesively with their on-premise data sets. Register for this episode of The Briefing Room to learn from Analyst Dean Abbott, who will explain how the ability to access data in the cloud can play a critical role for generating business value from analytics. He’ll be briefed by Ellie Fields of Tableau Software who will tout Tableau’s latest release, which includes native connectors to cloud-based applications like Salesforce.com, Amazon Redshift, Google Analytics and BigQuery. She’ll also demonstrate how Tableau can combine cloud data with other data sources, including spreadsheets, databases, cubes and even Big Data.

Bridging the Gap: Analyzing Data in and Below the Cloud

Inside Analysis

I presented this at a 2014 Tableau Conference session with Albert Wong. Netflix relies on data to make decisions ranging from buying and recommending content, to improving the streaming experience on devices. This presentation shares our Big Data analytics architecture and the tools used to make data accessible throughout our business, focusing on how Tableau fits into our organization and why it aligns well with our culture.

DATA @ NFLX (Tableau Conference 2014 Presentation)

Blake Irvine

How to Leverage Machine Learning (R, Hadoop, Spark, H2O) for Real Time Proces...

Codemotion Tel Aviv

Similaire à Data-Driven @ Netflix (20)

Data engineering at the interface of art and analytics: the why, what, and ho...

AI Solutions with Macnica.ai - AI Expo 2018 Tokyo Japan

Getting Started with Amazon DynamoDB

Using BigDL on Apache Spark to Improve the MLS Real Estate Search Experience ...

[Public] 7 archetipi della tecnologia moderna [italy]

Pinterest - Big Data Machine Learning Platform at Pinterest

Big Data LDN 2017: How Big Data Insights Become Easily Accessible With Workfl...

The Complexity to "Yes" in Analytics Software and the Possibilities with Dock...

Start Getting Your Feet Wet in Open Source Machine and Deep Learning

Analytical Innovation: How to Build the Next Generation Data Platform

Applying R in BI and Real Time applications EARL London 2015

New Opportunities for Connected Data - Emil Eifrem @ GraphConnect Boston + Ch...

Big Data LDN 2017: Big Impact with Big Data

Applying the R Language to BI and Real Time Applications

Maximize Big Data ROI via Best of Breed Patterns and Practices

JASPERSOFT LIVE DEMO - NAM

Data Preparation vs. Inline Data Wrangling in Data Science and Machine Learning

Bridging the Gap: Analyzing Data in and Below the Cloud

DATA @ NFLX (Tableau Conference 2014 Presentation)

How to Leverage Machine Learning (R, Hadoop, Spark, H2O) for Real Time Proces...

Dernier

In an era where artificial intelligence (AI) stands at the forefront of business innovation, Information Architecture (IA) is at the core of functionality. See “There’s No AI Without IA” – (from 2016 but even more relevant today) Understanding and leveraging how Information Architecture (IA) supports AI synergies between knowledge engineering and prompt engineering is critical for senior leaders looking to successfully deploy AI for internal and externally facing knowledge processes. This webinar be a high-level overview of the methodologies that can elevate AI-driven knowledge processes supporting both employees and customers. Core Insights Include: Strategic Knowledge Engineering: Delve into how structuring AI's knowledge base is required to prevent hallucinations, enable contextual retrieval of accurate information. This will include discussion of gold standard libraries of use cases support testing various LLMs and structures and configurations of knowledge base. Precision in Prompt Engineering: Learn the art of crafting prompts that direct AI to deliver targeted, relevant responses, thereby optimizing customer experiences and business outcomes. Unified Approach for Enhanced AI Performance: Explore the intersection of knowledge and prompt engineering to develop AI systems that are not only more responsive but also aligned with overarching business strategies. Guiding Principles for Implementation: Equip yourself with best practices, ethical guidelines, and strategic considerations for embedding these technologies into your business ecosystem effectively. This webinar is designed to empower business and technology leaders with the knowledge to harness the full potential of AI, ensuring their organizations not only keep pace with digital transformation but lead the charge. Join us to map a roadmap to fully leverage Information Architecture (IA) and AI chart a course towards a future where AI is a key pillar of strategic innovation and business success.

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx

Earley Information Science

Heather Hedden, Senior Consultant at Enterprise Knowledge, presented “The Role of Taxonomy and Ontology in Semantic Layers” at a webinar hosted by Progress Semaphore on April 16, 2024. Taxonomies at their core enable effective tagging and retrieval of content, and combined with ontologies they extend to the management and understanding of related data. There are even greater benefits of taxonomies and ontologies to enhance your enterprise information architecture when applying them to a semantic layer. A survey by DBP-Institute found that enterprises using a semantic layer see their business outcomes improve by four times, while reducing their data and analytics costs. Extending taxonomies to a semantic layer can be a game-changing solution, allowing you to connect information silos, alleviate knowledge gaps, and derive new insights. Hedden, who specializes in taxonomy design and implementation, presented how the value of taxonomies shouldn’t reside in silos but be integrated with ontologies into a semantic layer. Learn about: - The essence and purpose of taxonomies and ontologies in information and knowledge management; - Advantages of semantic layers leveraging organizational taxonomies; and - Components and approaches to creating a semantic layer, including the integration of taxonomies and ontologies

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf

Enterprise Knowledge

Sara Mae O’Brien Scott and Tatiana Baquero Cakici, Senior Consultants at Enterprise Knowledge (EK), presented “AI Fast Track to Search-Focused AI Solutions” at the Information Architecture Conference (IAC24) that took place on April 11, 2024 in Seattle, WA. In their presentation, O’Brien-Scott and Cakici focused on what Enterprise AI is, why it is important, and what it takes to empower organizations to get started on a search-based AI journey and stay on track. The presentation explored the complexities of enterprise search challenges and how IA principles can be leveraged to provide AI solutions through the use of a semantic layer. O’Brien-Scott and Cakici showcased a case study where a taxonomy, an ontology, and a knowledge graph were used to structure content at a healthcare workforce solutions organization, providing personalized content recommendations and increasing content findability. In this session, participants gained insights about the following: Most common types of AI categories and use cases; Recommended steps to design and implement taxonomies and ontologies, ensuring they evolve effectively and support the organization’s search objectives; Taxonomy and ontology design considerations and best practices; Real-world AI applications that illustrated the value of taxonomies, ontologies, and knowledge graphs; and Tools, roles, and skills to design and implement AI-powered search solutions.

IAC 2024 - IA Fast Track to Search Focused AI Solutions

Enterprise Knowledge

Histor y of HAM Radio presentation slide

vu2urc

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

The Digital Insurer

How to Troubleshoot Apps for the Modern Connected Worker

ThousandEyes

Data Cloud, More than a CDP by Matt Robison

Anna Loughnan Colquhoun

BooK Now Call us at +918448380779 to hire a gorgeous and seductive call girl for sex. Take a Delhi Escort Service. The help of our escort agency is mostly meant for men who want sexual Indian Escorts In Delhi NCR. It should be noted that any impersonator will get 100 attention from our Young Girls Escorts in Delhi. They will assume the position of reliable allies. VIP Call Girl With Original Photos Book Tonight +918448380779 Our Cheap Price 1 Hour not available 2 Hours 5000 Full Night 8000 TAG: Call Girls in Delhi, Noida, Gurgaon, Ghaziabad, Connaught Place, Greater Kailash Delhi, Lajpat Nagar Delhi, Mayur Vihar Delhi, Chanakyapuri Delhi, New Friends Colony Delhi, Majnu Ka Tilla, Karol Bagh, Malviya Nagar, Saket, Khan Market, Noida Sector 18, Noida Sector 76, Noida Sector 51, Gurgaon Mg Road, Iffco Chowk Gurgaon, Rajiv Chowk Gurgaon All Delhi Ncr Free Home Deliver

08448380779 Call Girls In Civil Lines Women Seeking Men

Delhi Call girls

This presentations targets students or working professionals. You may know Google for search, YouTube, Android, Chrome, and Gmail, but did you know Google has many developer tools, platforms & APIs? This comprehensive yet still high-level overview outlines the most impactful tools for where to run your code, store & analyze your data. It will also inspire you as to what's possible. This talk is 50 minutes in length.

Powerful Google developer tools for immediate impact! (2023-24 C)

wesley chun

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Neo4j

GenCyber Cyber Security Day Presentation

Michael W. Hawkins

Abhishek Deb(1), Mr Abdul Kalam(2) M. Des (UX) , School of Design, DIT University , Dehradun. This paper explores the future potential of AI-enabled smartphone processors, aiming to investigate the advancements, capabilities, and implications of integrating artificial intelligence (AI) into smartphone technology. The research study goals consist of evaluating the development of AI in mobile phone processors, analyzing the existing state as well as abilities of AI-enabled cpus determining future patterns as well as chances together with reviewing obstacles as well as factors to consider for more growth.

Exploring the Future Potential of AI-Enabled Smartphone Processors

debabhi2

Tata AIG General Insurance Company - Insurer Innovation Award 2024

The Digital Insurer

In this session, we will delve into strategic approaches for optimizing knowledge management within Microsoft 365, amidst the evolving landscape of Copilot. From leveraging automatic metadata classification and permission governance with SharePoint Premium, to unlocking Viva Engage for the cultivation of knowledge and communities, you will gain actionable insights to bolster your organization's knowledge-sharing initiatives. In this session, we will also explore how to facilitate solutions to enable your employees to find answers and expertise within Microsoft 365. You will leave equipped with practical techniques and a deeper understanding of how there is more to effective knowledge management than just enabling Copilot, but building actual solutions to prepare the knowledge that Copilot and your employees can use.

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Drew Madelung

Choosing the right accounts payable services provider is a strategic decision that can significantly impact your business's financial performance and operational efficiency. By considering factors such as expertise, range of services, technology infrastructure, scalability, cost, and reputation, businesses can make informed decisions and select a provider that aligns with their unique needs and objectives. Partnering with the right provider can streamline accounts payable processes, drive cost savings, and position your business for long-term success. https://katprotech.com/accounts-payable-and-purchase-order-automation/

Factors to Consider When Choosing Accounts Payable Services Providers.pptx

Katpro Technologies

Imagine a world where information flows as swiftly as thought itself, making decision-making as fluid as the data driving it. Every moment is critical, and the right tools can significantly boost your organization’s performance. The power of real-time data automation through FME can turn this vision into reality. Aimed at professionals eager to leverage real-time data for enhanced decision-making and efficiency, this webinar will cover the essentials of real-time data and its significance. We’ll explore: FME’s role in real-time event processing, from data intake and analysis to transformation and reporting An overview of leveraging streams vs. automations FME’s impact across various industries highlighted by real-life case studies Live demonstrations on setting up FME workflows for real-time data Practical advice on getting started, best practices, and tips for effective implementation Join us to enhance your skills in real-time data automation with FME, and take your operational capabilities to the next level.

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

Safe Software

Slack Application Development 101 Slides

praypatel2

What is a good lead in your organisation? Which leads are priority? What happens to leads? When sales and marketing give different answers to these questions, or perhaps aren't sure of the answers at all, frustrations build and opportunities are left on the table. Join us for an illuminating session with Cian McLoughlin, HubSpot Principal Customer Success Manager, as we look at that crucial piece of the customer journey in which leads are transferred from marketing to sales.

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

HampshireHUG

Microsoft's Threat Matrix for Kubernetes helps organizations understand the attack surface a Kubernetes deployment introduces to their environments. This ensures that adequate detections and mitigations are in place. By covering over 40 different attacker techniques, defenders can learn about Kubernetes-specific mitigations and controls to deploy to their environments. In this session, we will explore the MS-TA9013 Host Path Mount technique, which is commonly used by attackers to perform privilege escalation in a Kubernetes cluster. Attendees will learn how attackers and defenders can: * Escape the container's host volume mount to gain persistence on an underlying node * Move laterally from the underlying node into the customer's cloud environment * Analyze Kubernetes audit logs to detect pods deployed with a hostPath mount * Deploy an admission controller that prevents new pods from using a hostPath mount

Breaking the Kubernetes Kill Chain: Host Path Mount

Puma Security, LLC

Axa Assurance Maroc - Insurer Innovation Award 2024

The Digital Insurer

Dernier (20)

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf

IAC 2024 - IA Fast Track to Search Focused AI Solutions

Histor y of HAM Radio presentation slide

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

How to Troubleshoot Apps for the Modern Connected Worker

Data Cloud, More than a CDP by Matt Robison

08448380779 Call Girls In Civil Lines Women Seeking Men

Powerful Google developer tools for immediate impact! (2023-24 C)

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

GenCyber Cyber Security Day Presentation

Exploring the Future Potential of AI-Enabled Smartphone Processors

Tata AIG General Insurance Company - Insurer Innovation Award 2024

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Factors to Consider When Choosing Accounts Payable Services Providers.pptx

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

Slack Application Development 101 Slides

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

Breaking the Kubernetes Kill Chain: Host Path Mount

Axa Assurance Maroc - Insurer Innovation Award 2024

Data-Driven @ Netflix

1. Data-Driven @ Netflix Michelle Ufford Principal Architect Data Engineering & Analytics

2. Michelle Ufford Highlights ● Principal Architect at Netflix Data Engineering & Analytics ● Prev. Engineering Manager at GoDaddy Data Platform ● Microsoft Data Platform MVP ● 10+ years building web-scale analytics & data engineering infrastructure ● advises on Big Data topics Microsoft, Hortonworks, Teradata, etc. Gratuitous picture of my kids

3. By the Numbers.

4. The business numbers. 86.7 million members 1000+ devices supported 125+ million hours watched launched 19 years ago every. day.

5. Any device. Anywhere.* * Well, almost anywhere.

6. The data numbers. 4 petabyte DW reads 300 terabyte DW writes 40 petabyte data warehouse 700+ billion events written

7. Data in Action.

8. Content. What should we license?

9. Predicting Value for Licensed Content. Feature Engineering Predictive Models License Terms Content Efficiency

10. Predicting Value for Licensed Content. ● past performance of similar content on Netflix ● broadcast & Box Office performance ● talent (writers, actors, directors, etc.) ● critic & user reviews ● awards & accolades Feature Engineering Predictive Models License Terms Content Efficiency

11. Predicting Value for Licensed Content. Feature Engineering Predictive Models License Terms Content Efficiency

12. Predicting Value for Licensed Content. ● terms (length, exclusivity, etc.) ● bid amount ● negotiations Feature Engineering Predictive Models License Terms Content Efficiency

13. Predicting Value for Licensed Content. ● value / cost ● if efficient, license Feature Engineering Predictive Models License Terms Content Efficiency

14. “ last year our original content overall was some of our most efficient content. ”

15. “ We are building a studio in the cloud and pioneering new approaches to movie production, optimizing pitches, production schedules, subtitling, and digital asset management for our Original content. ”

16.

17. What should we license?create?

18. Product UX. Data. Driven. Experience.

19.

20.

21.

22.

23.

24. There are 86 million different versions of Netflix.

25. billboard rows, row order titles, title order title artwork

26. Public Relations. Analytics of news.Analytics is news.

27.

28.

29. Content Delivery. Monitoring a global service.

30.

31. YouTube video of Vizceral demo https://youtu.be/JctsPpgEsVs

32. Behind the Scenes.

33. data access AWS S3 Big Data Platform Amazon Redshift data processing fast storage data viz METACA T data services events data operational data elastic storage Apache Pig

34. Philosophy.

35.

36. Freedom & Responsibility.

37.

38. Context, Not Control.

39.

40.

41. Highly Aligned & Loosely Coupled.

42. Big Data Platform

43. Data Engineering & Analytics MarketingProduct PlaybackContent Finance 105 talented engineers & analysts data viz engineers analytics engineers data engineers Big Data Platform analysts

44. Results, Not Opinions.

45.

46.

47.

48. Experimentation Platform Batch & Ad Hoc Analysis

49. Questions?

50. Thank you for attending! Michelle Ufford linkedin.com/in/mufford @sqlfool Data @ Netflix @NetflixData hadoopsie.com techblog.netflix.com tinyurl.com/NetflixData

Notes de l'éditeur

Abstract: Netflix is the quintessential data-driven company. It’s 83 million members stream more than 125 million hours in over 190 countries every day and generate more than 700 billion events in the process. In this session, we’ll share how data is used to make informed decisions across the entire business — from content acquisition to content delivery, and everything in between. We’ll look at how Netflix successfully employs a scalable cloud-based data platform to support a constant deluge of data and a small army of data analysts, engineers, and scientists. We’ll discuss the advanced analytical capabilities that are enabled through modern data technologies. Lastly, we’ll explore some of the architectural & operational principals that enable Netflix to so effectively make use of its data.
Obligatory “why should you listen to me talk?” slide
Numbers as of Q3 2016
During CES 2016 this January, ‘flipped the switch’ making Netflix available in 130+ new countries. Netflix is presently available in over 190 countries worldwide.
What content should we license? How much should we bid? How should we value exclusivity? How should we measure content performance?
Originals content: 2015 - 450 hours 2016 - 600 hours 2017 - 1000 hours
Netflix website: circa 2012
Netflix website: circa 2013
Netflix website: circa 2014
Netflix website: circa 2015
Netflix website: circa 2016
Vizceral Open-Source Project: https://github.com/netflix/vizceral http://techblog.netflix.com/2016/08/vizceral-open-source.html http://techblog.netflix.com/2015/10/flux-new-approach-to-system-intuition.html
Genie – federated job execution engine Metacat – federated metadata service Kragle – python APIs
15m views on SlideShare
Minimize rules Make smart choices Take ownership
Avoid prescriptive requirements Give visibility
Set context (strategy, goals) Communicate only as much as needed
At Netflix, we use the scientific method We’re often right at predicting behavior – for people exactly like us Most people aren’t like us

Data-Driven @ Netflix

Recommandé

Recommandé

Contenu connexe

Tendances

Tendances (20)

Similaire à Data-Driven @ Netflix

Similaire à Data-Driven @ Netflix (20)

Dernier

Dernier (20)

Data-Driven @ Netflix

Notes de l'éditeur