Big Data Day LA 2016 Keynote - Paul Ellwood/ Netflix

•

0 j'aime•623 vues

Data Con LA

Big Data Day LA 2016 - Paul Ellwood, VP - Data Engineering & Analytics, Netflix

Technologie

Netflix Is The New…?
Paul Ellwood
VP, Data Engineering & Analytics

Programming
- Content Knowledge Base
- Identifying Opportunities
- Predicting Performance
- Measuring Performance
- Catalog Health

Digital Supply Chain
- Localization
- Encoding
- Quality Control

Paul Ellwood
pellwood@netflix.com
@pellwood

Contenu connexe

En vedette

Jay Kreps, Open Source Visionary and Co Founder of Confluent and several open source projects will be visiting LA. I have asked him to come present at our group. He will present his vision and will answer questions regarding Kafka and other projects Bio:- Jay is the co-founder and CEO at Confluent a company built around realtime data streams and the open source messaging system Apache Kafka. He is the original author of several of open source projects including Apache Kafka, Apache Samza, Voldemort, and Azkaban.

An evening with Jay Kreps; author of Apache Kafka, Samza, Voldemort & Azkaban.

Data Con LA

Big Data Day LA 2016 Keynote - Jeanne Holm/ City of LA

Data Con LA

Companies analyzing big data help achieve important business objectives such as customer retention, real-time in-context marketing, omni-channel marketing productivity, campaign productivity and operational efficiencies. Cloud-based big data architectures create lower risk, lower startup costs and faster time-to-market. This session will examine the key advantages from deploying big data in the cloud, such as the flexibility to auto scale and the ability to experiment with on-demand and hybrid nodes. We will also discuss lessons learned from big data in the cloud, such as how to avoid bottlenecks by building caches or how to design instances to leverage spotting.

Big Data Day LA 2015 - Lessons learned from scaling Big Data in the Cloud by...

Data Con LA

How can our data make the biggest impact? How do we find the stories worth sharing buried in our analytics? How important are visuals, hooks, connections, content? As data science and journalism have co-evolved, the potential for effectively communicating with data has skyrocketed. We'll look at case studies of impactful data stories and share the process for developing data stories that drive action.

Big Data Day LA 2016/ Data Science Track - Data Storytelling for Impact - Dav...

Data Con LA

The social media real estate you put time into is as important as the suburb you invest in. The right place at the right price is what gives good returns. For time-poor professionals looking to start out in social media the sheer number of platforms to choose from can feel overwhelming – LinkedIn, Twitter, Facebook, YouTube, Pinterest, Google Plus? It’s a bit like selecting the ‘all suburbs’ search when you are trying to find somewhere to live. While I am loathe to suggest one platform to the exclusion of others (because together they create an amplification effect) if you’re a professional or need to reach high net worth individuals then research suggests that a great place to live is LinkedIn. This is why.

Do you know how the ultra affluent use social media? Find out.

The Social Executive

Spark After Dark is a mock dating site that uses the latest Spark libraries, AWS Kinesis, Lambda Architecture, and Probabilistic Data Structures to generate dating recommendations. There will be 5+ demos covering everything from basic data ETL to advanced data processing including Alternating Least Squares Machine Learning/Collaborative Filtering and PageRank Graph Processing. There is heavy emphasis on Spark Streaming and AWS Kinesis. Watch the video here https://www.youtube.com/watch?v=g0i_d8YT-Bs

Spark after Dark by Chris Fregly of Databricks

Data Con LA

Example 3, Warner Brothers 2016

Carla Emilian Olivas

Abstract:- With its easy to use interfaces and native integration with some of the most popular ingest tools, such as Kafka, Flume, Kinesis etc, Spark Streaming has become go-to tool for stream processing. Code sharing with Spark also makes it attractive. In this talk, we will discuss the latest features in Spark Streaming and how it integrates with Kafka natively with no data loss, and even do exactly once processing! Bio:- Hari Shreedharan is a PMC member and committer on the Apache Flume Project. As a PMC member, he is involved in making decisions on the direction of the project. Author of the O’Reilly book Using Flume, Hari is also a software engineer at Cloudera, where he works on Apache Flume, Apache Spark, and Apache Sqoop. He also ensures that customers can successfully deploy and manage Flume, Spark, and Sqoop on their clusters, by helping them resolve any issues they are facing.

Spark Streaming& Kafka-The Future of Stream Processing by Hari Shreedharan of...

Data Con LA

6 damaging myths about social media and the truths behind them

The Social Executive

Greg Ballard, Warner Bros.

anastasiaalikova

Big Data Day LA 2016/ Use Case Driven track - Shaping the Role of Data Scienc...

Data Con LA

While we frequently talk about how to build interesting products on top of machine and event data, the reality is that collecting, organizing, providing access to, and managing this data is where most people get stuck. In this session, we’ll follow the flow of data through an end to end system built to handle tens of terabytes per day of event-oriented data, providing real time streaming, in-memory, SQL, and batch access to this data. We’ll go into detail on how open source systems such as Hadoop, Kafka, Solr, and Impala/Hive are actually stitched together; describe how and where to perform data transformation and aggregation; provide a simple and pragmatic way of managing event metadata; and talk about how applications built on top of this platform get access to data and extend its functionality. This session is especially recommended for data infrastructure engineers and architects planning, building, or maintaining similar systems.

Big Data Day LA 2016/ Hadoop/ Spark/ Kafka track - Building an Event-oriented...

Data Con LA

Today’s Software Defined environments attempt to remove the weakness of computing hardware from the operational equation. There is no doubt that this is a natural progress away from overpriced, proprietary compute and storage layers. However, even at the heart of any Software Defined universe is an underlying hardware stack that must be robust, reliable and cost effective. Our 20+ years experience delivering over 2000 clusters and clouds has taught us how to properly design and engineer the right hardware solution for Big Data, Cluster and Cloud environments. This presentation will share this knowledge allowing user to make better design decisions for any deployment.

Big Data Day LA 2016/ Use Case Driven track - From Clusters to Clouds, Hardwa...

Data Con LA

Big Data Day LA 2016/ NoSQL track - Big Data and Real Estate, Jon Zifcak, CEO...

Data Con LA

Big Data Day LA 2016/ Data Science Track - Intuit's Payments Risk Platform, D...

Data Con LA

Big Data Day LA 2016/ Use Case Driven track - How to Use Design Thinking to J...

Data Con LA

As integrated web analytics evolves to both a service oriented and event based model, there will be higher emphasis on moving toward event based analytics. Business analytics is moving from purely counts of analytics to time-series, relationship and usage analytics. Examples of web analytics that can take advantage of this architecture are conversions analytics or cross channel marketing. The advantage of storing raw event data is that you have maximum flexibility for analysis. For example, you can trace the sequence of pages that one person visited over the course of their session. You can’t do that if you’ve squashed all the events into e.g. counters. That sort of analysis is really important for some offline processing tasks, such as training a recommender system (“people who bought X also bought Y”, that sort of thing). For such use cases, it’s best to simply keep all the raw events, so that you can later feed them all into your shiny new machine learning system. In this session we are going to elaborate on using Kafka, an Event Processing framework (e.g. Storm or Spark Streaming) and either Hadoop or EDW for building an Event Driven Architecture.

Big Data Day LA 2015 - Event Driven Architecture for Web Analytics by Peyman ...

Data Con LA

This talk explores deploying a series of small and large batch and streaming pipelines locally, to Spark and Flink clusters and to Google Cloud Dataflow services to give the audience a feel for the portability of Beam, a new portable Big Data processing framework recently submitted by Google to the Apache foundation. This talk will look at how the programming model handles late arriving data in a stream with event time, windows, and triggers.

Big Data Day LA 2016/ Big Data Track - Portable Stream and Batch Processing w...

Data Con LA

Abstract:- Come learn about Google BigQuery and its underlying architecture. Felipe will go over the evolution of BigQuery and explain some of the underlying principles of BigQuery and Dremel. Felipe will also go over some of the latest use cases and will demo a use case of Google BigQuery Bio:- Felipe Hoffa moved from Chile to San Francisco to join Google as a Software Engineer. Since 2013 he's been a Developer Advocate on big data - to inspire developers around the world to leverage the Google Cloud Platform tools to analyze and understand their data in ways they could never before. You can find him in several YouTube videos, blog posts, and conferences around the world. Follow Felipe at https://twitter.com/felipehoffa.

An indepth look at Google BigQuery Architecture by Felipe Hoffa of Google

Data Con LA

Warner Bros

N V Jagadeesh Kumar

En vedette (20)