Online Content Optimization with Hadoop__HadoopSummit2010

•

3 j'aime•410 vues

Yahoo Developer Network

Hadoop Summit 2010 - Application Track Online Content Optimization with Hadoop Amit Phadke, Yahoo!

Online Content Optimization using Hadoop ,[object Object],[object Object],[object Object],[object Object],Yahoo!

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Content Optimization

Data Flow ,[object Object],[object Object],[object Object],[object Object]

Content Meta Data Source ,[object Object],[object Object]

Event Data Source ,[object Object],[object Object]

HBase ,[object Object],[object Object],[object Object]

HBase ,[object Object],[object Object],[object Object],[object Object]

MapReduce ,[object Object],[object Object]

Job co-ordination ,[object Object],[object Object]

Leader Election (Zookeeper) ,[object Object],[object Object],[object Object]

Edge Services ,[object Object],[object Object],[object Object]

Serving Store ,[object Object],[object Object]

Questions? ,[object Object]

Contenu connexe

Tendances

Hd insight essentials quick view

Hd insight essentials quick view

Hd insight essentials quick view

Rajesh Nadipalli

Azure Big Data Story

Azure Big Data Story

Azure Big Data Story

Azure Cosmos DB - NoSQL In the Microsoft Cloud

Azure Cosmos DB - NoSQL In the Microsoft Cloud

Azure Cosmos DB - NoSQL In the Microsoft Cloud

Big data in Azure

Big data in Azure

Big data in Azure

Venkatesh Narayanan

Владимир Слободянюк «DWH & BigData – architecture approaches»

Владимир Слободянюк «DWH & BigData – architecture approaches»

Владимир Слободянюк «DWH & BigData – architecture approaches»

Anna Shymchenko

Which database should I use for my app?

Which database should I use for my app?

Which database should I use for my app?

Building Data Lakes with Apache Airflow

Building Data Lakes with Apache Airflow

Building Data Lakes with Apache Airflow

Using ElasticSearch as a fast, flexible, and scalable solution to search occu...

Using ElasticSearch as a fast, flexible, and scalable solution to search occu...

Using ElasticSearch as a fast, flexible, and scalable solution to search occu...

Integrating an editorial calendar with Drupal / Thunder

Integrating an editorial calendar with Drupal / Thunder

Integrating an editorial calendar with Drupal / Thunder

Cloudian HyperStore Operating Environment

Cloudian HyperStore Operating Environment

Cloudian HyperStore Operating Environment

Paris Day Cassandra: Use case

Paris Day Cassandra: Use case

Paris Day Cassandra: Use case

Christopher Batey

Nosql Introduction, Basics

Nosql Introduction, Basics

Nosql Introduction, Basics

Camellia Ghoroghi

Next Generation Data Platforms - Deon Thomas

Next Generation Data Platforms - Deon Thomas

Next Generation Data Platforms - Deon Thomas

Pivotal-HadoopOverview2016-working

Pivotal-HadoopOverview2016-working

Pivotal-HadoopOverview2016-working

Building an API layer for C* at Coursera

Building an API layer for C* at Coursera

Building an API layer for C* at Coursera

Daniel Jin Hao Chia

Big data is the new big thing where storing the data is the easy part. Gaining insights in your pile of data is something different. Based on a data dump of the well-known StackExchange websites, we will store & analyse 150+ GB of data with Azure Data Lake Store & Analytics to gain some insights about their users. After that we will use Power BI to give an at a glance overview of our learnings. If you are a developer that is interested in big data, this is your time to shine! We will use our existing SQL & C# skills to analyse everything without having to worry about running clusters.

Integration Monday - Analysing StackExchange data with Azure Data Lake

Integration Monday - Analysing StackExchange data with Azure Data Lake

Integration Monday - Analysing StackExchange data with Azure Data Lake

Database Choices

Database Choices

Database Choices

Hadoop bangalore-meetup-dec-2011-yoda

Hadoop bangalore-meetup-dec-2011-yoda

Hadoop bangalore-meetup-dec-2011-yoda

Big Data and Hadoop Training in Chandigarh

Big Data and Hadoop Training in Chandigarh

Big Data and Hadoop Training in Chandigarh

Big Boxx Animation Academy

CouchbasetoHadoop_Matt_Michael_Justin v4

CouchbasetoHadoop_Matt_Michael_Justin v4

CouchbasetoHadoop_Matt_Michael_Justin v4

Tendances (20)

Hd insight essentials quick view

Hd insight essentials quick view

Hd insight essentials quick view

Azure Big Data Story

Azure Big Data Story

Azure Big Data Story

Azure Cosmos DB - NoSQL In the Microsoft Cloud

Azure Cosmos DB - NoSQL In the Microsoft Cloud

Azure Cosmos DB - NoSQL In the Microsoft Cloud

Big data in Azure

Big data in Azure

Big data in Azure

Владимир Слободянюк «DWH & BigData – architecture approaches»

Владимир Слободянюк «DWH & BigData – architecture approaches»

Владимир Слободянюк «DWH & BigData – architecture approaches»

Which database should I use for my app?

Which database should I use for my app?

Which database should I use for my app?

Building Data Lakes with Apache Airflow

Building Data Lakes with Apache Airflow

Building Data Lakes with Apache Airflow

Using ElasticSearch as a fast, flexible, and scalable solution to search occu...

Using ElasticSearch as a fast, flexible, and scalable solution to search occu...

Using ElasticSearch as a fast, flexible, and scalable solution to search occu...

Integrating an editorial calendar with Drupal / Thunder

Integrating an editorial calendar with Drupal / Thunder

Integrating an editorial calendar with Drupal / Thunder

Cloudian HyperStore Operating Environment

Cloudian HyperStore Operating Environment

Cloudian HyperStore Operating Environment

Paris Day Cassandra: Use case

Paris Day Cassandra: Use case

Paris Day Cassandra: Use case

Nosql Introduction, Basics

Nosql Introduction, Basics

Nosql Introduction, Basics

Next Generation Data Platforms - Deon Thomas

Next Generation Data Platforms - Deon Thomas

Next Generation Data Platforms - Deon Thomas

Pivotal-HadoopOverview2016-working

Pivotal-HadoopOverview2016-working

Pivotal-HadoopOverview2016-working

Building an API layer for C* at Coursera

Building an API layer for C* at Coursera

Building an API layer for C* at Coursera

Integration Monday - Analysing StackExchange data with Azure Data Lake

Integration Monday - Analysing StackExchange data with Azure Data Lake

Integration Monday - Analysing StackExchange data with Azure Data Lake

Database Choices

Database Choices

Database Choices

Hadoop bangalore-meetup-dec-2011-yoda

Hadoop bangalore-meetup-dec-2011-yoda

Hadoop bangalore-meetup-dec-2011-yoda

Big Data and Hadoop Training in Chandigarh

Big Data and Hadoop Training in Chandigarh

Big Data and Hadoop Training in Chandigarh

CouchbasetoHadoop_Matt_Michael_Justin v4

CouchbasetoHadoop_Matt_Michael_Justin v4

CouchbasetoHadoop_Matt_Michael_Justin v4

Similaire à Online Content Optimization with Hadoop__HadoopSummit2010

Big Data and Hadoop

Big Data and Hadoop

Big Data and Hadoop

Big-Data Hadoop Tutorials - MindScripts Technologies, Pune

Big-Data Hadoop Tutorials - MindScripts Technologies, Pune

Big-Data Hadoop Tutorials - MindScripts Technologies, Pune

Hadoop and BigData - July 2016

Hadoop and BigData - July 2016

Hadoop and BigData - July 2016

A Glimpse of Bigdata - Introduction

A Glimpse of Bigdata - Introduction

A Glimpse of Bigdata - Introduction

How Hadoop Revolutionized Data Warehousing at Yahoo and Facebook

How Hadoop Revolutionized Data Warehousing at Yahoo and Facebook

How Hadoop Revolutionized Data Warehousing at Yahoo and Facebook

Big Data Concepts

Big Data Concepts

Big Data Concepts

Hadoop @ Sara & BiG Grid

Hadoop @ Sara & BiG Grid

Hadoop @ Sara & BiG Grid

Architecting the Future of Big Data and Search

Architecting the Future of Big Data and Search

Architecting the Future of Big Data and Search

Scalable Application Insight Framework

Scalable Application Insight Framework

Scalable Application Insight Framework

Rajesh Chandramohan

Big Data , Big Problem?

Big Data , Big Problem?

Big Data , Big Problem?

Mohammadhasan Farazmand

Hadoop ecosystem framework n hadoop in live environment

Hadoop ecosystem framework n hadoop in live environment

Hadoop ecosystem framework n hadoop in live environment

Cloud Computing: Hadoop

Cloud Computing: Hadoop

Cloud Computing: Hadoop

Hadoop jon

Humoyun Ahmedov

Hadoop An Introduction

Hadoop An Introduction

Hadoop An Introduction

Mohanasundaram Ponnusamy

Hadoop basics

Hadoop: An Industry Perspective

Hadoop: An Industry Perspective

Hadoop: An Industry Perspective

How can Hadoop & SAP be integrated

How can Hadoop & SAP be integrated

How can Hadoop & SAP be integrated

Douglas Bernardini

Need for Time series Database

Need for Time series Database

Need for Time series Database

Pramit Choudhary

Overview of Big data, Hadoop and Microsoft BI - version1 Big Data and Hadoop are emerging topics in data warehousing for many executives, BI practices and technologists today. However, many people still aren't sure how Big Data and existing Data warehouse can be married and turn that promise into value. This presentation provides an overview of Big Data technology and how Big Data can fit to the current BI/data warehousing context. http://www.quantumit.com.au http://www.evisional.com

Overview of big data & hadoop version 1 - Tony Nguyen

Overview of big data & hadoop version 1 - Tony Nguyen

Overview of big data & hadoop version 1 - Tony Nguyen

Big Data and advanced analytics are critical topics for executives today. But many still aren't sure how to turn that promise into value. This presentation provides an overview of 16 examples and use cases that lay out the different ways companies have approached the issue and found value: everything from pricing flexibility to customer preference management to credit risk analysis to fraud protection and discount targeting. For the latest on Big Data & Advanced Analytics: http://mckinseyonmarketingandsales.com/topics/big-data

Overview of Big data, Hadoop and Microsoft BI - version1

Overview of Big data, Hadoop and Microsoft BI - version1

Overview of Big data, Hadoop and Microsoft BI - version1

Similaire à Online Content Optimization with Hadoop__HadoopSummit2010 (20)

Big Data and Hadoop

Big Data and Hadoop

Big Data and Hadoop

Big-Data Hadoop Tutorials - MindScripts Technologies, Pune

Big-Data Hadoop Tutorials - MindScripts Technologies, Pune

Big-Data Hadoop Tutorials - MindScripts Technologies, Pune

Hadoop and BigData - July 2016

Hadoop and BigData - July 2016

Hadoop and BigData - July 2016

A Glimpse of Bigdata - Introduction

A Glimpse of Bigdata - Introduction

A Glimpse of Bigdata - Introduction

How Hadoop Revolutionized Data Warehousing at Yahoo and Facebook

How Hadoop Revolutionized Data Warehousing at Yahoo and Facebook

How Hadoop Revolutionized Data Warehousing at Yahoo and Facebook

Big Data Concepts

Big Data Concepts

Big Data Concepts

Hadoop @ Sara & BiG Grid

Hadoop @ Sara & BiG Grid

Hadoop @ Sara & BiG Grid

Architecting the Future of Big Data and Search

Architecting the Future of Big Data and Search

Architecting the Future of Big Data and Search

Scalable Application Insight Framework

Scalable Application Insight Framework

Scalable Application Insight Framework

Big Data , Big Problem?

Big Data , Big Problem?

Big Data , Big Problem?

Hadoop ecosystem framework n hadoop in live environment

Hadoop ecosystem framework n hadoop in live environment

Hadoop ecosystem framework n hadoop in live environment

Cloud Computing: Hadoop

Cloud Computing: Hadoop

Cloud Computing: Hadoop

Hadoop jon

Hadoop An Introduction

Hadoop An Introduction

Hadoop An Introduction

Hadoop basics

Hadoop: An Industry Perspective

Hadoop: An Industry Perspective

Hadoop: An Industry Perspective

How can Hadoop & SAP be integrated

How can Hadoop & SAP be integrated

How can Hadoop & SAP be integrated

Need for Time series Database

Need for Time series Database

Need for Time series Database

Overview of big data & hadoop version 1 - Tony Nguyen

Overview of big data & hadoop version 1 - Tony Nguyen

Overview of big data & hadoop version 1 - Tony Nguyen

Overview of Big data, Hadoop and Microsoft BI - version1

Overview of Big data, Hadoop and Microsoft BI - version1

Overview of Big data, Hadoop and Microsoft BI - version1

Plus de Yahoo Developer Network

Developing Mobile Apps for Performance - Swapnil Patel, Verizon Media

Developing Mobile Apps for Performance - Swapnil Patel, Verizon Media

Developing Mobile Apps for Performance - Swapnil Patel, Verizon Media

Yahoo Developer Network

Athenz - The Open-Source Solution to Provide Access Control in Dynamic Infras...

Athenz - The Open-Source Solution to Provide Access Control in Dynamic Infras...

Athenz - The Open-Source Solution to Provide Access Control in Dynamic Infras...

Yahoo Developer Network

Athenz & SPIFFE, Tatsuya Yano, Yahoo Japan

Athenz & SPIFFE, Tatsuya Yano, Yahoo Japan

Athenz & SPIFFE, Tatsuya Yano, Yahoo Japan

Yahoo Developer Network

Athenz with Istio - Single Access Control Model in Cloud Infrastructures, Tat...

Athenz with Istio - Single Access Control Model in Cloud Infrastructures, Tat...

Athenz with Istio - Single Access Control Model in Cloud Infrastructures, Tat...

Yahoo Developer Network

CICD at Oath using Screwdriver

CICD at Oath using Screwdriver

CICD at Oath using Screwdriver

Yahoo Developer Network

Offline and stream processing of big data sets can be done with tools such as Hadoop, Spark, and Storm, but what if you need to process big data at the time a user is making a request? Vespa (http://www.vespa.ai) allows you to search, organize and evaluate machine-learned models from e.g TensorFlow over large, evolving data sets with latencies in the tens of milliseconds. Vespa is behind the recommendation, ad targeting, and search at Yahoo where it handles billions of daily queries over billions of documents.

Big Data Serving with Vespa - Jon Bratseth, Distinguished Architect, Oath

Big Data Serving with Vespa - Jon Bratseth, Distinguished Architect, Oath

Big Data Serving with Vespa - Jon Bratseth, Distinguished Architect, Oath

Yahoo Developer Network

How @TwitterHadoop Chose Google Cloud, Joep Rottinghuis, Lohit VijayaRenu

How @TwitterHadoop Chose Google Cloud, Joep Rottinghuis, Lohit VijayaRenu

How @TwitterHadoop Chose Google Cloud, Joep Rottinghuis, Lohit VijayaRenu

Yahoo Developer Network

The Future of Hadoop in an AI World, Milind Bhandarkar, CEO, Ampool

The Future of Hadoop in an AI World, Milind Bhandarkar, CEO, Ampool

The Future of Hadoop in an AI World, Milind Bhandarkar, CEO, Ampool

Yahoo Developer Network

Apache YARN Federation and Tez at Microsoft, Anupam Upadhyay, Adrian Nicoara,...

Apache YARN Federation and Tez at Microsoft, Anupam Upadhyay, Adrian Nicoara,...

Apache YARN Federation and Tez at Microsoft, Anupam Upadhyay, Adrian Nicoara,...

Yahoo Developer Network

Containerized Services on Apache Hadoop YARN: Past, Present, and Future, Shan...

Containerized Services on Apache Hadoop YARN: Past, Present, and Future, Shan...

Containerized Services on Apache Hadoop YARN: Past, Present, and Future, Shan...

Yahoo Developer Network

HDFS Scalability and Security, Daryn Sharp, Senior Engineer, Oath

HDFS Scalability and Security, Daryn Sharp, Senior Engineer, Oath

HDFS Scalability and Security, Daryn Sharp, Senior Engineer, Oath

Yahoo Developer Network

Hadoop {Submarine} Project: Running deep learning workloads on YARN, Wangda T...

Hadoop {Submarine} Project: Running deep learning workloads on YARN, Wangda T...

Hadoop {Submarine} Project: Running deep learning workloads on YARN, Wangda T...

Yahoo Developer Network

Moving the Oath Grid to Docker, Eric Badger, Oath

Moving the Oath Grid to Docker, Eric Badger, Oath

Moving the Oath Grid to Docker, Eric Badger, Oath

Yahoo Developer Network

Architecting Petabyte Scale AI Applications

Architecting Petabyte Scale AI Applications

Architecting Petabyte Scale AI Applications

Yahoo Developer Network

Offline and stream processing of big data sets can be done with tools such as Hadoop, Spark, and Storm, but what if you need to process big data at the time a user is making a request? This presentation introduces Vespa (http://vespa.ai) – the open source big data serving engine. Vespa allows you to search, organize, and evaluate machine-learned models from e.g TensorFlow over large, evolving data sets with latencies in the tens of milliseconds. Vespa is behind the recommendation, ad targeting, and search at Yahoo where it handles billions of daily queries over billions of documents and was recently open sourced at http://vespa.ai.

Introduction to Vespa – The Open Source Big Data Serving Engine, Jon Bratseth...

Introduction to Vespa – The Open Source Big Data Serving Engine, Jon Bratseth...

Introduction to Vespa – The Open Source Big Data Serving Engine, Jon Bratseth...

Yahoo Developer Network

In recent times, YARN Capacity Scheduler has improved a lot in terms of some critical features and refactoring. Here is a quick look into some of the recent changes in scheduler: Global Scheduling Support General placement support Better preemption model to handle resource anomalies across and within queue. Absolute resources’ configuration support Priority support between Queues and Applications In this talk, we will deep dive into each of these new features to give a better picture of their usage and performance comparison. We will also provide some more brief overview about the ongoing efforts and how they can help to solve some of the core issues we face today. Speakers: Sunil Govind (Hortonworks), Jian He (Hortonworks)

Jun 2017 HUG: YARN Scheduling – A Step Beyond

Jun 2017 HUG: YARN Scheduling – A Step Beyond

Jun 2017 HUG: YARN Scheduling – A Step Beyond

Yahoo Developer Network

In recent years, Yahoo has brought the big data ecosystem and machine learning together to discover mathematical models for search ranking, online advertising, content recommendation, and mobile applications. We use distributed computing clusters with CPUs and GPUs to train these models from 100’s of petabytes of data. A collection of distributed algorithms have been developed to achieve 10-1000x the scale and speed of alternative solutions. Our algorithms construct regression/classification models and semantic vectors within hours, even for billions of training examples and parameters. We have made our distributed deep learning solutions, CaffeOnSpark and TensorFlowOnSpark, available as open source. In this talk, we highlight Yahoo use cases where big data and machine learning technologies are best exemplified. We explain algorithm/system challenges to scale ML algorithms for massive datasets. We provide a technical overview of CaffeOnSpark and TensorFlowOnSpark to jumpstart your journey of large-scale machine learning. Speakers: Andy Feng is a VP of Architecture at Yahoo, leading the architecture and design of big data and machine learning initiatives. He has architected large-scale systems for personalization, ad serving, NoSQL, and cloud infrastructure. Prior to Yahoo, he was a Chief Architect at Netscape/AOL, and Principal Scientist at Xerox. He received a Ph.D. degree in computer science from Osaka University, Japan.

Jun 2017 HUG: Large-Scale Machine Learning: Use Cases and Technologies

Jun 2017 HUG: Large-Scale Machine Learning: Use Cases and Technologies

Jun 2017 HUG: Large-Scale Machine Learning: Use Cases and Technologies

Yahoo Developer Network

Spark and SQL-on-Hadoop have made it easier than ever for enterprises to create or migrate apps to the big data stack. Thousands of apps are being generated every day in the form of ETL and modeling pipelines, business intelligence and data cubes, deep machine learning, graph analytics, and real-time data streaming. However, the task of reliably operationalizing these big data apps involves many painpoints. Developers may not have the experience in distributed systems to tune apps for efficiency and performance. Diagnosing failures or unpredictable performance of apps can be a laborious process that involves multiple people. Apps may get stuck or steal resources and cause mission-critical apps to miss SLAs. This talk with introduce the audience to these problems and their common causes. We will also demonstrate how to find and fix these problems quickly, as well as prevent such problems from happening in the first place. Speakers: Dr. Shivnath Babu is a Co-founder and CTO of Unravel and Associate Professor of Computer Science at Duke University. With more than a decade of experience researching the ease of use and manageability of data-intensive systems, he leads the Starfish project at Duke, which pioneered the automation of Hadoop application tuning, problem diagnosis, and resource management. Shivnath has more than 80 peer-reviewed publications to his credit and has received the U.S. National Science Foundation CAREER Award, the HP Labs Innovation Award, and three IBM Faculty Awards.

February 2017 HUG: Slow, Stuck, or Runaway Apps? Learn How to Quickly Fix Pro...

February 2017 HUG: Slow, Stuck, or Runaway Apps? Learn How to Quickly Fix Pro...

February 2017 HUG: Slow, Stuck, or Runaway Apps? Learn How to Quickly Fix Pro...

Yahoo Developer Network

Apache Apex (http://apex.apache.org/) is a stream processing platform that helps organizations to build processing pipelines with fault tolerance and strong processing guarantees. It was built to support low processing latency, high throughput, scalability, interoperability, high availability and security. The platform comes with Malhar library - an extensive collection of processing operators and a wide range of input and output connectors for out-of-the-box integration with an existing infrastructure. In the talk I am going to describe how connectors together with the distributed checkpointing (a mechanism used by the Apex to support fault tolerance and high availability) provide exactly-once end-to-end processing guarantees. Speakers: Vlad Rozov is Apache Apex PMC member and back-end engineer at DataTorrent where he focuses on the buffer server, Apex platform network layer, benchmarks and optimizing the core components for low latency and high throughput. Prior to DataTorrent Vlad worked on distributed BI platform at Huawei and on multi-dimensional database (OLAP) at Hyperion Solutions and Oracle.

February 2017 HUG: Exactly-once end-to-end processing with Apache Apex

February 2017 HUG: Exactly-once end-to-end processing with Apache Apex

February 2017 HUG: Exactly-once end-to-end processing with Apache Apex

Yahoo Developer Network

In the analysis of big data there are problematic queries that don’t scale because they require huge compute resources and time to generate exact results. Examples include count distinct, quantiles, most frequent items, joins, matrix computations, and graph analysis. If approximate results are acceptable, there is a class of sub-linear, stochastic streaming algorithms, called "sketches", that can produce results orders-of magnitude faster and with mathematically proven error bounds. For interactive queries there may not be other viable alternatives, and in the case of extracting results for these problem queries in real-time, sketches are the only known solution. For any analysis system that requires these problematic queries from big data, sketches are a required toolkit that should be tightly integrated into the system's analysis capabilities. This technology has helped Yahoo successfully reduce data processing times from days to hours, or minutes to seconds on a number of its internal platforms. This talk covers the current state of our Open Source DataSketches.github.io library, which includes adaptations and example code for Pig, Hive, Spark and Druid and gives architectural examples of use and a case study. Speakers: Jon Malkin is a scientist at Yahoo working to extend the DataSketches library. His previous roles have involved large scale data processing for sponsored search, display advertising, user counting, ad targeting, and cross-device user identity modeling. Alexander Saydakov is a senior software engineer at Yahoo working on the open source Data Sketches project. In his previous roles he has been involved in building large-scale back-end data processing systems and frameworks for data analytics and experimentation based on Torque, Hadoop, Pig, Hive and Druid. Alexander’s education background is in the field of applied mathematics.

February 2017 HUG: Data Sketches: A required toolkit for Big Data Analytics

February 2017 HUG: Data Sketches: A required toolkit for Big Data Analytics

February 2017 HUG: Data Sketches: A required toolkit for Big Data Analytics

Yahoo Developer Network

Plus de Yahoo Developer Network (20)

Developing Mobile Apps for Performance - Swapnil Patel, Verizon Media

Developing Mobile Apps for Performance - Swapnil Patel, Verizon Media

Developing Mobile Apps for Performance - Swapnil Patel, Verizon Media

Athenz - The Open-Source Solution to Provide Access Control in Dynamic Infras...

Athenz - The Open-Source Solution to Provide Access Control in Dynamic Infras...

Athenz - The Open-Source Solution to Provide Access Control in Dynamic Infras...

Athenz & SPIFFE, Tatsuya Yano, Yahoo Japan

Athenz & SPIFFE, Tatsuya Yano, Yahoo Japan

Athenz & SPIFFE, Tatsuya Yano, Yahoo Japan

Athenz with Istio - Single Access Control Model in Cloud Infrastructures, Tat...

Athenz with Istio - Single Access Control Model in Cloud Infrastructures, Tat...

Athenz with Istio - Single Access Control Model in Cloud Infrastructures, Tat...

CICD at Oath using Screwdriver

CICD at Oath using Screwdriver

CICD at Oath using Screwdriver

Big Data Serving with Vespa - Jon Bratseth, Distinguished Architect, Oath

Big Data Serving with Vespa - Jon Bratseth, Distinguished Architect, Oath

Big Data Serving with Vespa - Jon Bratseth, Distinguished Architect, Oath

How @TwitterHadoop Chose Google Cloud, Joep Rottinghuis, Lohit VijayaRenu

How @TwitterHadoop Chose Google Cloud, Joep Rottinghuis, Lohit VijayaRenu

How @TwitterHadoop Chose Google Cloud, Joep Rottinghuis, Lohit VijayaRenu

The Future of Hadoop in an AI World, Milind Bhandarkar, CEO, Ampool

The Future of Hadoop in an AI World, Milind Bhandarkar, CEO, Ampool

The Future of Hadoop in an AI World, Milind Bhandarkar, CEO, Ampool

Apache YARN Federation and Tez at Microsoft, Anupam Upadhyay, Adrian Nicoara,...

Apache YARN Federation and Tez at Microsoft, Anupam Upadhyay, Adrian Nicoara,...

Apache YARN Federation and Tez at Microsoft, Anupam Upadhyay, Adrian Nicoara,...

Containerized Services on Apache Hadoop YARN: Past, Present, and Future, Shan...

Containerized Services on Apache Hadoop YARN: Past, Present, and Future, Shan...

Containerized Services on Apache Hadoop YARN: Past, Present, and Future, Shan...

HDFS Scalability and Security, Daryn Sharp, Senior Engineer, Oath

HDFS Scalability and Security, Daryn Sharp, Senior Engineer, Oath

HDFS Scalability and Security, Daryn Sharp, Senior Engineer, Oath

Hadoop {Submarine} Project: Running deep learning workloads on YARN, Wangda T...

Hadoop {Submarine} Project: Running deep learning workloads on YARN, Wangda T...

Hadoop {Submarine} Project: Running deep learning workloads on YARN, Wangda T...

Moving the Oath Grid to Docker, Eric Badger, Oath

Moving the Oath Grid to Docker, Eric Badger, Oath

Moving the Oath Grid to Docker, Eric Badger, Oath

Architecting Petabyte Scale AI Applications

Architecting Petabyte Scale AI Applications

Architecting Petabyte Scale AI Applications

Introduction to Vespa – The Open Source Big Data Serving Engine, Jon Bratseth...

Introduction to Vespa – The Open Source Big Data Serving Engine, Jon Bratseth...

Introduction to Vespa – The Open Source Big Data Serving Engine, Jon Bratseth...

Jun 2017 HUG: YARN Scheduling – A Step Beyond

Jun 2017 HUG: YARN Scheduling – A Step Beyond

Jun 2017 HUG: YARN Scheduling – A Step Beyond

Jun 2017 HUG: Large-Scale Machine Learning: Use Cases and Technologies

Jun 2017 HUG: Large-Scale Machine Learning: Use Cases and Technologies

Jun 2017 HUG: Large-Scale Machine Learning: Use Cases and Technologies

February 2017 HUG: Slow, Stuck, or Runaway Apps? Learn How to Quickly Fix Pro...

February 2017 HUG: Slow, Stuck, or Runaway Apps? Learn How to Quickly Fix Pro...

February 2017 HUG: Slow, Stuck, or Runaway Apps? Learn How to Quickly Fix Pro...

February 2017 HUG: Exactly-once end-to-end processing with Apache Apex

February 2017 HUG: Exactly-once end-to-end processing with Apache Apex

February 2017 HUG: Exactly-once end-to-end processing with Apache Apex

February 2017 HUG: Data Sketches: A required toolkit for Big Data Analytics

February 2017 HUG: Data Sketches: A required toolkit for Big Data Analytics

February 2017 HUG: Data Sketches: A required toolkit for Big Data Analytics

Dernier

Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...

Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...

Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Exploring Multimodal Embeddings with Milvus

Exploring Multimodal Embeddings with Milvus

Exploring Multimodal Embeddings with Milvus

Effective data discovery is crucial for maintaining compliance and mitigating risks in today's rapidly evolving privacy landscape. However, traditional manual approaches often struggle to keep pace with the growing volume and complexity of data. Join us for an insightful webinar where industry leaders from TrustArc and Privya will share their expertise on leveraging AI-powered solutions to revolutionize data discovery. You'll learn how to: - Effortlessly maintain a comprehensive, up-to-date data inventory - Harness code scanning insights to gain complete visibility into data flows leveraging the advantages of code scanning over DB scanning - Simplify compliance by leveraging Privya's integration with TrustArc - Implement proven strategies to mitigate third-party risks Our panel of experts will discuss real-world case studies and share practical strategies for overcoming common data discovery challenges. They'll also explore the latest trends and innovations in AI-driven data management, and how these technologies can help organizations stay ahead of the curve in an ever-changing privacy landscape.

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

The Good, the Bad and the Governed - Why is governance a dirty word? David O'Neill, Chief Operating Officer - APIContext Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

Accelerating FinTech Innovation: Unleashing API Economy and GenAI Vasa Krishnan, Chief Technology Officer - FinResults Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

Elevate Developer Efficiency & build GenAI Application with Amazon Q

Elevate Developer Efficiency & build GenAI Application with Amazon Q

Elevate Developer Efficiency & build GenAI Application with Amazon Q

Bhuvaneswari Subramani

💥 You’re lucky! We’ve found two different (lead) developers that are willing to share their valuable lessons learned about using UiPath Document Understanding! Based on recent implementations in appealing use cases at Partou and SPIE. Don’t expect fancy videos or slide decks, but real and practical experiences that will help you with your own implementations. 📕 Topics that will be addressed: • Training the ML-model by humans: do or don't? • Rule-based versus AI extractors • Tips for finding use cases • How to start 👨‍🏫👨‍💻 Speakers: o Dion Morskieft, RPA Product Owner @Partou o Jack Klein-Schiphorst, Automation Developer @Tacstone Technology

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

UiPathCommunity

Understanding the FAA Part 107 License ..

Understanding the FAA Part 107 License ..

Understanding the FAA Part 107 License ..

Christopher Logan Kennedy

Tracing the root cause of a performance issue requires a lot of patience, experience, and focus. It’s so hard that we sometimes attempt to guess by trying out tentative fixes, but that usually results in frustration, messy code, and a considerable waste of time and money. This talk explains how to correctly zoom in on a performance bottleneck using three levels of profiling: distributed tracing, metrics, and method profiling. After we learn to read the JVM profiler output as a flame graph, we explore a series of bottlenecks typical for backend systems, like connection/thread pool starvation, invisible aspects, blocking code, hot CPU methods, lock contention, and Virtual Thread pinning, and we learn to trace them even if they occur in library code you are not familiar with. Attend this talk and prepare for the performance issues that will eventually hit any successful system. About authorWith two decades of experience, Victor is a Java Champion working as a trainer for top companies in Europe. Five thousands developers in 120 companies attended his workshops, so he gets to debate every week the challenges that various projects struggle with. In return, Victor summarizes key points from these workshops in conference talks and online meetups for the European Software Crafters, the world’s largest developer community around architecture, refactoring, and testing. Discover how Victor can help you on victorrentea.ro : company training catalog, consultancy and YouTube playlists.

Finding Java's Hidden Performance Traps @ DevoxxUK 2024

Finding Java's Hidden Performance Traps @ DevoxxUK 2024

Finding Java's Hidden Performance Traps @ DevoxxUK 2024

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Juan lago vázquez

Artificial Intelligence Chap.5 : Uncertainty

Artificial Intelligence Chap.5 : Uncertainty

Artificial Intelligence Chap.5 : Uncertainty

Khushali Kathiriya

Dubai, often portrayed as a shimmering oasis in the desert, faces its own set of challenges, including the occasional threat of flooding. Despite its reputation for opulence and modernity, the emirate is not immune to the forces of nature. In recent years, Dubai has experienced sporadic but significant floods, testing the resilience of its infrastructure and communities. Among the critical lifelines in this bustling metropolis is the Dubai International Airport, a bustling hub that connects the city to the world. This article explores the intersection of Dubai flood events and the resilience demonstrated by the Dubai International Airport in the face of such challenges.

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

How to Troubleshoot Apps for the Modern Connected Worker

How to Troubleshoot Apps for the Modern Connected Worker

How to Troubleshoot Apps for the Modern Connected Worker

[BuildWithAI] Introduction to Gemini.pdf

[BuildWithAI] Introduction to Gemini.pdf

[BuildWithAI] Introduction to Gemini.pdf

Retrieval augmented generation (RAG) is the most popular style of large language model application to emerge from 2023. The most basic style of RAG works by vectorizing your data and injecting it into a vector database like Milvus for retrieval to augment the text output generated by an LLM. This is just the beginning. One of the ways that we can extend RAG, and extend AI, is through multilingual use cases. Typical RAG is done in English using embedding models that are trained in English. In this talk, we’ll explore how RAG could work in languages other than English. We’ll explore French, Chinese, and Polish.

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Introduction to Multilingual Retrieval Augmented Generation (RAG)

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Product Anonymous

MINDCTI Revenue Release Quarter One 2024

MINDCTI Revenue Release Quarter One 2024

MINDCTI Revenue Release Quarter One 2024

Strategies for Landing an Oracle DBA Job as a Fresher

Strategies for Landing an Oracle DBA Job as a Fresher

Strategies for Landing an Oracle DBA Job as a Fresher

Remote DBA Services

Dernier (20)

Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...

Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...

Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Exploring Multimodal Embeddings with Milvus

Exploring Multimodal Embeddings with Milvus

Exploring Multimodal Embeddings with Milvus

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

Elevate Developer Efficiency & build GenAI Application with Amazon Q

Elevate Developer Efficiency & build GenAI Application with Amazon Q

Elevate Developer Efficiency & build GenAI Application with Amazon Q

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

Understanding the FAA Part 107 License ..

Understanding the FAA Part 107 License ..

Understanding the FAA Part 107 License ..

Finding Java's Hidden Performance Traps @ DevoxxUK 2024

Finding Java's Hidden Performance Traps @ DevoxxUK 2024

Finding Java's Hidden Performance Traps @ DevoxxUK 2024

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Artificial Intelligence Chap.5 : Uncertainty

Artificial Intelligence Chap.5 : Uncertainty

Artificial Intelligence Chap.5 : Uncertainty

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

How to Troubleshoot Apps for the Modern Connected Worker

How to Troubleshoot Apps for the Modern Connected Worker

How to Troubleshoot Apps for the Modern Connected Worker

[BuildWithAI] Introduction to Gemini.pdf

[BuildWithAI] Introduction to Gemini.pdf

[BuildWithAI] Introduction to Gemini.pdf

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Introduction to Multilingual Retrieval Augmented Generation (RAG)

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

MINDCTI Revenue Release Quarter One 2024

MINDCTI Revenue Release Quarter One 2024

MINDCTI Revenue Release Quarter One 2024

Strategies for Landing an Oracle DBA Job as a Fresher

Strategies for Landing an Oracle DBA Job as a Fresher

Strategies for Landing an Oracle DBA Job as a Fresher

Online Content Optimization with Hadoop__HadoopSummit2010

1.

2.

3.

4.

5.

6.

7.

8.

9.

10.

11.

12.

13.

Notes de l'éditeur

This is the Title slide. Please use the name of the presentation that was used in the abstract submission.
This is the agenda slide. There is only one of these in the deck.
This is the final slide; generally for questions at the end of the talk. Please post your contact information here.