SlideShare une entreprise Scribd logo

Storm realtime processingofbigdata

•Télécharger en tant que PPTX, PDF•
•
J
jonespi
1  sur  10
Storm: Realtime processing of Big Data Jon Espen Ingvaldsen
Common Big Data Architectures MapReduce job
Storm – Continuous Monitoring MapReduce job Storm topology
Architecture
Example code
Example code
Aktivt miljø
Sammendrag

Recommandé

Sarmad Ahsan Siddiqui Colloquium 7-13-15
Sarmad Ahsan Siddiqui Colloquium 7-13-15Sarmad Ahsan Siddiqui Colloquium 7-13-15
Sarmad Ahsan Siddiqui Colloquium 7-13-15Sarmad Siddiqui
 
Compressive Sampling Presentation
Compressive Sampling PresentationCompressive Sampling Presentation
Compressive Sampling PresentationManu Mitra
 
Kyle Ikuma MEMSat presentation
Kyle Ikuma MEMSat presentationKyle Ikuma MEMSat presentation
Kyle Ikuma MEMSat presentationKyleIkuma
 
Federated HPC Clouds Applied to Radiation Therapy
Federated HPC Clouds Applied to Radiation TherapyFederated HPC Clouds Applied to Radiation Therapy
Federated HPC Clouds Applied to Radiation TherapyAndrés Gómez
 
Classroom occupancy project
Classroom occupancy projectClassroom occupancy project
Classroom occupancy projectMengdi Yue
 
NASA's Movement Towards Cloud Computing
NASA's Movement Towards Cloud ComputingNASA's Movement Towards Cloud Computing
NASA's Movement Towards Cloud ComputingSoftware & Information Industry Association
 
Optimizing purdue lin microphysics scheme for intel xeon phi coprocessor
Optimizing purdue lin microphysics scheme for intel xeon phi coprocessorOptimizing purdue lin microphysics scheme for intel xeon phi coprocessor
Optimizing purdue lin microphysics scheme for intel xeon phi coprocessorieeepondy
 
Nasa HPC in the Cloud
Nasa HPC in the CloudNasa HPC in the Cloud
Nasa HPC in the CloudAdianto Wibisono
 

Recommandé

Sarmad Ahsan Siddiqui Colloquium 7-13-15
Sarmad Ahsan Siddiqui Colloquium 7-13-15Sarmad Ahsan Siddiqui Colloquium 7-13-15
Sarmad Ahsan Siddiqui Colloquium 7-13-15Sarmad Siddiqui
 
Compressive Sampling Presentation
Compressive Sampling PresentationCompressive Sampling Presentation
Compressive Sampling PresentationManu Mitra
 
Kyle Ikuma MEMSat presentation
Kyle Ikuma MEMSat presentationKyle Ikuma MEMSat presentation
Kyle Ikuma MEMSat presentationKyleIkuma
 
Federated HPC Clouds Applied to Radiation Therapy
Federated HPC Clouds Applied to Radiation TherapyFederated HPC Clouds Applied to Radiation Therapy
Federated HPC Clouds Applied to Radiation TherapyAndrés Gómez
 
Classroom occupancy project
Classroom occupancy projectClassroom occupancy project
Classroom occupancy projectMengdi Yue
 
NASA's Movement Towards Cloud Computing
NASA's Movement Towards Cloud ComputingNASA's Movement Towards Cloud Computing
NASA's Movement Towards Cloud ComputingSoftware & Information Industry Association
 
Optimizing purdue lin microphysics scheme for intel xeon phi coprocessor
Optimizing purdue lin microphysics scheme for intel xeon phi coprocessorOptimizing purdue lin microphysics scheme for intel xeon phi coprocessor
Optimizing purdue lin microphysics scheme for intel xeon phi coprocessorieeepondy
 
Nasa HPC in the Cloud
Nasa HPC in the CloudNasa HPC in the Cloud
Nasa HPC in the CloudAdianto Wibisono
 
Next Generation Data Platforms - Deon Thomas
Next Generation Data Platforms - Deon ThomasNext Generation Data Platforms - Deon Thomas
Next Generation Data Platforms - Deon ThomasThoughtworks
 
Node frameworks talk_hackerdojo
Node frameworks talk_hackerdojoNode frameworks talk_hackerdojo
Node frameworks talk_hackerdojoShubhra Kar
 
On Attention Mechanisms for AGI Architectures: A Design Proposal
On Attention Mechanisms for AGI Architectures: A Design ProposalOn Attention Mechanisms for AGI Architectures: A Design Proposal
On Attention Mechanisms for AGI Architectures: A Design ProposalHelgi Páll Helgason, PhD
 
Realtime Computation with Storm
Realtime Computation with StormRealtime Computation with Storm
Realtime Computation with Stormboorad
 
Utilizing Big Data to Optimize Customer Value Management Strategies
Utilizing Big Data to Optimize Customer Value Management StrategiesUtilizing Big Data to Optimize Customer Value Management Strategies
Utilizing Big Data to Optimize Customer Value Management StrategiescVidya Networks
 
Design patterns talk_node_summit
Design patterns talk_node_summitDesign patterns talk_node_summit
Design patterns talk_node_summitShubhra Kar
 
Realtime Detection of DDOS attacks using Apache Spark and MLLib
Realtime Detection of DDOS attacks using Apache Spark and MLLibRealtime Detection of DDOS attacks using Apache Spark and MLLib
Realtime Detection of DDOS attacks using Apache Spark and MLLibRyan Bosshart
 
Hadoop and Storm - AJUG talk
Hadoop and Storm - AJUG talkHadoop and Storm - AJUG talk
Hadoop and Storm - AJUG talkboorad
 
In‐Vehicle Networking: a Survey and Look Forward
In‐Vehicle Networking: a Survey and Look ForwardIn‐Vehicle Networking: a Survey and Look Forward
In‐Vehicle Networking: a Survey and Look ForwardRealTime-at-Work (RTaW)
 
Big Data for Smart City
Big Data for Smart CityBig Data for Smart City
Big Data for Smart CityKoltiva
 
Getting Started with the Node.js LoopBack APi Framework
Getting Started with the Node.js LoopBack APi FrameworkGetting Started with the Node.js LoopBack APi Framework
Getting Started with the Node.js LoopBack APi FrameworkJimmy Guerrero
 
Node Interactive : 7 years, 7 design patterns, will node continue to outshine
Node Interactive : 7 years, 7 design patterns, will node continue to outshineNode Interactive : 7 years, 7 design patterns, will node continue to outshine
Node Interactive : 7 years, 7 design patterns, will node continue to outshineShubhra Kar
 
Node.js Frameworks & Design Patterns Webinar
Node.js Frameworks & Design Patterns WebinarNode.js Frameworks & Design Patterns Webinar
Node.js Frameworks & Design Patterns WebinarShubhra Kar
 
Webcast: API-Centric Architecture for Building Context-Aware Apps
Webcast: API-Centric Architecture for Building Context-Aware AppsWebcast: API-Centric Architecture for Building Context-Aware Apps
Webcast: API-Centric Architecture for Building Context-Aware AppsApigee | Google Cloud
 
Blockchain for Business on Hyperledger
Blockchain for Business on HyperledgerBlockchain for Business on Hyperledger
Blockchain for Business on HyperledgerAll Things Open
 
BlockChain, Bitcoin and Smart Contracts - Oleg Kudrenko
BlockChain, Bitcoin and Smart Contracts - Oleg KudrenkoBlockChain, Bitcoin and Smart Contracts - Oleg Kudrenko
BlockChain, Bitcoin and Smart Contracts - Oleg KudrenkoOleg Kudrenko
 
Blockchain Consensus Protocols
Blockchain Consensus ProtocolsBlockchain Consensus Protocols
Blockchain Consensus ProtocolsMelanie Swan
 
Building Realtime Data Pipelines with Kafka Connect and Spark Streaming
Building Realtime Data Pipelines with Kafka Connect and Spark StreamingBuilding Realtime Data Pipelines with Kafka Connect and Spark Streaming
Building Realtime Data Pipelines with Kafka Connect and Spark StreamingJen Aman
 
Kimberley Peter and Michael Schaus: Understanding Bitcoin Currency and Blockc...
Kimberley Peter and Michael Schaus: Understanding Bitcoin Currency and Blockc...Kimberley Peter and Michael Schaus: Understanding Bitcoin Currency and Blockc...
Kimberley Peter and Michael Schaus: Understanding Bitcoin Currency and Blockc...RSD Relating Systems Thinking and Design
 
Blockchain in 2016 - Advanced Distributed Ledger Technologies
Blockchain in 2016 - Advanced Distributed Ledger TechnologiesBlockchain in 2016 - Advanced Distributed Ledger Technologies
Blockchain in 2016 - Advanced Distributed Ledger TechnologiesHoward Smith
 

Contenu connexe

En vedette

Next Generation Data Platforms - Deon Thomas
Next Generation Data Platforms - Deon ThomasNext Generation Data Platforms - Deon Thomas
Next Generation Data Platforms - Deon ThomasThoughtworks
 
Node frameworks talk_hackerdojo
Node frameworks talk_hackerdojoNode frameworks talk_hackerdojo
Node frameworks talk_hackerdojoShubhra Kar
 
On Attention Mechanisms for AGI Architectures: A Design Proposal
On Attention Mechanisms for AGI Architectures: A Design ProposalOn Attention Mechanisms for AGI Architectures: A Design Proposal
On Attention Mechanisms for AGI Architectures: A Design ProposalHelgi Páll Helgason, PhD
 
Realtime Computation with Storm
Realtime Computation with StormRealtime Computation with Storm
Realtime Computation with Stormboorad
 
Utilizing Big Data to Optimize Customer Value Management Strategies
Utilizing Big Data to Optimize Customer Value Management StrategiesUtilizing Big Data to Optimize Customer Value Management Strategies
Utilizing Big Data to Optimize Customer Value Management StrategiescVidya Networks
 
Design patterns talk_node_summit
Design patterns talk_node_summitDesign patterns talk_node_summit
Design patterns talk_node_summitShubhra Kar
 
Realtime Detection of DDOS attacks using Apache Spark and MLLib
Realtime Detection of DDOS attacks using Apache Spark and MLLibRealtime Detection of DDOS attacks using Apache Spark and MLLib
Realtime Detection of DDOS attacks using Apache Spark and MLLibRyan Bosshart
 
Hadoop and Storm - AJUG talk
Hadoop and Storm - AJUG talkHadoop and Storm - AJUG talk
Hadoop and Storm - AJUG talkboorad
 
In‐Vehicle Networking: a Survey and Look Forward
In‐Vehicle Networking: a Survey and Look ForwardIn‐Vehicle Networking: a Survey and Look Forward
In‐Vehicle Networking: a Survey and Look ForwardRealTime-at-Work (RTaW)
 
Big Data for Smart City
Big Data for Smart CityBig Data for Smart City
Big Data for Smart CityKoltiva
 
Getting Started with the Node.js LoopBack APi Framework
Getting Started with the Node.js LoopBack APi FrameworkGetting Started with the Node.js LoopBack APi Framework
Getting Started with the Node.js LoopBack APi FrameworkJimmy Guerrero
 
Node Interactive : 7 years, 7 design patterns, will node continue to outshine
Node Interactive : 7 years, 7 design patterns, will node continue to outshineNode Interactive : 7 years, 7 design patterns, will node continue to outshine
Node Interactive : 7 years, 7 design patterns, will node continue to outshineShubhra Kar
 
Node.js Frameworks & Design Patterns Webinar
Node.js Frameworks & Design Patterns WebinarNode.js Frameworks & Design Patterns Webinar
Node.js Frameworks & Design Patterns WebinarShubhra Kar
 
Webcast: API-Centric Architecture for Building Context-Aware Apps
Webcast: API-Centric Architecture for Building Context-Aware AppsWebcast: API-Centric Architecture for Building Context-Aware Apps
Webcast: API-Centric Architecture for Building Context-Aware AppsApigee | Google Cloud
 
Blockchain for Business on Hyperledger
Blockchain for Business on HyperledgerBlockchain for Business on Hyperledger
Blockchain for Business on HyperledgerAll Things Open
 
BlockChain, Bitcoin and Smart Contracts - Oleg Kudrenko
BlockChain, Bitcoin and Smart Contracts - Oleg KudrenkoBlockChain, Bitcoin and Smart Contracts - Oleg Kudrenko
BlockChain, Bitcoin and Smart Contracts - Oleg KudrenkoOleg Kudrenko
 
Blockchain Consensus Protocols
Blockchain Consensus ProtocolsBlockchain Consensus Protocols
Blockchain Consensus ProtocolsMelanie Swan
 
Building Realtime Data Pipelines with Kafka Connect and Spark Streaming
Building Realtime Data Pipelines with Kafka Connect and Spark StreamingBuilding Realtime Data Pipelines with Kafka Connect and Spark Streaming
Building Realtime Data Pipelines with Kafka Connect and Spark StreamingJen Aman
 
Kimberley Peter and Michael Schaus: Understanding Bitcoin Currency and Blockc...
Kimberley Peter and Michael Schaus: Understanding Bitcoin Currency and Blockc...Kimberley Peter and Michael Schaus: Understanding Bitcoin Currency and Blockc...
Kimberley Peter and Michael Schaus: Understanding Bitcoin Currency and Blockc...RSD Relating Systems Thinking and Design
 
Blockchain in 2016 - Advanced Distributed Ledger Technologies
Blockchain in 2016 - Advanced Distributed Ledger TechnologiesBlockchain in 2016 - Advanced Distributed Ledger Technologies
Blockchain in 2016 - Advanced Distributed Ledger TechnologiesHoward Smith
 

En vedette (20)

Next Generation Data Platforms - Deon Thomas
Next Generation Data Platforms - Deon ThomasNext Generation Data Platforms - Deon Thomas
Next Generation Data Platforms - Deon Thomas
 
Node frameworks talk_hackerdojo
Node frameworks talk_hackerdojoNode frameworks talk_hackerdojo
Node frameworks talk_hackerdojo
 
On Attention Mechanisms for AGI Architectures: A Design Proposal
On Attention Mechanisms for AGI Architectures: A Design ProposalOn Attention Mechanisms for AGI Architectures: A Design Proposal
On Attention Mechanisms for AGI Architectures: A Design Proposal
 
Realtime Computation with Storm
Realtime Computation with StormRealtime Computation with Storm
Realtime Computation with Storm
 
Utilizing Big Data to Optimize Customer Value Management Strategies
Utilizing Big Data to Optimize Customer Value Management StrategiesUtilizing Big Data to Optimize Customer Value Management Strategies
Utilizing Big Data to Optimize Customer Value Management Strategies
 
Design patterns talk_node_summit
Design patterns talk_node_summitDesign patterns talk_node_summit
Design patterns talk_node_summit
 
Realtime Detection of DDOS attacks using Apache Spark and MLLib
Realtime Detection of DDOS attacks using Apache Spark and MLLibRealtime Detection of DDOS attacks using Apache Spark and MLLib
Realtime Detection of DDOS attacks using Apache Spark and MLLib
 
Hadoop and Storm - AJUG talk
Hadoop and Storm - AJUG talkHadoop and Storm - AJUG talk
Hadoop and Storm - AJUG talk
 
In‐Vehicle Networking: a Survey and Look Forward
In‐Vehicle Networking: a Survey and Look ForwardIn‐Vehicle Networking: a Survey and Look Forward
In‐Vehicle Networking: a Survey and Look Forward
 
Big Data for Smart City
Big Data for Smart CityBig Data for Smart City
Big Data for Smart City
 
Getting Started with the Node.js LoopBack APi Framework
Getting Started with the Node.js LoopBack APi FrameworkGetting Started with the Node.js LoopBack APi Framework
Getting Started with the Node.js LoopBack APi Framework
 
Node Interactive : 7 years, 7 design patterns, will node continue to outshine
Node Interactive : 7 years, 7 design patterns, will node continue to outshineNode Interactive : 7 years, 7 design patterns, will node continue to outshine
Node Interactive : 7 years, 7 design patterns, will node continue to outshine
 
Node.js Frameworks & Design Patterns Webinar
Node.js Frameworks & Design Patterns WebinarNode.js Frameworks & Design Patterns Webinar
Node.js Frameworks & Design Patterns Webinar
 
Webcast: API-Centric Architecture for Building Context-Aware Apps
Webcast: API-Centric Architecture for Building Context-Aware AppsWebcast: API-Centric Architecture for Building Context-Aware Apps
Webcast: API-Centric Architecture for Building Context-Aware Apps
 
Blockchain for Business on Hyperledger
Blockchain for Business on HyperledgerBlockchain for Business on Hyperledger
Blockchain for Business on Hyperledger
 
BlockChain, Bitcoin and Smart Contracts - Oleg Kudrenko
BlockChain, Bitcoin and Smart Contracts - Oleg KudrenkoBlockChain, Bitcoin and Smart Contracts - Oleg Kudrenko
BlockChain, Bitcoin and Smart Contracts - Oleg Kudrenko
 
Blockchain Consensus Protocols
Blockchain Consensus ProtocolsBlockchain Consensus Protocols
Blockchain Consensus Protocols
 
Building Realtime Data Pipelines with Kafka Connect and Spark Streaming
Building Realtime Data Pipelines with Kafka Connect and Spark StreamingBuilding Realtime Data Pipelines with Kafka Connect and Spark Streaming
Building Realtime Data Pipelines with Kafka Connect and Spark Streaming
 
Kimberley Peter and Michael Schaus: Understanding Bitcoin Currency and Blockc...
Kimberley Peter and Michael Schaus: Understanding Bitcoin Currency and Blockc...Kimberley Peter and Michael Schaus: Understanding Bitcoin Currency and Blockc...
Kimberley Peter and Michael Schaus: Understanding Bitcoin Currency and Blockc...
 
Blockchain in 2016 - Advanced Distributed Ledger Technologies
Blockchain in 2016 - Advanced Distributed Ledger TechnologiesBlockchain in 2016 - Advanced Distributed Ledger Technologies
Blockchain in 2016 - Advanced Distributed Ledger Technologies
 

Storm realtime processingofbigdata