Outline for workshop on "Big Data, Real-time Processing and Storm" proposed for The Fifth Elephant, 2013 [http://fifthelephant.in/2013/workshops], Bangalore, India
Final presentation has been uploaded post the workshop to: http://j.mp/5thEleStorm_SS
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Outline of Big Data, Real-time Processing and Storm
1. Outline for workshop proposed for The Fifth Elephant, 2013, Bangalore
Big Data, Real-time
Processing and Storm
Prashanth Babu
http://About.Me/Prashanth
Please let me know your feedback and / or comments on this Outline for the Workshop.
2. Outline of the session
Big Data
Batch processing
Real-time processing
Real-time vs. Batch processing
Tools / frameworks
Complex Event Processing
Event Stream Processing
CEP vs. ESP
Storm overview
Use cases of Storm
Comparison with other open source Big Data solutions
Storm vs. Hadoop
3. Outline of the session
Storm Dependencies
Storm Architecture
Storm Components
o Nimbus
o Supervisor
o ZooKeeper
Storm Concepts
o Tuples
o Streams
o Spouts
o Bolts
o Topologies
4. Outline of the session
Storm UI
Modes of operation
o Local Mode
o Production Mode
Storm through an example
Word Count demo
Trident
How the combination of Storm and Hadoop can help analyze
data
Other features & Community Support
Real-time analysis of tweets with Storm
References
QnA
5. Storm Overview
Developed at BackType by Nathan Marz and team
Open sourced by Twitter [after acquiring Backtype] in
August, 2011
Stream Processing
Distributed RPC
Continuous computation
Guaranteed data Processing
Fault tolerance
Horizontal scalability
CEP
Further discussion in the session.
Notes de l'éditeur
Outline for workshop proposed for The Fifth Elephant, 2013, BangalorePlease let me know what else you want me to showcase or touch base during this presentation. My details are in my About.Me profile page.Image source: http://www.theweatherimagerepo.com/var/albums/Thunder/Lightning_Storm_by_Nightwalker50.jpg
Outline for workshop proposed for The Fifth Elephant, 2013, Bangalore
Outline for workshop proposed for The Fifth Elephant, 2013, Bangalore
Outline for workshop proposed for The Fifth Elephant, 2013, Bangalore
Outline for workshop proposed for The Fifth Elephant, 2013, BangaloreImage source: http://libertystorm.com