SlideShare une entreprise Scribd logo
1  sur  27
Welcome to the Webinar

Deploy Big Data Solutions Rapidly in
Cloud through Harbinger’s ABC Model
by Harbinger Systems
Panellists

Dr. Prashant Khambekar

Umesh Kanade

Vice President
Delivery

General Manager
Technology Solutions

Dr. Asheesh Choksi
Solutions Architect

2
Agenda
• Big Data Problem Space

• Harbinger ABC Model
• Case Studies
• Q&A

3
Big Data Paradigm

4
Manageable Data
Variety

Velocity

RDBMS system for data storage
Implementation of Business
logic by Application server
Business features are rendered
by Request/Response model

Volume

5
Big Data
Variety

Velocity

Volume
6
ABC Model

7
Harbinger’s ABC Learning Model

Big Data
A-B-C
Learning

Agile

Cloud
8
ABC Iteration Model

9
Case 1
Volume Space

10
Case 1 - Volume Space : Business Challenges
• Data maintained by Legacy system is not queriable
• Searching for information is becoming pain area as the data size
is growing
• Business wants to connect operational, clinical and financial
properties of each record

• App should support interoperability from multiple platforms
(mobile devices, desktop OS …)
11
Case 1 – ABC in Volume Space
Data Volume
ETL
Hadoop DFS

Search

Multiple Business
needs evolving over
time

AWS EMR

12
Case 1 - Volume Space

ETL
Flat Files, Feeds

Name Node

Secondary
Name Node

Data Nodes
Hadoop API

Map
Reduce

Results

13
Case 1 – Volume Space
Scaling

Hadoop distributed File System

• Map Reduce Jobs for each type of query

Search

Solr based indexing

• De-identification of sensitive information (HIPAA compliance)
• Relevance search

ETL

Data migration from Legacy system

• Custom ETL, Cleaning and Validation of records

14
Case 2
Velocity Space

15
Case 2 - Velocity Space: Business Challenges

Users Bet or Bid on Certain Resources

Sport Events
Live Show on TV…

Application Should Synchronize
Thousands of Users in Real-Time

Application Usage Spikes with Popular Events

16
ABC in Velocity Space
Transaction Velocity
Mongo DB
Redis

Evolving Business
Requirements

Tech POCs

AWS EC2
Real time resource
scale up/down
17
Case 2 - Velocity Space
Notifications Node JS, Socket IO
• Dynamic Synchronization
• Cross browser (HTML 5-based)

Extensibility

Grails, MVC, REST

• Efficient Development
• Support for Mobile

18
Case 3
Variety Space

19
Case 3 - Variety Space: Business Challenges

Relationships:
Structured and un-structured attributes
Recommendations:
Connections and preferences and Discovery

Data Variety: Traditional design approach could be extremely complex

20
Case 3 – Variety Space
Data Variety

Orient DB, PostgreSQL
Graph Structures and
Recommendation Engine

Weekly Builds
Synchronization with
Business

AWS EC2
Scalability, Multi-tenancy
Auto-Scaling, Separate
Schema for accounts
21
Case 3 – Variety Space
Multi-tenancy Cloud + PostgreSQL
• Supports Schemas for Multi-tenancy

Productivity

RoR, Phusion Passenger Server

• Developer Productivity
• Resources exposed with REST APIs

Responsive

D3, SVG, VivaGraph

• Renders scalable vector images in modern browsers

22
Summary

23
Solution Space
Variety
Key Value Store
(NoSQL)
Document based or
Graph database

Velocity
In memory Database
Push (WebSocket)

Volume
Map Reduce
(Hadoop)
24
A-B-C Model Review
Structured,
Unstructured Data
Volume, Velocity,
Variety Analytics

Frequent Builds
Validations/POCs
Re-alignment with business

App Complexity
Resource Scale-up/down
Platform Services
(Security, Backup, Metering)
25
Q&A

26
Thank You!
Visit us at: www.harbinger-systems.com
Write to us at: hsplinfo@harbingergroup.com

Blog: blog.harbinger-systems.com
Twitter: twitter.com/HarbingerSys (@HarbingerSys)
Slideshare: slideshare.net/hsplmkting
Facebook: facebook.com/harbingersys
LinkedIn: linkedin.com/company/382306
27

Contenu connexe

En vedette

Engage for Success: Improve Workforce Engagement with Open Communication and ...
Engage for Success: Improve Workforce Engagement with Open Communication and ...Engage for Success: Improve Workforce Engagement with Open Communication and ...
Engage for Success: Improve Workforce Engagement with Open Communication and ...
Harbinger Systems - HRTech Builder of Choice
 
Elements
ElementsElements
Elements
kaa kaa
 
Webinar: How to choose your outsourcing partner for building mobile apps?
Webinar: How to choose your outsourcing partner for building mobile apps?Webinar: How to choose your outsourcing partner for building mobile apps?
Webinar: How to choose your outsourcing partner for building mobile apps?
Harbinger Systems - HRTech Builder of Choice
 
Webinar: Mobile UX: Doing It The Right Way
Webinar: Mobile UX: Doing It The Right WayWebinar: Mobile UX: Doing It The Right Way
Webinar: Mobile UX: Doing It The Right Way
Harbinger Systems - HRTech Builder of Choice
 

En vedette (12)

Create scalable and configurable multi tenancy application
Create scalable and configurable multi tenancy applicationCreate scalable and configurable multi tenancy application
Create scalable and configurable multi tenancy application
 
Webinar: UI/UX best practices in cms based web design
Webinar: UI/UX best practices in cms based web designWebinar: UI/UX best practices in cms based web design
Webinar: UI/UX best practices in cms based web design
 
Engage for Success: Improve Workforce Engagement with Open Communication and ...
Engage for Success: Improve Workforce Engagement with Open Communication and ...Engage for Success: Improve Workforce Engagement with Open Communication and ...
Engage for Success: Improve Workforce Engagement with Open Communication and ...
 
Harbinger Tech Session in cloud Expo 2015- Harnessing the power of linked ope...
Harbinger Tech Session in cloud Expo 2015- Harnessing the power of linked ope...Harbinger Tech Session in cloud Expo 2015- Harnessing the power of linked ope...
Harbinger Tech Session in cloud Expo 2015- Harnessing the power of linked ope...
 
Elements
ElementsElements
Elements
 
Hardware Lab. Andrew Kokhanovskyi. Kaa introduction
Hardware Lab. Andrew Kokhanovskyi. Kaa introductionHardware Lab. Andrew Kokhanovskyi. Kaa introduction
Hardware Lab. Andrew Kokhanovskyi. Kaa introduction
 
Enhancing Unified Communication Experience through Microsoft Lync SDK and UCMA
Enhancing Unified Communication Experience through Microsoft Lync SDK and UCMAEnhancing Unified Communication Experience through Microsoft Lync SDK and UCMA
Enhancing Unified Communication Experience through Microsoft Lync SDK and UCMA
 
Webinar: Structured attestation to meaningful use stage 2
Webinar: Structured attestation to meaningful use stage 2Webinar: Structured attestation to meaningful use stage 2
Webinar: Structured attestation to meaningful use stage 2
 
Webinar: Building amazing web apps rapidly with emerging tech
Webinar: Building amazing web apps rapidly with emerging techWebinar: Building amazing web apps rapidly with emerging tech
Webinar: Building amazing web apps rapidly with emerging tech
 
Webinar: How to choose your outsourcing partner for building mobile apps?
Webinar: How to choose your outsourcing partner for building mobile apps?Webinar: How to choose your outsourcing partner for building mobile apps?
Webinar: How to choose your outsourcing partner for building mobile apps?
 
iOS 8 HealthKit: Driving Smart Health Solutions
iOS 8 HealthKit: Driving Smart Health SolutionsiOS 8 HealthKit: Driving Smart Health Solutions
iOS 8 HealthKit: Driving Smart Health Solutions
 
Webinar: Mobile UX: Doing It The Right Way
Webinar: Mobile UX: Doing It The Right WayWebinar: Mobile UX: Doing It The Right Way
Webinar: Mobile UX: Doing It The Right Way
 

Plus de Harbinger Systems - HRTech Builder of Choice

Plus de Harbinger Systems - HRTech Builder of Choice (20)

Using People Analytics for a Sustainable Remote Workforce
Using People Analytics for a Sustainable Remote WorkforceUsing People Analytics for a Sustainable Remote Workforce
Using People Analytics for a Sustainable Remote Workforce
 
5 Trends That Will Drive the Transformation of EdTech in 2021
5 Trends That Will Drive the Transformation of EdTech in 20215 Trends That Will Drive the Transformation of EdTech in 2021
5 Trends That Will Drive the Transformation of EdTech in 2021
 
Rapidly Transforming Organizational Content into Learning Experiences
Rapidly Transforming Organizational Content into Learning ExperiencesRapidly Transforming Organizational Content into Learning Experiences
Rapidly Transforming Organizational Content into Learning Experiences
 
Scalable HR Integrations for Better Data Analytics: Challenges & Solutions
Scalable HR Integrations for Better Data Analytics: Challenges & SolutionsScalable HR Integrations for Better Data Analytics: Challenges & Solutions
Scalable HR Integrations for Better Data Analytics: Challenges & Solutions
 
5 Key Items HR Should Consider Before Buying HR Technologies
5 Key Items HR Should Consider Before Buying HR Technologies5 Key Items HR Should Consider Before Buying HR Technologies
5 Key Items HR Should Consider Before Buying HR Technologies
 
Best Practices to Build Marketplace-Ready Integrations
Best Practices to Build Marketplace-Ready IntegrationsBest Practices to Build Marketplace-Ready Integrations
Best Practices to Build Marketplace-Ready Integrations
 
HRTech Integration Masterclass Session 4 How to Expand Your Recruitment Datab...
HRTech Integration Masterclass Session 4 How to Expand Your Recruitment Datab...HRTech Integration Masterclass Session 4 How to Expand Your Recruitment Datab...
HRTech Integration Masterclass Session 4 How to Expand Your Recruitment Datab...
 
Recalibrating Product Strategy - Addressing Demand Shifts in Existing Markets
Recalibrating Product Strategy - Addressing Demand Shifts in Existing MarketsRecalibrating Product Strategy - Addressing Demand Shifts in Existing Markets
Recalibrating Product Strategy - Addressing Demand Shifts in Existing Markets
 
How to Gain Key Insights from Data Distributed Across Multiple HR Systems
How to Gain Key Insights from Data Distributed Across Multiple HR SystemsHow to Gain Key Insights from Data Distributed Across Multiple HR Systems
How to Gain Key Insights from Data Distributed Across Multiple HR Systems
 
HRTech Integration Master Class Session 1 -Delivering Seamless Learning Exper...
HRTech Integration Master Class Session 1 -Delivering Seamless Learning Exper...HRTech Integration Master Class Session 1 -Delivering Seamless Learning Exper...
HRTech Integration Master Class Session 1 -Delivering Seamless Learning Exper...
 
Recalibrating Product Strategy - Addressing Demand Shifts in Existing Markets
Recalibrating Product Strategy - Addressing Demand Shifts in Existing MarketsRecalibrating Product Strategy - Addressing Demand Shifts in Existing Markets
Recalibrating Product Strategy - Addressing Demand Shifts in Existing Markets
 
Integrating System of Records and Collaboration Tools
Integrating System of Records and Collaboration ToolsIntegrating System of Records and Collaboration Tools
Integrating System of Records and Collaboration Tools
 
How to Power Your HR Apps With AI And Make It Explainable
How to Power Your HR Apps With AI And Make It ExplainableHow to Power Your HR Apps With AI And Make It Explainable
How to Power Your HR Apps With AI And Make It Explainable
 
Chatbot for Continuous Performance Management
Chatbot for Continuous Performance Management Chatbot for Continuous Performance Management
Chatbot for Continuous Performance Management
 
Leveraging mobile capabilities in your HR application
Leveraging mobile capabilities in your HR applicationLeveraging mobile capabilities in your HR application
Leveraging mobile capabilities in your HR application
 
Automate HR applications using AI and ML
Automate HR applications using AI and MLAutomate HR applications using AI and ML
Automate HR applications using AI and ML
 
A Cloud-based Collaborative Learning and Coaching Platform
A Cloud-based Collaborative Learning and Coaching PlatformA Cloud-based Collaborative Learning and Coaching Platform
A Cloud-based Collaborative Learning and Coaching Platform
 
Extending LRSs and the xAPI for Event-driven Blended and Adaptive Learning
Extending LRSs and the xAPI for Event-driven Blended and Adaptive LearningExtending LRSs and the xAPI for Event-driven Blended and Adaptive Learning
Extending LRSs and the xAPI for Event-driven Blended and Adaptive Learning
 
Impact of SMAC Technology in HCM
Impact of SMAC Technology in HCMImpact of SMAC Technology in HCM
Impact of SMAC Technology in HCM
 
A medical prescription reminder app for i phone
A medical prescription reminder app for i phoneA medical prescription reminder app for i phone
A medical prescription reminder app for i phone
 

Dernier

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Dernier (20)

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 

Deploy Big Data solutions Rapidly in Cloud through Harbinger’s ABC model

  • 1. Welcome to the Webinar Deploy Big Data Solutions Rapidly in Cloud through Harbinger’s ABC Model by Harbinger Systems
  • 2. Panellists Dr. Prashant Khambekar Umesh Kanade Vice President Delivery General Manager Technology Solutions Dr. Asheesh Choksi Solutions Architect 2
  • 3. Agenda • Big Data Problem Space • Harbinger ABC Model • Case Studies • Q&A 3
  • 5. Manageable Data Variety Velocity RDBMS system for data storage Implementation of Business logic by Application server Business features are rendered by Request/Response model Volume 5
  • 8. Harbinger’s ABC Learning Model Big Data A-B-C Learning Agile Cloud 8
  • 11. Case 1 - Volume Space : Business Challenges • Data maintained by Legacy system is not queriable • Searching for information is becoming pain area as the data size is growing • Business wants to connect operational, clinical and financial properties of each record • App should support interoperability from multiple platforms (mobile devices, desktop OS …) 11
  • 12. Case 1 – ABC in Volume Space Data Volume ETL Hadoop DFS Search Multiple Business needs evolving over time AWS EMR 12
  • 13. Case 1 - Volume Space ETL Flat Files, Feeds Name Node Secondary Name Node Data Nodes Hadoop API Map Reduce Results 13
  • 14. Case 1 – Volume Space Scaling Hadoop distributed File System • Map Reduce Jobs for each type of query Search Solr based indexing • De-identification of sensitive information (HIPAA compliance) • Relevance search ETL Data migration from Legacy system • Custom ETL, Cleaning and Validation of records 14
  • 16. Case 2 - Velocity Space: Business Challenges Users Bet or Bid on Certain Resources Sport Events Live Show on TV… Application Should Synchronize Thousands of Users in Real-Time Application Usage Spikes with Popular Events 16
  • 17. ABC in Velocity Space Transaction Velocity Mongo DB Redis Evolving Business Requirements Tech POCs AWS EC2 Real time resource scale up/down 17
  • 18. Case 2 - Velocity Space Notifications Node JS, Socket IO • Dynamic Synchronization • Cross browser (HTML 5-based) Extensibility Grails, MVC, REST • Efficient Development • Support for Mobile 18
  • 20. Case 3 - Variety Space: Business Challenges Relationships: Structured and un-structured attributes Recommendations: Connections and preferences and Discovery Data Variety: Traditional design approach could be extremely complex 20
  • 21. Case 3 – Variety Space Data Variety Orient DB, PostgreSQL Graph Structures and Recommendation Engine Weekly Builds Synchronization with Business AWS EC2 Scalability, Multi-tenancy Auto-Scaling, Separate Schema for accounts 21
  • 22. Case 3 – Variety Space Multi-tenancy Cloud + PostgreSQL • Supports Schemas for Multi-tenancy Productivity RoR, Phusion Passenger Server • Developer Productivity • Resources exposed with REST APIs Responsive D3, SVG, VivaGraph • Renders scalable vector images in modern browsers 22
  • 24. Solution Space Variety Key Value Store (NoSQL) Document based or Graph database Velocity In memory Database Push (WebSocket) Volume Map Reduce (Hadoop) 24
  • 25. A-B-C Model Review Structured, Unstructured Data Volume, Velocity, Variety Analytics Frequent Builds Validations/POCs Re-alignment with business App Complexity Resource Scale-up/down Platform Services (Security, Backup, Metering) 25
  • 27. Thank You! Visit us at: www.harbinger-systems.com Write to us at: hsplinfo@harbingergroup.com Blog: blog.harbinger-systems.com Twitter: twitter.com/HarbingerSys (@HarbingerSys) Slideshare: slideshare.net/hsplmkting Facebook: facebook.com/harbingersys LinkedIn: linkedin.com/company/382306 27