SlideShare une entreprise Scribd logo
1  sur  21
Télécharger pour lire hors ligne
SnapLogic
Leader in Enterprise iPaaS
by
Surendar S
https://www.linkedin.com/in/ssurendar/
Synopsis:
 Rise of cloud and importance of cloud
 Traditional ETL
 ETL frameworks & Popular ETL tools
 SnapLogic Origin and DI Solutions
 As per Gartner report leader in DI
 Importance of SnapLogic (Why SnapLogic)
 Introduction of SnapLogic
 Components of SnapLogic
 Elastic Integration Platform Architecture
 Web Standards
 Resources reference
2
Popular ETL Tools:
 Informatica
 Talend
 Data Stage
 Pentho
 Clover ETL
 Abi-inito
 SAP
3
 SnapLogic
 Informatica Cloud
 Talend Cloud
 Cloudera
 Databricks
 AWS Glue
 Alation
 Data pipelines
Installation Based: Cloud Based:
SnapLogic Origin and DI Solutions
 SnapLogic founded in 2006
 Elastic Integration Cloud
 Data Integration Solutions
 Cloud Data Warehousing
 Finance & Accounting
 API Integration
 Big Data
 Data Analytics
 IOT
 CRM
 Flat files and Databases etc
4
 Benefits:
 Easy and drag and drop
 Digital Cloud based and faster
 Increase your integrate by 10X
 Save millions in integrations Cost
Data Integration Solutions:
5
Introduction to SnapLogic:
SnapLogic Integration Cloud offers,
 Faster Integration
 Multipoint Integration
 Modern Integration
 iPaaS - Integrated Platform as a Service
 Batch Processing
 Real time applications
 ETL and Data integration requirements
 REST and JSON based data transfer
 AWS Cloud and easily Scale in and Scale out
 Expose as a webservice with access permission
6
Integration Cloud Platform Components:
 Designer
 Manager
 Monitoring Dashboard
 Snaps:
 Prebuilt Connectors - 450+ Snaps available
 Different Snap-packs available
 Core Snaps (XML,JSON, File Reader, COPY, Mapper etc)
 Data Snaps (Oracle, Redshift ,SQL Server etc)
 Enterprise Snaps(Sales force, Service Now etc)
 Social Media Snaps etc(Facebook, Tweeter etc)
 Snaplex:
 Cloudplex
 Groundplex
 Hadooplex 7
Designer:
 An HTML5-based
 Canvas Area for pipeline development
 Creating the pipelines
 Importing the single pipeline
 Pipeline properties
 Pipeline execution statistics
 Validating the pipeline (Shift +Validate) will clear the Cache as well
 Pipeline Versions (important for tracking/changes)
 Copy Pipeline & Move pipeline
 Create the Task
 Download pipeline
 Compare pipelines
8
Designer Tab:
9
Manager:
 Snap Packs
 Has different types of Snap packs and its no.of Snaps for each Snap pack
 Example: Redshift, Oracle, Facebook, Email etc
 Scheduled Tasks
 This will give you the details about list of Scheduled Task and its details
 Asset Search
 Very useful for searching the pipelines, account , files, tasks etc
 Activity Logs
 List of activity logs information and details about each and every change
 Also we can see logs for different purpose,
 Snaplex logs
 User logs
 Assets logs etc
 Alerts
 Snap Statistics
 Project Spaces 10
Manager Tab:
11
Monitoring Dashboard:
 Health Tab
 Snaplex health
 Total node
 Active Node
 Feed master/ Nodes
 Additional information's like Machine Memory, Java version, Total processor , Used
Memory etc
 Performance details about the Snaplex
 Pipeline Tab
 Current Pipeline Executions
 History Pipeline Executions
 Filter by Invocation Type(Trigger, Ultra, Scheduled, Manual), Particular User view
12
Dashboard Tab:
13
Cloud Deployment Architecture:
Data is streamed not stored. 14
Elastic Integration Platform Architecture
15
Elastic Integration Platform Architecture
 Implemented based on Concept of SDN – Software Defined Networking
 System decoupled into two main areas,
 Control plane
 Data plane
1. Control Plane
 It controls where and how the data are processed based on configurations
 Three web applications > Designer, Manager and Dashboard
16
Control Plane:
 1. Hardware and Software Load Balancers:
 2. Security: Manages the authorization and authentication of users accessing the web
applications.
 3. Scheduler: Manages scheduled tasks and jobs of integration pipelines.
 4. Controller: The control point where elasticity, lifecycle, software updates, etc. of all
runtime components are managed.
 5. Metadata Repository: Stores pipeline metadata in a fully redundant, secure
database(MongoDB).
 6. Amazon S3 for File System and Log Servers: Stores system files and pipeline generated
log files in a secure and resilient environment.
 7. SnapWatch: The management and monitoring tool for the SnapLogic DevOps team to
administer the entire SnapLogic Integration Cloud infrastructure.
17
Data plane
 The “data plane” is where the actual business data is processed
 One or more Snaplex
 On premise Groundplex > installation required
 Cloudplex > Preconfigured
 Hadooplex
 Eplex > New release
 Remotely managed by control plane
 The unit of scalability inside Snaplex is a Java virtual machine (JVM), referred
to as a “Node
 One or more nodes for scalability
 Auto scaling of nodes
18
Web Standards: JSON, REST, APIs, and Mobile
 JSON - Java script Object Notation
 REST - Representational State Transfer
 Common standard for data interchange as JSON and REST service for web
application
 Cloud web standards for to handle
 Structured data
 Un-Structured data
 Each pipeline can be invoke by REST protocol
 We can expose as API service for pipelines with security of authentication
19
 SnapLogic Developer Site: http://developer.snaplogic.com/
 Mainly for Snap development
 SnapLogic Blog: https://www.snaplogic.com/blog
 Read about SnapLogic case studies, news, features, initiatives, and more.
 SnapLogic Collateral: https://www.snaplogic.com/resources
 SnapLogic Analyst Reports, White Papers, Data Sheets, Webcasts, Videos, and more.
 SnapLogic Trust Site: http://trust.snaplogic.com/
 SnapLogic's site for real-time visibility into system performance and availability. See the
current status of the SnapLogic Enterprise Integration Cloud and the Cloudplex, as well as a
list of upcoming scheduled maintenance. Subscribe to receive automatic updates.
 SnapLogic documentation: https://docs-
snaplogic.atlassian.net/wiki/spaces/SD/overview
 SnapLogic Community: https://community.snaplogic.com/
Useful SnapLogic Resources:
20
Thank You!
Email: ssure.cse@gmail.com
https://www.linkedin.com/in/ssurendar/
21

Contenu connexe

Tendances

Infrastructure And Application Consolidation Analysis And Design
Infrastructure And Application Consolidation Analysis And DesignInfrastructure And Application Consolidation Analysis And Design
Infrastructure And Application Consolidation Analysis And Design
Alan McSweeney
 

Tendances (20)

Data warehouse proposal
Data warehouse proposalData warehouse proposal
Data warehouse proposal
 
Why Data Virtualization? An Introduction
Why Data Virtualization? An IntroductionWhy Data Virtualization? An Introduction
Why Data Virtualization? An Introduction
 
Migrating data: How to reduce risk
Migrating data: How to reduce riskMigrating data: How to reduce risk
Migrating data: How to reduce risk
 
NetSuite - An Overview
NetSuite - An OverviewNetSuite - An Overview
NetSuite - An Overview
 
Capgemini Cloud Assessment - A Pathway to Enterprise Cloud Migration
Capgemini Cloud Assessment - A Pathway to Enterprise Cloud MigrationCapgemini Cloud Assessment - A Pathway to Enterprise Cloud Migration
Capgemini Cloud Assessment - A Pathway to Enterprise Cloud Migration
 
Making a cloud first strategy a practical reality
Making a cloud first strategy a practical realityMaking a cloud first strategy a practical reality
Making a cloud first strategy a practical reality
 
Business intelligence, Data Analytics & Data Visualization
Business intelligence, Data Analytics & Data VisualizationBusiness intelligence, Data Analytics & Data Visualization
Business intelligence, Data Analytics & Data Visualization
 
How to establish the data management strategy, organization, culture and leve...
How to establish the data management strategy, organization, culture and leve...How to establish the data management strategy, organization, culture and leve...
How to establish the data management strategy, organization, culture and leve...
 
Splunk: Druid on Kubernetes with Druid-operator
Splunk: Druid on Kubernetes with Druid-operatorSplunk: Druid on Kubernetes with Druid-operator
Splunk: Druid on Kubernetes with Druid-operator
 
Operationalizing Machine Learning at Scale at Starbucks
Operationalizing Machine Learning at Scale at StarbucksOperationalizing Machine Learning at Scale at Starbucks
Operationalizing Machine Learning at Scale at Starbucks
 
Cloud Based Business Intelligence with Amazon QuickSight - AWS Online Tech Talks
Cloud Based Business Intelligence with Amazon QuickSight - AWS Online Tech TalksCloud Based Business Intelligence with Amazon QuickSight - AWS Online Tech Talks
Cloud Based Business Intelligence with Amazon QuickSight - AWS Online Tech Talks
 
How Netflix Uses Druid in Real-time to Ensure a High Quality Streaming Experi...
How Netflix Uses Druid in Real-time to Ensure a High Quality Streaming Experi...How Netflix Uses Druid in Real-time to Ensure a High Quality Streaming Experi...
How Netflix Uses Druid in Real-time to Ensure a High Quality Streaming Experi...
 
Infrastructure And Application Consolidation Analysis And Design
Infrastructure And Application Consolidation Analysis And DesignInfrastructure And Application Consolidation Analysis And Design
Infrastructure And Application Consolidation Analysis And Design
 
Emerging Trends in Data Architecture – What’s the Next Big Thing
Emerging Trends in Data Architecture – What’s the Next Big ThingEmerging Trends in Data Architecture – What’s the Next Big Thing
Emerging Trends in Data Architecture – What’s the Next Big Thing
 
Building a modern data warehouse
Building a modern data warehouseBuilding a modern data warehouse
Building a modern data warehouse
 
MDM and Reference Data
MDM and Reference DataMDM and Reference Data
MDM and Reference Data
 
Cloud Cost Optimization Whitepaper
Cloud Cost Optimization WhitepaperCloud Cost Optimization Whitepaper
Cloud Cost Optimization Whitepaper
 
Geospatial Analytics
Geospatial AnalyticsGeospatial Analytics
Geospatial Analytics
 
Capturing Data Requirements
Capturing Data RequirementsCapturing Data Requirements
Capturing Data Requirements
 
Business intelligence
Business intelligenceBusiness intelligence
Business intelligence
 

Similaire à SnapLogic- iPaaS (Elastic Integration Cloud and Data Integration)

Perfsystems- Consulting Services
Perfsystems- Consulting ServicesPerfsystems- Consulting Services
Perfsystems- Consulting Services
Perfsys Tems
 
Splunk app for stream
Splunk app for stream Splunk app for stream
Splunk app for stream
csching
 

Similaire à SnapLogic- iPaaS (Elastic Integration Cloud and Data Integration) (20)

Enterprise guide to building a Data Mesh
Enterprise guide to building a Data MeshEnterprise guide to building a Data Mesh
Enterprise guide to building a Data Mesh
 
The Never Landing Stream with HTAP and Streaming
The Never Landing Stream with HTAP and StreamingThe Never Landing Stream with HTAP and Streaming
The Never Landing Stream with HTAP and Streaming
 
Operational Analytics on Event Streams in Kafka
Operational Analytics on Event Streams in KafkaOperational Analytics on Event Streams in Kafka
Operational Analytics on Event Streams in Kafka
 
Cloud lunch and learn real-time streaming in azure
Cloud lunch and learn real-time streaming in azureCloud lunch and learn real-time streaming in azure
Cloud lunch and learn real-time streaming in azure
 
Databricks Platform.pptx
Databricks Platform.pptxDatabricks Platform.pptx
Databricks Platform.pptx
 
The Enterprise Guide to Building a Data Mesh - Introducing SpecMesh
The Enterprise Guide to Building a Data Mesh - Introducing SpecMeshThe Enterprise Guide to Building a Data Mesh - Introducing SpecMesh
The Enterprise Guide to Building a Data Mesh - Introducing SpecMesh
 
NextGenML
NextGenML NextGenML
NextGenML
 
Keeping Analytics Data Fresh in a Streaming Architecture | John Neal, Qlik
Keeping Analytics Data Fresh in a Streaming Architecture | John Neal, QlikKeeping Analytics Data Fresh in a Streaming Architecture | John Neal, Qlik
Keeping Analytics Data Fresh in a Streaming Architecture | John Neal, Qlik
 
Spring Cloud Services with Pivotal Cloud Foundry- Gokhan Goksu
Spring Cloud Services with Pivotal Cloud Foundry- Gokhan GoksuSpring Cloud Services with Pivotal Cloud Foundry- Gokhan Goksu
Spring Cloud Services with Pivotal Cloud Foundry- Gokhan Goksu
 
Data Pipeline for The Big Data/Data Science OKC
Data Pipeline for The Big Data/Data Science OKCData Pipeline for The Big Data/Data Science OKC
Data Pipeline for The Big Data/Data Science OKC
 
Software Innovations and Control Plane Evolution in the new SDN Transport Arc...
Software Innovations and Control Plane Evolution in the new SDN Transport Arc...Software Innovations and Control Plane Evolution in the new SDN Transport Arc...
Software Innovations and Control Plane Evolution in the new SDN Transport Arc...
 
Cloud Foundry Technical Overview
Cloud Foundry Technical OverviewCloud Foundry Technical Overview
Cloud Foundry Technical Overview
 
StrongLoop Overview
StrongLoop OverviewStrongLoop Overview
StrongLoop Overview
 
Perfsystems- Consulting Services
Perfsystems- Consulting ServicesPerfsystems- Consulting Services
Perfsystems- Consulting Services
 
Red Hat Storage Roadmap
Red Hat Storage RoadmapRed Hat Storage Roadmap
Red Hat Storage Roadmap
 
Red Hat Storage Roadmap
Red Hat Storage RoadmapRed Hat Storage Roadmap
Red Hat Storage Roadmap
 
Splunk app for stream
Splunk app for stream Splunk app for stream
Splunk app for stream
 
Cisco project ideas
Cisco   project ideasCisco   project ideas
Cisco project ideas
 
OpenStack for VMware Administrators
OpenStack for VMware AdministratorsOpenStack for VMware Administrators
OpenStack for VMware Administrators
 
StrongLoop DevOps Overview
StrongLoop DevOps OverviewStrongLoop DevOps Overview
StrongLoop DevOps Overview
 

Dernier

The title is not connected to what is inside
The title is not connected to what is insideThe title is not connected to what is inside
The title is not connected to what is inside
shinachiaurasa2
 
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdfintroduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
VishalKumarJha10
 
AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
AI Mastery 201: Elevating Your Workflow with Advanced LLM TechniquesAI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
VictorSzoltysek
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
Health
 

Dernier (20)

Define the academic and professional writing..pdf
Define the academic and professional writing..pdfDefine the academic and professional writing..pdf
Define the academic and professional writing..pdf
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
 
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
 
ManageIQ - Sprint 236 Review - Slide Deck
ManageIQ - Sprint 236 Review - Slide DeckManageIQ - Sprint 236 Review - Slide Deck
ManageIQ - Sprint 236 Review - Slide Deck
 
The title is not connected to what is inside
The title is not connected to what is insideThe title is not connected to what is inside
The title is not connected to what is inside
 
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdfintroduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
 
8257 interfacing 2 in microprocessor for btech students
8257 interfacing 2 in microprocessor for btech students8257 interfacing 2 in microprocessor for btech students
8257 interfacing 2 in microprocessor for btech students
 
AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
AI Mastery 201: Elevating Your Workflow with Advanced LLM TechniquesAI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
 
Sector 18, Noida Call girls :8448380779 Model Escorts | 100% verified
Sector 18, Noida Call girls :8448380779 Model Escorts | 100% verifiedSector 18, Noida Call girls :8448380779 Model Escorts | 100% verified
Sector 18, Noida Call girls :8448380779 Model Escorts | 100% verified
 
A Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docxA Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docx
 
VTU technical seminar 8Th Sem on Scikit-learn
VTU technical seminar 8Th Sem on Scikit-learnVTU technical seminar 8Th Sem on Scikit-learn
VTU technical seminar 8Th Sem on Scikit-learn
 
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
 
Pharm-D Biostatistics and Research methodology
Pharm-D Biostatistics and Research methodologyPharm-D Biostatistics and Research methodology
Pharm-D Biostatistics and Research methodology
 
Introducing Microsoft’s new Enterprise Work Management (EWM) Solution
Introducing Microsoft’s new Enterprise Work Management (EWM) SolutionIntroducing Microsoft’s new Enterprise Work Management (EWM) Solution
Introducing Microsoft’s new Enterprise Work Management (EWM) Solution
 
Direct Style Effect Systems - The Print[A] Example - A Comprehension Aid
Direct Style Effect Systems -The Print[A] Example- A Comprehension AidDirect Style Effect Systems -The Print[A] Example- A Comprehension Aid
Direct Style Effect Systems - The Print[A] Example - A Comprehension Aid
 
10 Trends Likely to Shape Enterprise Technology in 2024
10 Trends Likely to Shape Enterprise Technology in 202410 Trends Likely to Shape Enterprise Technology in 2024
10 Trends Likely to Shape Enterprise Technology in 2024
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
 
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
 
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected WorkerHow To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
 
Exploring the Best Video Editing App.pdf
Exploring the Best Video Editing App.pdfExploring the Best Video Editing App.pdf
Exploring the Best Video Editing App.pdf
 

SnapLogic- iPaaS (Elastic Integration Cloud and Data Integration)

  • 1. SnapLogic Leader in Enterprise iPaaS by Surendar S https://www.linkedin.com/in/ssurendar/
  • 2. Synopsis:  Rise of cloud and importance of cloud  Traditional ETL  ETL frameworks & Popular ETL tools  SnapLogic Origin and DI Solutions  As per Gartner report leader in DI  Importance of SnapLogic (Why SnapLogic)  Introduction of SnapLogic  Components of SnapLogic  Elastic Integration Platform Architecture  Web Standards  Resources reference 2
  • 3. Popular ETL Tools:  Informatica  Talend  Data Stage  Pentho  Clover ETL  Abi-inito  SAP 3  SnapLogic  Informatica Cloud  Talend Cloud  Cloudera  Databricks  AWS Glue  Alation  Data pipelines Installation Based: Cloud Based:
  • 4. SnapLogic Origin and DI Solutions  SnapLogic founded in 2006  Elastic Integration Cloud  Data Integration Solutions  Cloud Data Warehousing  Finance & Accounting  API Integration  Big Data  Data Analytics  IOT  CRM  Flat files and Databases etc 4  Benefits:  Easy and drag and drop  Digital Cloud based and faster  Increase your integrate by 10X  Save millions in integrations Cost
  • 6. Introduction to SnapLogic: SnapLogic Integration Cloud offers,  Faster Integration  Multipoint Integration  Modern Integration  iPaaS - Integrated Platform as a Service  Batch Processing  Real time applications  ETL and Data integration requirements  REST and JSON based data transfer  AWS Cloud and easily Scale in and Scale out  Expose as a webservice with access permission 6
  • 7. Integration Cloud Platform Components:  Designer  Manager  Monitoring Dashboard  Snaps:  Prebuilt Connectors - 450+ Snaps available  Different Snap-packs available  Core Snaps (XML,JSON, File Reader, COPY, Mapper etc)  Data Snaps (Oracle, Redshift ,SQL Server etc)  Enterprise Snaps(Sales force, Service Now etc)  Social Media Snaps etc(Facebook, Tweeter etc)  Snaplex:  Cloudplex  Groundplex  Hadooplex 7
  • 8. Designer:  An HTML5-based  Canvas Area for pipeline development  Creating the pipelines  Importing the single pipeline  Pipeline properties  Pipeline execution statistics  Validating the pipeline (Shift +Validate) will clear the Cache as well  Pipeline Versions (important for tracking/changes)  Copy Pipeline & Move pipeline  Create the Task  Download pipeline  Compare pipelines 8
  • 10. Manager:  Snap Packs  Has different types of Snap packs and its no.of Snaps for each Snap pack  Example: Redshift, Oracle, Facebook, Email etc  Scheduled Tasks  This will give you the details about list of Scheduled Task and its details  Asset Search  Very useful for searching the pipelines, account , files, tasks etc  Activity Logs  List of activity logs information and details about each and every change  Also we can see logs for different purpose,  Snaplex logs  User logs  Assets logs etc  Alerts  Snap Statistics  Project Spaces 10
  • 12. Monitoring Dashboard:  Health Tab  Snaplex health  Total node  Active Node  Feed master/ Nodes  Additional information's like Machine Memory, Java version, Total processor , Used Memory etc  Performance details about the Snaplex  Pipeline Tab  Current Pipeline Executions  History Pipeline Executions  Filter by Invocation Type(Trigger, Ultra, Scheduled, Manual), Particular User view 12
  • 14. Cloud Deployment Architecture: Data is streamed not stored. 14
  • 15. Elastic Integration Platform Architecture 15
  • 16. Elastic Integration Platform Architecture  Implemented based on Concept of SDN – Software Defined Networking  System decoupled into two main areas,  Control plane  Data plane 1. Control Plane  It controls where and how the data are processed based on configurations  Three web applications > Designer, Manager and Dashboard 16
  • 17. Control Plane:  1. Hardware and Software Load Balancers:  2. Security: Manages the authorization and authentication of users accessing the web applications.  3. Scheduler: Manages scheduled tasks and jobs of integration pipelines.  4. Controller: The control point where elasticity, lifecycle, software updates, etc. of all runtime components are managed.  5. Metadata Repository: Stores pipeline metadata in a fully redundant, secure database(MongoDB).  6. Amazon S3 for File System and Log Servers: Stores system files and pipeline generated log files in a secure and resilient environment.  7. SnapWatch: The management and monitoring tool for the SnapLogic DevOps team to administer the entire SnapLogic Integration Cloud infrastructure. 17
  • 18. Data plane  The “data plane” is where the actual business data is processed  One or more Snaplex  On premise Groundplex > installation required  Cloudplex > Preconfigured  Hadooplex  Eplex > New release  Remotely managed by control plane  The unit of scalability inside Snaplex is a Java virtual machine (JVM), referred to as a “Node  One or more nodes for scalability  Auto scaling of nodes 18
  • 19. Web Standards: JSON, REST, APIs, and Mobile  JSON - Java script Object Notation  REST - Representational State Transfer  Common standard for data interchange as JSON and REST service for web application  Cloud web standards for to handle  Structured data  Un-Structured data  Each pipeline can be invoke by REST protocol  We can expose as API service for pipelines with security of authentication 19
  • 20.  SnapLogic Developer Site: http://developer.snaplogic.com/  Mainly for Snap development  SnapLogic Blog: https://www.snaplogic.com/blog  Read about SnapLogic case studies, news, features, initiatives, and more.  SnapLogic Collateral: https://www.snaplogic.com/resources  SnapLogic Analyst Reports, White Papers, Data Sheets, Webcasts, Videos, and more.  SnapLogic Trust Site: http://trust.snaplogic.com/  SnapLogic's site for real-time visibility into system performance and availability. See the current status of the SnapLogic Enterprise Integration Cloud and the Cloudplex, as well as a list of upcoming scheduled maintenance. Subscribe to receive automatic updates.  SnapLogic documentation: https://docs- snaplogic.atlassian.net/wiki/spaces/SD/overview  SnapLogic Community: https://community.snaplogic.com/ Useful SnapLogic Resources: 20