Ce diaporama a bien été signalé.
Nous utilisons votre profil LinkedIn et vos données d’activité pour vous proposer des publicités personnalisées et pertinentes. Vous pouvez changer vos préférences de publicités à tout moment.

28

Partager

Solution architecture for big data projects

Solution architecture for big data projects
solution architecture,big data,hadoop,hive,hbase,impala,spark,apache,cassandra,SAP HANA,Cognos big insights

Solution architecture for big data projects

  1. 1. Solution Architecture for bigdata Business Architecture Information Architecture Infrastructure Architecture Data Architecture Integration Architecture Service Architecture
  2. 2. Solution Architecture BI Solution Requirements Corporate Strategy BI Stakeholders BI Vision BI Strategy BI Mission Statement BI Solution Architecture Business Architecture Infrastructure Architecture Data Architecture Service Architecture Integration Architecture Information Architecture
  3. 3. Business Architecture Business Architecture Business Objective Business Strategy Business Capabilities Business Process Areas Ways of Working Interviews Requirement Workshop Business Structure
  4. 4. Information Architecture Information Architecture Social Media:Facebook data from API Legacy System Social Media Data: Twitter Data Capture System Web Application data KANBAN Process ERP (Manufacturing) Landing Space Staging Tables ODC Denormalized Column Families Row KeyERP 3NF Tables Reference Data Data Ownership Data Contracts Structural Design Shared Info Env. Flow & Lineage Meaning and Use
  5. 5. Application Architecture Application Architecture noSQL databases: HBASE, Cassandra, MongoDB Relational databases (Source /Target): Oracle,SQL Server,Terradata Graph databases: Neo4j and Giraph Hadoop Technologies: HDFS In memory/MPP/Search: Shark,Spark,Impala,SAP HANA, Visualisation/Reporting: Tableau,Pentaho,qlickview Data Integration: (Talend/Informatica/BODI,Pentaho DI) How All Application Hook Together Data Warehouse: (Hive, Relational Datawarehouse,SAP HANA)
  6. 6. Infrastructure Architecture Infrastructure Architecture Storage Communication Data Federation Data Virtualization Cloud Security HA/DR Recovery/Backup Licensing Models Versioning / Patching Hardware/ VM Procurement Sizing Production Test Development
  7. 7. Data Architecture Data Architecture ETL Sources Data Governance Metadata Data Quality Data Profiling MDM Big data Near Real time Real time ODS Reference Data Physical /logical Data model Dimensional Modelling Entity Modelling Data Warehouse
  8. 8. Data Integration Architecture Data Integration Architecture ETL ETL Subsystem Sources Data Governance Metadata Data Quality Data Profiling MDM Big data Near Real time Real time ODS Reference Data Physical /logical Data model Dimensional Modelling Entity Modelling Data Warehouse Details Next Slide
  9. 9. ETL Subsystems Profiling Extrac tion Data Change Mgmt. Error Event Schema Audit Dimension Deduplication Data Cleansing Surrogate Generation SCD Mgmt. Fact Update Dimension & Fact Conformity Hierarchy Mgmt. Surrogate Mgmt. Bridge Table Sorting Job Scheduler Lineage Dependencies Parallel Processing Bulk Load TransformExtract Load Recovery & Restart Security Systems Package Versioning Compliance Metadata Repository Recovery & Restart Problem Escalation Package Lifecycle Workflow Monitoring Backup Systems Manage
  10. 10. Integration Architecture Integration Architecture Security (Cloud Security, Data security, Top 10) Portal Integration Coarse grain Integration (Web Services) Social Media API Distributed Hadoop Java Customization Infrastructure AWS API publication-consumption Service Oriented Architecture Big data Analysis Java Components Data Analysis javascript Libraries Real time data feed API (node.js) 3rd party Visualisation API like Adobe Flex Analytics API Integration Governance Framework Other 3rd party system Integration API Process Modelling: BPM/BPEL components Supporting Platforms Integration
  11. 11. Service Architecture Service Architecture Compliance Backup and Recovery Disaster Recovery and High Availability Service Library Defects/ Fixes/Impact Management Upgrades/Maintenance Service Operations Change Requests CR, Request For Change RFC Release Policy Service Transition Service Design Package Capacity Plan Service Level Agreement Service Design Recovery Time Objective/ Recovery Point Objective Service Strategy
  12. 12. More details • http://thebigdatatrends.wordpress.com • http://enterprisearchitectview.wordpress.com • http://thedatascience.wordpress.com/ • http://thecloudview.wordpress.com/ • http://businessarchitectview.wordpress.com/ • https://sandyclassic.wordpress.com
  • blue3106

    Aug. 17, 2021
  • Duncx

    Jul. 7, 2020
  • ashokibm

    Feb. 18, 2020
  • SatyakrishnaJasti

    Jan. 29, 2020
  • rk_yyj

    Jan. 21, 2020
  • venkatdhulipala9

    Oct. 23, 2019
  • jainayush007

    Aug. 28, 2018
  • safibaig

    Aug. 20, 2018
  • mohsenmotamedi1

    Feb. 8, 2018
  • sriniramesh

    Dec. 22, 2017
  • BilalHomsi

    Dec. 8, 2017
  • WorawutHanklup

    Oct. 15, 2017
  • snow3d

    Jun. 30, 2017
  • ChethanChandra2

    May. 31, 2017
  • FatihAKBAS

    Mar. 21, 2017
  • TiffiniManningCSM

    Feb. 17, 2017
  • Macdin

    Dec. 23, 2016
  • gloriayang

    Nov. 20, 2016
  • rajeevsharma310

    Jul. 1, 2016
  • Gudimetla

    May. 25, 2016

Solution architecture for big data projects solution architecture,big data,hadoop,hive,hbase,impala,spark,apache,cassandra,SAP HANA,Cognos big insights

Vues

Nombre de vues

9 865

Sur Slideshare

0

À partir des intégrations

0

Nombre d'intégrations

3 227

Actions

Téléchargements

0

Partages

0

Commentaires

0

Mentions J'aime

28

×