Ce diaporama a bien été signalé.
Nous utilisons votre profil LinkedIn et vos données d’activité pour vous proposer des publicités personnalisées et pertinentes. Vous pouvez changer vos préférences de publicités à tout moment.

Getting Started with Apache NiFi Across Industries

1 022 vues

Publié le

Join experts, Cindy Maike, VP of Industry Solutions at Hortonworks, and Dan Potter, VP of Product Management and Marketing at Attunity, as they discuss how the combination of Hortonworks and Attunity technology provides a modern data architecture that enables new use cases for applications.

https://hortonworks.com/webinar/getting-started-apache-nifi-across-industries/

Publié dans : Technologie
  • Earn $90/day Working Online You won't get rich, but it is going to make you some money! ♣♣♣ http://ishbv.com/ezpayjobs/pdf
       Répondre 
    Voulez-vous vraiment ?  Oui  Non
    Votre message apparaîtra ici

Getting Started with Apache NiFi Across Industries

  1. 1. 1 © Hortonworks Inc. 2011–2018. All rights reserved Getting Started with Apache NiFi Across Industries Cindy Maike, VP of Industry Solutions – Hortonworks Dan Potter, VP of Product Marketing - Attunity
  2. 2. 2 © Hortonworks Inc. 2011–2018. All rights reserved Dan Potter VP Product Marketing ATTUNITY Cindy Maike VP Industry Solutions HORTONWORKS
  3. 3. 3 © Hortonworks Inc. 2011–2018. All rights reserved Agenda • Connected Digital World Opportunities • The Changing Data Landscape • Industry Use Cases • Attunity Replicate • Q&A
  4. 4. 4 © Hortonworks Inc. 2011–2018. All rights reserved Mobile apps Online shopping Medical records Wearables Music streaming
  5. 5. 5 © Hortonworks Inc. 2011–2018. All rights reserved BIGGEST BUSINESS MODEL TRANSFORMATION SINCE INDUSTRIAL REVOLUTION PROCEDURAL PROCESSING CUSTOMER SUPPLY ENTERPRISE PRODUCT CONNECTED COMMUNITIES ENTERPRISE CUSTOMER PRODUCT SUPPLY
  6. 6. 6 © Hortonworks Inc. 2011–2018. All rights reserved Opportunities to Create Business Value Across Connected Communities Cost savings from predictive maintenance New revenues from location aware E-Commerce Supply Chain Data Exchange New Models for Commerce and Trade Monetization of Data Real-Time Operational Models New revenues by monetized customer profile and location data Improve supply chain efficiencies through sharing of real-time data © Hortonworks Inc. 2011–2018. All rights reserved
  7. 7. 7 © Hortonworks Inc. 2011–2018. All rights reserved CUSTOMER SUPPLY ENTERPRISE PRODUCT MODERN BUSINESS MODELS REQUIRES WE CREATE CONNECTED COMMUNITIES TO GET MORE BUSINESS VALUE • Real-time visibility • Product performance • Customer satisfaction New models drive With High-Velocity • Adjustments • Remedies • Responses © Hortonworks Inc. 2011–2018. All rights reserved
  8. 8. 8 © Hortonworks Inc. 2011–2018. All rights reserved MULTIPLE CLUSTERS AND SOURCES MULTIHYBRID DATAPLANE SERVICE (DPS) MANAGE, GOVERN, SECURE DATA LIFECYCLE MANAGER DATA STEWARD STUDIO* ISV SERVICES *not yet available, coming soon EXTENSIBLE SERVICES IBM DSX*CLOUD- BREAK* DATA ANALYTICS STUDIO* CONNECTED DATA PLATFORMS HORTONWORKS DATA PLATFORM (HDP®) DATA-AT-REST HORTONWORKS DATAFLOW (HDF™) DATA-IN-MOTION MODERN DATA USE CASES EDW OPTIMIZATION CYBER SECURITY DATA SCIENCE ADVANCED ANALYTICS PARTNER SOLUTIONS IOT/ STREAMING ANALYTICS HORTONWORKS CONNECTION ENTERPRISE SUPPORT PREMIER SUPPORT EDUCATIONAL SERVICES PROFESSIONAL SERVICES COMMUNITY CONNECTION HORTONWORKS PLATFORM SERVICES OPERATIONAL SERVICES SMARTSENSE™ Global Data Management With Hortonworks and Attunity
  9. 9. 9 © Hortonworks Inc. 2011–2018. All rights reserved Example: Real-Time Supply Chain Analytics ENTERPRISE TRANSACTION SOURCES ERP, MES, SCM, WMS, TMS, ETC. ENTERPRISE DATA LAKE 6 REAL-TIME INVENTORY ACTION ACT 1 I N G E S T 1 INGEST 2 STORE 3 PROCESS 4 •Data Discovery •Business Intelligence ANALYZE MONITOR 5 Deploy 4 LEARN •Develop Models •Machine Learning Model Inputs • Historic click-streams, POS data • Historic inventory locations/levels • Historic Weather • Historic order histories, inventory locations and levels • Historic disruptions REAL-TIME DATA SOURCES Connected Supply Chain RFIDSocial WEB POS GPS
  10. 10. 10 © Hortonworks Inc. 2011–2018. All rights reserved Hortonworks & Attunity for Real-Time Connected Industries ENTERPRISE TRANSACTION SOURCES ENTERPRISE DATA LAKE 1 I N G E S T 4 4 Deploy INGEST DATA IN MOTION MONITOR STORE AND PROCESS DATA AT REST ANALYZE LEARN 1 5 ERP, MES, SCM, WMS, TMS, ETC. •Data Discovery •Business Intelligence DATA AT REST REAL-TIME DATA SOURCES Connected Supply Chain RFIDSocial WEB POS GPS 6 REAL-TIME INVENTORY ACTION ACT Model Inputs • Historic click-streams, POS data • Historic inventory locations/levels • Historic Weather • Historic order histories, inventory locations and levels • Historic disruptions Illustration of Supply Chain
  11. 11. 12 © Hortonworks Inc. 2011–2018. All rights reserved 12© 2017 Attunity MODERN DATA INGEST METADATA HIVE OPTIMIZED STREAM OPTIMIZED CHANGE DATA CAPTURE CLOUD ON PREM WAREHOUSE MAINFRAME RDBMS SAP ▪ CDC (log-based) for high performance, low latency and low impact ▪ Single platform for all key enterprise systems ▪ Hive-optimized for HDP and Stream- optimized for HDF ▪ Point-and-Click with NO coding and NO agents
  12. 12. 13© 2018 Attunity METADATA HIVE OPTIMIZED STREAM OPTIMIZED Hive-optimized for HDP and Stream-optimized for HDF Point-and-Click with NO coding and NO agents Automates creation of analytics-ready Hive dataset Reconciles source data and metadata updates Transformation processing pushed down to Hive CHANGE DATA CAPTURE CLOUD ON PREM WAREHOUSE MAINFRAME RDBMS SAP TRANSFORM & UPDATE ATTUNITY + HORTONWORKS
  13. 13. 14 © Hortonworks Inc. 2011–2018. All rights reserved Industry Use Cases
  14. 14. 15 © Hortonworks Inc. 2011–2018. All rights reserved Insurance Industry - Business use cases Emerging Tech, Real-time data and the Connected World Smart Cities & Buildings Smart Factories / Commercial Connected Life / Health / Medicine IoT / Robotics Telematics Shared Economy Smart Homes Cyber / AI / Analytics
  15. 15. 16 © Hortonworks Inc. 2011–2018. All rights reserved Driving Actionable Intelligence in Insurance Catastrophic Event Data Customer Onboarding Data Seismic Data Biometrics Data Usage-Based Driver Data Cyber Threat Metadata RISK & UNDERWRITING ANALYSIS USAGE-BASED INSURANCE CLAIMS ANALYTICS NEW PRODUCT DEVELOPMENT CYBER RISK ANALYTICS Drones & Aerial Imagery Claims Docs, Notes & Diaries Weather & Environment Underwriting Analysis Policy Histories Photos
  16. 16. 17 © Hortonworks Inc. 2011–2018. All rights reserved Nifi and Attunity Replicate in Insurance Insurance Risk & underwriting analysis; Usage-based insurance; Claims analytics; New product development, and cyber-risk analytics · Apache NiFi: Usage-Based Driver Data, Weather & Environment, Drones & Aerial Imagery, Seismic Data, Biometrics Data, Cyber Threat Metadata, Catastrophic Event Data, Photos · Attunity Replicate: Underwriting Analysis, Customer Onboarding Data, Underwriting Analysis, Policy histories, Claims Docs, Notes & Diaries
  17. 17. 18 © Hortonworks Inc. 2011–2018. All rights reserved Actionable Intelligence Powers Modern Manufacturing Defect Testing Data Product Designs MES System s RFID Streams SCADA Systems Shop Floor Sensors PREVENTATIVE MAINTENANCE SUPPLY CHAIN OPTIMIZATION YIELD MAXIMIZATION QUALITY CONTROL RECALL AVOIDANCE ERP Systems Supplier Receipts Machine Data Assembly Line Sensors Data Historians Work Orders
  18. 18. 19 © Hortonworks Inc. 2011–2018. All rights reserved Data Drives the Connected Car – Must include SAP SCM, etc. Insurance Premiums Warranties Recalls Pricing Models Design Innovation Autonomous Driving Connected City Infotainment Sensors Scheduled Maintenance Predictive Maintenance Route Optimization INSURANCE COMPANIES GOVERNMENT AGENCIES INFOTAINMENT PROVIDERS SOFTWARE COMPANIES AUTO MAKERS
  19. 19. 20 © Hortonworks Inc. 2011–2018. All rights reserved Attunity Replicate Enables Global Manufacturing and Automotive Transformation Manufacturing Preventative Maintenance, Supply Chain Optimization, Yield Maximization, Quality Control, and Recall Avoidance Development · Apache NiFi: Machine Data, Testing Data, Assembly Line Sensors, RFID Streams, Shop Floors · Attunity Replicate: Scada systems, Work Orders, Supplier Receipts, ERP Systems, MES, Data Historians, Product Designs
  20. 20. 21 © Hortonworks Inc. 2011–2018. All rights reserved Actionable Intelligence Transforms Energy and Utilities Asset Data Customer Surveys Weather & Environmental Service Fleet GPS Data Smart Meter Streams Commodity Prices REVENUE PROTECTION SINGLE VIEW OF CUSTOMER PREDICTIVE EQUIPMENT MAINTENANCE CONSERVATION VOLTAGE REDUCTION COMMODITY TRADING Social Media GIS Data SCADA Outage Histories CIS Records EDW
  21. 21. 22 © Hortonworks Inc. 2011–2018. All rights reserved Attunity Replicate Provides Pumps More Relevant Data for Energy and Utilities Utilities REVENUE PROTECTION; SINGLE VIEW OF CUSTOMER; PREDICTIVE EQUIPMENT MAINTENANCE; CONSERVATION VOLTAGE REDUCTION; COMMODITY TRADING · Apache NiFi: smart meter streams, GIS data, social media, weather & environmental, CIS record, customer surveys, commodity prices ·Attunity Replicate: SCADA, EDW, asset data, outage histories
  22. 22. 23 © Hortonworks Inc. 2011–2018. All rights reserved Actionable Intelligence Powers Today’s Financial Services OFAC Lists Credit Records ATM Streams Transactions & Wires Stock Tickers Trade Settlements DIGITAL CUSTOMER 360 RISK DATA AGGREGATION ANTI-MONEY LAUNDERING FRAUD DETECTION TRADE SURVEILLANCE Mobile App Data Trade Data Web Logs Banker Notes Demographic Data Customer Transaction Data
  23. 23. 24 © Hortonworks Inc. 2011–2018. All rights reserved Attunity Replicate Connects You to Your Money and Integrates with Key Market Resources Financial Services DIGITAL CUSTOMER 360; RISK DATA AGGREGATION; ANTI-MONEY LAUNDERING; FRAUD DETECTION; TRADE SURVELLIANCE · Apache NiFi: web logs, trade data, mobile app data, ATM streams, OFAC lists, transactions & wires, demographic data, trade settlements. · Attunity Replicate: customer transaction data, OFAC lists, banker notes, credit records, stock tickers
  24. 24. STREAMING REAL-TIME DATA
  25. 25. 26© 2018 Attunity Requirement Detail Latency Need to update data sets in near real-time Scale High volume and variety of data ingestion Flexibility Change platforms quickly Time to Value Dependency on developers Performance Negative impact on production Efficiency Slow, disruptive full load replication NEEDS AND CHALLENGES
  26. 26. 27© 2018 Attunity AUTOMATE YOUR DATA PIPELINE Consume ANALYZE MONITOR SAP RDBMS DATA WAREHOUSE FILES MAINFRAME Land Structure Provision CREATE UPDATE ENRICH SUBSET STANDARDIZE MERGE FORMAT Raw Deltas Historical Data Store HDS ODS Snapshot Model PREPARE UNIFY Mart Views Data ingested into data lake Data continuously updated and merged into historic data store Subsets created to meet analytic requirements Create marts for queries and analysis
  27. 27. 28 © Hortonworks Inc. 2011–2018. All rights reserved Why Attunity with Hortonworks? Data Ingestion Solution of Choice Modern Data Platforms Modern Industry Use Cases • Data Lakes • Process Optimization • Machine Learning & AI Supporting The Use Cases of the Now and Future
  28. 28. 29 © Hortonworks Inc. 2011–2018. All rights reserved Questions?
  29. 29. 30 © Hortonworks Inc. 2011–2018. All rights reserved Download Apache NiFi for Dummies Today! https://hortonworks.com/ebook/ni-fi- dummies/ Industry Solution Guide for Using Apache NiFi and Attunity Replicate https://hortonworks.com/info/industr y-solution-guide-using-apache-nifi- attunity-replicate/
  30. 30. 31 © Hortonworks Inc. 2011–2018. All rights reserved Thank you For more information, go to: www.Attunity.com/nifibook

×