The True Cost of Data Integration
28 Sep 2020•0 j'aime•111 vues
Télécharger pour lire hors ligne
Signaler
Technologie
This on-demand webinar will explore the challenges of working with legacy data and explain the technologies required to make that data a first-class citizen in modern cloud data environments while ensuring your costs don’t impact your business. In this webinar viewers will understand: - Challenges in integrating legacy systems with modern cloud data platforms - Strategies for integrating legacy systems into a cloud architecture - How Precisely Connect is helping customers to minimize costs while taking a modern approach to data integration
PreciselySuivre
Recommandé
Bridging Legacy Systems and Cloud Data Platforms to Unlock Valuable Enterpris...Precisely
Will AI Eliminate Reports and DashboardsEric Kavanagh
Data science as a serviceidan_by
Using Apache Spark for Intelligent Services by Alexis RoosSpark Summit
Coscole KiData IntroMatt Woodruff
The culture trip snowplow implementationidan_by
Contenu connexe
Tendances
Data Democracy: Hadoop + RedshiftLooker
SPARK16 Presentation: Urjanet Product VisionUrjanet
Embedding Data & Analytics With LookerLooker
Managing Data Sprawl with Data Catalogs for Self-ServiceEckerson Group
AI-Powered Analytics: What It Is and How It’s Powering the Next Generation of...Tyler Wishnoff
From Architecture to Analytics: A look at Simply Business’s data strategy Looker
Similaire à The True Cost of Data Integration
Predictive and Prescriptive Analytics Expert Session Webinar ibi
Modernizing the Legacy Data Warehouse – What, Why, and How 1.23.19Cloudera, Inc.
TDWI Boston Keynote - The New BI/Analytics Synergy - 7 30-2015 - tdwi keynoteEckerson Group
TDWI Boston Keynote: The New BI/Analytics Synergy Eckerson Group
Metadata Mastery: A Big Step for BI ModernizationEric Kavanagh
The Evolution of Self-Service AnalyticsEckerson Group
Plus de Precisely
Democratized Data & Analytics for the CloudPrecisely
Looking Ahead: The Future Of Automation and Live Q&APrecisely
Maximize Your Investments with the Precisely Strategic Services TeamPrecisely
Hyperautomation and AI/ ML: A Strategy for Digital Transformation SuccessPrecisely
The State of Automation: New Trends and InsightsPrecisely
Data Integrity TrendsPrecisely
Dernier
alfred-product-research-proposal.pdfAlfredSuratos
CamundaCon NYC 2023 Keynote - Shifting into overdrive with process orchestrationBernd Ruecker
Brisbane MuleSoft Meetup 13 MuleSoft Maven and Managing Dependencies Part 1.pptxBrianFraser29
Common WordPress APIs_ Settings APIJonathan Bossenger
THRIVING IN THE GEN AI ERA: NAVIGATING CHANGE IN TECHSteve Poole
Regain Supply Chain ControlConverge
The True Cost of Data Integration
- 2. © Eckerson Group 2020 Twitter: @eckersongroup www.eckerson.com The True Cost of Data Integration Sponsored by: WELCOME!
- 3. © Eckerson Group 2020 Twitter: @eckersongroup www.eckerson.com Today’s Speakers Oliver Vagner Senior Research Analyst Eckerson Group Arianna Valentini Product Marketing Manager Precisely Speaker Speaker
- 4. © Eckerson Group 2020 Twitter: @eckersongroup www.eckerson.com Three Eras of Intelligence IT-Driven User-Driven Model-Driven ~1990-2005 ~2005-2020 ~2020+ Business Intelligence Self-Service Intelligence Artificial Intelligence Keys •Data Science •Automation •DataOps/MLOpsKeys •Data Warehousing •Data Integration •Data Quality/MDM •Standard KPIs •Dashboards Keys • Data and Report Governance • Federated Center of Excellence • Data Refinery • Data Catalog/Data Prep/AutoML • Data Literacy Volume,Complexity,Speed Business Value Human Input Machine Analysis
- 5. © Eckerson Group 2020 Twitter: @eckersongroup www.eckerson.com “Simple models and a lot of data trump more elaborate models based on less data” -Peter Norvig Success in Analytics is All About Data
- 6. © Eckerson Group 2020 Twitter: @eckersongroup www.eckerson.com Ripped from the Headlines
- 7. © Eckerson Group 2020 Twitter: @eckersongroup www.eckerson.com Operational Agility “The goal is to boost the availability of real-time data and enable commercial customers to better manage inventory by closely tracking air, sea and ground freight.” - Brannon Kuykendall, CIO Crane Worldwide Logistics
- 8. © Eckerson Group 2020 Twitter: @eckersongroup www.eckerson.com Today’s Complex Data and Application Landscapes 8 Data Lake POS Order Processing Inventory Purchasing Receiving Facilities Shipping Call Center Legacy and Mainframe Applications On-Premises Data CenterSixSeparateCloudPlatforms…ManyCloudTenants Analytics Data Warehouse Adobe Experience Legacy Data Warehouses • Data Silos • Application Silos • Cloud/On-Premises Hybrid • Multi-Cloud • Data Variety • Data Velocity • Variety of Users • Variety of Use Cases • Requirements Volatility
- 9. © Eckerson Group 2020 Twitter: @eckersongroup www.eckerson.com What is a Legacy System?
- 10. © Eckerson Group 2020 Twitter: @eckersongroup www.eckerson.com Challenges
- 11. © Eckerson Group 2020 Twitter: @eckersongroup www.eckerson.com Challenges $$$ $ $ $ $ $ $ $ $ $ $ $$$ $$ $ $ $ $ $$
- 15. • • • • •
- 19. • • • • •
- 20. • • •
- 24. • • • •
- 25. • • •
- 26. • • • •
Notes de l'éditeur
- Data and application management in today’s world is complex and challenging. While the need for integration – both data and application integration – grows, the work of integration becomes ever more complex. A typical data and application landscape looks something like the diagram shown here, with many data silos including multiple data warehouses, a data lake, and many application databases. And the data is spread across six cloud platforms as well and on-premises databases of several types. Application silos and sprawl are similar to what we’ve experienced with data with SaaS, ERP, and legacy systems spread across a multi-cloud plus on-premises hybrid environment. Management and integration challenges are exacerbated with increasing volume, variety, and velocity of data combined with more users, more use cases, and demand for agility and ability to respond to changing business needs.
- There are two flavors of our Connect solution Connect offers High-performance ETL for Apache Spark, Cloud, Windows, Linux, Unix and Hadoop MapReduce Connect also has a data replication/CDC solution that supports cloud and hybrid architectures. This solutions offers real-time database replication to streaming platforms, Cloud, databases and data warehouses
- Break down data silos by connecting traditional systems such as mainframes to next wave technologies in minutes Real-time data delivery to feed business applications and analytics Design once, deploy anywhere to future proof your business with easy to use GUI and self-tuning engine - no coding or tuning needed The industry’s only guaranteed data delivery solution for change data capture Mainframe expertise to help drive innovation – directly access and understand VSAM files, COBOL Copybooks, IMS, mainframe fixed and sequential files, and Db2 data
- Emphasize real-time CDC Looking to revamp integration processes to save on cost, to enable action on these new use cases – it’s a true modernization
- Takes 2-3 days just to load data Using Scoop to perform full table loads of massive DB2 tables Maintaining multiple copies of the data then determine manually what changed, so if only 10% of the data changed they still need to download full data sets. Need 100% of the data. Compare snapshots of both yesterday’s data with changes of today – causing them to need to store more data than they really needed Only appending to Hive. No way to perform CDC
- Solution: Real-time CDC for high volume DB2 transactions. High speed Replication utility Pull only changed data as it changes not a snapshot on a regularly scheduled basis Real-time CDC for high volume DB2 transactions. Plug and play, no complex mapping required Lightweight, low latency Benefits: Reduction in storage costs OPEX reduction, reduced MIPS Dev costs almost eliminated Quick benefits and ROI Less consumption
- Needed to access Db2 and VSAM files need to be accesses for AI/ML use cases Current solution that they had for DI was complex and not dynamic Connect helped to extract COBOL program on mainframe making it scalable for big data platforms
- Decided to attempt doing the work in house with contractors….. Per project prior to Connect required 1-2 programmers @ $95/per hour they were hired for 6-8 months, roughly cost savings is $104K per project – could not quantify the overhead related to systems Assuming 26 weeks in a 6 month period
- Open source isn’t also free too, you are just shifting where you pay