Data Driven Advanced Analytics using Denodo Platform on AWS

Denodo
Denodo Denodo
Data Driven Advanced Analytics using Denodo Platform on AWS
Agenda
1. Introduction to Data Driven Everything on AWS
2. Challenges with Data Driven Cloud Modernization
3. Addressing Challenges with Denodo Platform for AWS
4. Denodo Platform Use Cases and Data Architectures.
5. Key Takeaways | Q&A
3
Modernizing leads to maximum innovation velocity and optimal
total cost of ownership
On-premises Lift
and shift
Move to managed
databases
Modernize with
purpose-built
databases
Innovation
velocity
Total
cost of
ownership
(TCO)
Break-free from
legacy databases
4
5
6
What are customers building?
Backup &
restore
Non-disruptive
Easy place to start
Integrated with all
major vendors
Archive &
compliance
Media workflows
Tape replacement
Public Sector,
FinServ,
Healthcare/Life
Sciences
Home
directories
Simple to move
Not sensitive to
latency
Significant cost
savings
Data lakes
Variety of analytics
tools
Built for
streaming data
Data visualization
Business-
critical
applications
Integrated with
major vendors
Fully managed
infrastructure
Lift-and-shift
migrations
7
AWS Customer- Analytics Challenges in a Distributed Data Landscape
Point-to-point data integration approaches are
challenging:
§ Extracting and moving data increases latency
and cost, and decreases quality, thus lacking
unified data access
§ Every project solves data access and
integration in a different way, increasing IT
dependency
§ Solutions are tightly coupled to data sources,
impacting flexibility, agility and overall
governance
DATA
SOURCE
DATA
CONSUMER
Data
Governance
Tools
DB, DW &
Data Lakes
Files
BI Dashboard
Report and Tools
Data Science &
Machine Learning
Apps
Mobile &
Enterprise Apps
Microservices
Apps
Cloud DB
& SaaS
Streaming
Data & IoT
Cube
8
• The business wants more useful data
• Timely, curated, usable
• IT can’t keep up
• 67% of companies use less than half
of their data*
• IT stuck in old school thinking about data
management
• ‘Business as usual’
The ‘Useful Data’ Gap
* Source: Denodo Global Cloud Survey 2022
9
AWS Analytics Data Strategy, Keynote
Remember, re:Invent 2022
10
10
Businesses need a new approach to
connect data silos in real-time to
support various applications, insights,
and analytics.
11
Modern Data Architectural Patterns & Data Driven Analytics
Data Mesh
Data Lakehouse
Data Lake
Data Fabric
Cloud Data Warehouse
12
Real World Data Lake Example – AWS
Trusted Data Zone
Raw Data Zone Refined Data Zone
Transformation Transformation Data Consumers
Networking, Infrastructure & Security
Data Ingestion
Data
Sources
Data Catalog and Search – Asset Registry Workflow Orchestration, DevOps and CI/CD
13
Denodo + AWS – Simple and Complementary Recipe!
• Embrace distributed data landscape
• Embrace the fact that data resides in multiple
locations or systems – on-prem, hybrid, multi-
cloud. All data needs to be managed with
consistency
• Use a Logical approach to manage it
• Consumers access data through a centralized
semantic model, decoupled from data location
and physical schemas, that can enforce security
and governance requirements
14
Denodo Platform: ONE Logical Platform for All Your Data
Ease of Use Fast Query
Response
Integrated,
Active Data Catalog
Universal
Connectivity
Modern Data
Services API Layer
Dynamic Data
Masking
Automated Cloud
Management
Key Differentiators
83% reduction
in time-to-revenue
67% reduction
in data preparation effort
65% decrease
in delivery times over ETL
Source: Forrester Total Economic ImpactTM of Data
Virtualization, 2021
Hybrid/
Multi-Cloud
Security &
Governance
Al/ML
Recommendations
Advanced
Semantics
Data Catalog
Discover / Explore /
Document
BI Tools
SQL / MDX
Data Science
Tools
Data as a Service
RESTful / Odata
GraphQL/ GeoJSON
Files
Cubes
Cloud
Stores
Traditional
DB & DW
INTEGRATE
MANAGE
DELIVER
Disparate data in
any location, format
or latency
Related data with a universal
semantic model and AI / ML
functionality enabling vital
data governance
And democratize data using
BI & data science tools,
data catalogs, and APIs
Data Lake &
NoSQL
Query
Optimization &
Acceleration
On-
Premise
Transition
to Cloud
Hybrid
Multi-
Cloud
Stages of the Cloud Journey
•
•
•
•
•
•
•
Transition (or Migration) to the Cloud Challenges
17
Reduce the Business Impact
1 - Transition to the AWS Cloud (Minimize Business Disruption)
Business Need
§ Transition to cloud – migrate
EDW
§ Real-time analytics from Business
Users and Data Scientists
§ Security and governance across
multiple analytical tools need to be
centralized
§ Acts as a single semantic layer
§ Homogeneous data access regardless of
back-end technology
§ No need to deal with new languages and
APIs: access to SFDC, Excel, Amazon
Redshift, Oracle, Hadoop, other SaaS
APIs, etc.
§ Consistent business data model across all
consumers and reporting tools
§ Reusability of analytical objects across
multiple tools and consuming applications
§ Abstracts access to disparate data sources
§ Change in the data sources buffered
minimizing the impact on consumer
business applications
§ New technology adoption with minimal
impact on the business
§ Minimizes impact on consumers
§ Minimizes cross-environment connectivity
§ reducing risks of unauthorized access to
data
§ Amazon Athena
§ Amazon S3 Buckets
§ Amazon Redshift
§ Amazon Aurora
§ AWS PaaS - RDBMs
Denodo AWS
18
Transition to Cloud | Cloud Migration Acceleration
Denodo becomes the common access layer for all on-
premise and cloud systems:
Access to all data from a single system
The data can be accessed directly from the
original system, without the need for replication
The data can still be easily replicated and hidden
if necessary
Simplify data aggregation, regardless of the location or
format of the data
Allows semantic models definition, independent of
the original formats and structures
Advanced security for all data
Documentation and usage statistics included in the
Data Catalog
•
•
•
•
Hybrid (Cloud and On-Premise) Data Integration – Customer 360 / Single View
20
AWS Cloud Modernization - LeasePlan Data Hub Architecture
`
DATA
ACQUISITION
DATA
SOURCES
DATA
STORE (RAW)
ANALYTICS
WAREHOUSE
DATA
SCIENCE
DATA
FABRIC
DATA
CONSUMER
Next Gen Data Management (Meta-data, data quality, governance)
Meta data management, data quality, data governance as central components guarding the overall
data-asset of the corporation to allow trusted access to data for utilisation across the enterprise
Structured
Unstructured
ETL/ELT
ORCHESTRATION
STREAMING
Native Extraction
No ETL Tool(s)
AWS
Kinesis
Airflow
SAP BW/4HANA +
HANA Native
Raw
Quality
Integration
Consumption
Glacier
Archive
BW/4HANA +
HANA Native
NG Finance 1
NG Insurance
NG Procurement
NG Marketing
NG Sales
NG Service
NG Commerce
NG Fleet Ops
NG Supplier
Engagement
NG Policy Mgt.
NG Portals
NG Contact Center
Legacy – NOLS/
DB2/AS400 etc.
Other External Data:
Telematics, IoT, GA,
Social feeds,
streams
Analytics for
Cloud
Analysis for Office
AWS
SageMaker
Power BI
Role Based Access
Control
Caching
21
Take the right decision on accurate data
2 - Real-Time Analytics for Business Users
Business Need
§ Transition to cloud – migrate EDW
§ Real-time analysis from
Business Users and Data
Scientists
§ Security and governance across
multiple analytical tools need to be
centralized
§ Enables Self-Service BI
§ IT delivers a governed layer of “business
views” to business users
§ Business users can generate any report
over those IT-governed business views
§ Business views can be adapted for every
type of user making use of the same
terminology and naming conventions for
every Line of Business
§ Incorporate geospatial, IoT, and
other streaming data, to enable
real-time data services
§ Accelerate cloud analytics with Amazon’s
elastic infrastructure (EC2, auto-scaling)
§ Data is immediately available for use
without delays
§ Integrate and Manage data across
Amazon Redshift, Amazon RDS,
Amazon S3 in real-time to drive
advanced analytics
§ Source data to Amazon Lambda
serverless processes and expose them
as data source for BI-Analytics
§ Visualize data and reports in real time
with QuickSights
Denodo AWS
22
How Does Denodo Platform Work?
Development
Lifecycle Mgmt
Monitoring & Audit
Governance
Security
Development Tools
and SDK
Scheduled Tasks
Data Caching
Query Optimizer
JDBC/ODBC/ADO.Net SOAP / REST WS
U
Customer 360
View
Virtual Data
Mart View
J
Application
Layer
Business
Layer
Unified View Unified View
Unified View
Unified View
A
J
J
Derived View Derived View
J
J
S
Transformation
& Cleansing
Data
Source
Layer
Base
View
Base
View
Base
View
Base
View
Base
View
Base
View
Base
View
Abstraction
23
FAA – Federal Aviation Administration – Streamline Operations/Analytics
ü Reduced the IT Operations Cost by 99.8%,
while accelerating data access by 96%.
ü To reduce costs and streamline IT operations,
the U.S. Federal Aviation Administration (FAA)
wanted to consolidate multiple IT
organizations – each supporting different
mission areas – into a single office reporting
to a single CIO.
FAA leveraged the Denodo platform on AWS to:
24
Across multiple analytical tools
3 - Centralized Security and Governance
Business Need
§ Transition to cloud – migrate EDW
§ Real-time analytics from Business
Users and Data Scientists
§ Security and governance across
multiple analytical tools need to
be centralized
§ Unified Security Layer
§ Global Tag-based Policy Engine
§ Role-based authorization to all tables in
the virtual layer (RBAC)
§ Attribute-based access control (ABAC)
§ Security is moved outside the reporting
layer to avoid security bypasses
§ Centralized access point simplifies
operations and auditing
§ Data Masking / Obfuscation
§ Centralized Governance Layer
§ Centralized metadata catalog accessible
for both technical and business users
§ Data Source refresh, change impact
analysis, full data lineage, etc.
§ Protects data sources from uncontrolled
access through query throttling, limiting
#concurrent queries over them, limiting
resulting datasets sizes, enabling the cache
for minimizing the access to data sources for
some views, etc.
Denodo AWS Services
§ Datawarehouse Built for the cloud
§ Athena
§ Redshift
§ Secured, Managed Access
§ With Amazon Resource Manager
§ Identity Management & SSO Amazon
IAM
25
Data Fabric Overview
Core Principles:
ü Data Integration
ü Data Governance
ü Data Democratization
ü Data Intelligence
ü Data Interoperability
26
Data Mesh Powered by Denodo Data Virtualization
SQL
Operational EDW
Data Lakes Files
SaaS APIs
REST GraphQL OData
Event
Product
Customer Location Employee
Common Domain Event Management Human Resources
MDX
2.Domains connect
their data sources
❷
1.Each domain is given a
separate virtual schema.
A common domain may be
useful to centralized data
products common across
domains
❶
3.Metadata is mapped
to relational views.
No data is replicated
❸
4.Domains SMEs can
model their Data
Products.
Products can be used to
define other products
❹
5.For execution, Products can
be served directly from
their sources, or replicated
to a central location, like a
lake
❺
6.A central team can
set guidelines and
governance to
ensure
interoperability
❻
7.Products can be access via
SQL, MDX or exposed as an
API. No coding is required
❼ 8.Infrastructure can
easily scale out in a
cluster
❽
New architectural paradigm for data management | distributed organizational paradigm | Domains in charge of Data Products
27
Data Fabric & Data Mesh Powered by Data Virtualization
Summary and Takeaways
Benefits of Logical Data Architectures
Benefits of a Logical Data Architecture
“Now, we can do weekly releases.
We’re able to add new data sources
within 2 to 3 hours. We’re about 60%
faster than we were in the old world.”
VP of data and analytics, real estate
“To me, it all boils down to speed to
insights. Not having to wait to get the
question that you have top-of-mind
answered with data is huge.”
VP of data and analytics, real estate
29
30
Try Denodo Platform on AWS – Get Started Today!
• 30 days Free Trial of Denodo Professional via AWS Marketplace
• AWS Marketplace Transactable Pay-Go/Private Offers
• Denodo – AWS Test Drives (free hands-on learning in 2 hours) :
Denodo-AWS BI
Denodo-AWS Data Science
Visit Denodo Platform and AWS
https://www.denodo.com/en/denodo-platform/denodo-platform-for-aws
Q&A
Thanks!
www.denodo.com info@denodo.com
© Copyright Denodo Technologies. All rights reserved
Unless otherwise specified, no part of this PDF file may be reproduced or utilized in any for or by any means, electronic or mechanical, including photocopying and microfilm,
without prior the written authorization from Denodo Technologies.
1 sur 32

Recommandé

Modern Data Management for Federal Modernization par
Modern Data Management for Federal ModernizationModern Data Management for Federal Modernization
Modern Data Management for Federal ModernizationDenodo
218 vues24 diapositives
Simplifying Your Cloud Architecture with a Logical Data Fabric (APAC) par
Simplifying Your Cloud Architecture with a Logical Data Fabric (APAC)Simplifying Your Cloud Architecture with a Logical Data Fabric (APAC)
Simplifying Your Cloud Architecture with a Logical Data Fabric (APAC)Denodo
103 vues33 diapositives
Enabling Next Gen Analytics with Azure Data Lake and StreamSets par
Enabling Next Gen Analytics with Azure Data Lake and StreamSetsEnabling Next Gen Analytics with Azure Data Lake and StreamSets
Enabling Next Gen Analytics with Azure Data Lake and StreamSetsStreamsets Inc.
1.1K vues23 diapositives
Cloud Migration headache? Ease the pain with Data Virtualization! (EMEA) par
Cloud Migration headache? Ease the pain with Data Virtualization! (EMEA)Cloud Migration headache? Ease the pain with Data Virtualization! (EMEA)
Cloud Migration headache? Ease the pain with Data Virtualization! (EMEA)Denodo
121 vues26 diapositives
Data Virtualization: Introduction and Business Value (UK) par
Data Virtualization: Introduction and Business Value (UK)Data Virtualization: Introduction and Business Value (UK)
Data Virtualization: Introduction and Business Value (UK)Denodo
159 vues23 diapositives
Data Services and the Modern Data Ecosystem (ASEAN) par
Data Services and the Modern Data Ecosystem (ASEAN)Data Services and the Modern Data Ecosystem (ASEAN)
Data Services and the Modern Data Ecosystem (ASEAN)Denodo
311 vues39 diapositives

Contenu connexe

Similaire à Data Driven Advanced Analytics using Denodo Platform on AWS

Fast Data Strategy Houston Roadshow Presentation par
Fast Data Strategy Houston Roadshow PresentationFast Data Strategy Houston Roadshow Presentation
Fast Data Strategy Houston Roadshow PresentationDenodo
482 vues61 diapositives
Multi-Cloud Integration with Data Virtualization (ASEAN) par
Multi-Cloud Integration with Data Virtualization (ASEAN)Multi-Cloud Integration with Data Virtualization (ASEAN)
Multi-Cloud Integration with Data Virtualization (ASEAN)Denodo
73 vues33 diapositives
Virtualisation de données : Enjeux, Usages & Bénéfices par
Virtualisation de données : Enjeux, Usages & BénéficesVirtualisation de données : Enjeux, Usages & Bénéfices
Virtualisation de données : Enjeux, Usages & BénéficesDenodo
119 vues31 diapositives
DAMA & Denodo Webinar: Modernizing Data Architecture Using Data Virtualization par
DAMA & Denodo Webinar: Modernizing Data Architecture Using Data Virtualization DAMA & Denodo Webinar: Modernizing Data Architecture Using Data Virtualization
DAMA & Denodo Webinar: Modernizing Data Architecture Using Data Virtualization Denodo
140 vues38 diapositives
Slides-Discover-Power-of-Live-Data(2).pdf par
Slides-Discover-Power-of-Live-Data(2).pdfSlides-Discover-Power-of-Live-Data(2).pdf
Slides-Discover-Power-of-Live-Data(2).pdfbutthead7
2 vues15 diapositives
(ENT211) Migrating the US Government to the Cloud | AWS re:Invent 2014 par
(ENT211) Migrating the US Government to the Cloud | AWS re:Invent 2014(ENT211) Migrating the US Government to the Cloud | AWS re:Invent 2014
(ENT211) Migrating the US Government to the Cloud | AWS re:Invent 2014Amazon Web Services
1.3K vues17 diapositives

Similaire à Data Driven Advanced Analytics using Denodo Platform on AWS(20)

Fast Data Strategy Houston Roadshow Presentation par Denodo
Fast Data Strategy Houston Roadshow PresentationFast Data Strategy Houston Roadshow Presentation
Fast Data Strategy Houston Roadshow Presentation
Denodo 482 vues
Multi-Cloud Integration with Data Virtualization (ASEAN) par Denodo
Multi-Cloud Integration with Data Virtualization (ASEAN)Multi-Cloud Integration with Data Virtualization (ASEAN)
Multi-Cloud Integration with Data Virtualization (ASEAN)
Denodo 73 vues
Virtualisation de données : Enjeux, Usages & Bénéfices par Denodo
Virtualisation de données : Enjeux, Usages & BénéficesVirtualisation de données : Enjeux, Usages & Bénéfices
Virtualisation de données : Enjeux, Usages & Bénéfices
Denodo 119 vues
DAMA & Denodo Webinar: Modernizing Data Architecture Using Data Virtualization par Denodo
DAMA & Denodo Webinar: Modernizing Data Architecture Using Data Virtualization DAMA & Denodo Webinar: Modernizing Data Architecture Using Data Virtualization
DAMA & Denodo Webinar: Modernizing Data Architecture Using Data Virtualization
Denodo 140 vues
Slides-Discover-Power-of-Live-Data(2).pdf par butthead7
Slides-Discover-Power-of-Live-Data(2).pdfSlides-Discover-Power-of-Live-Data(2).pdf
Slides-Discover-Power-of-Live-Data(2).pdf
butthead72 vues
(ENT211) Migrating the US Government to the Cloud | AWS re:Invent 2014 par Amazon Web Services
(ENT211) Migrating the US Government to the Cloud | AWS re:Invent 2014(ENT211) Migrating the US Government to the Cloud | AWS re:Invent 2014
(ENT211) Migrating the US Government to the Cloud | AWS re:Invent 2014
Big Data: It’s all about the Use Cases par James Serra
Big Data: It’s all about the Use CasesBig Data: It’s all about the Use Cases
Big Data: It’s all about the Use Cases
James Serra9.1K vues
A Successful Journey to the Cloud with Data Virtualization par Denodo
A Successful Journey to the Cloud with Data VirtualizationA Successful Journey to the Cloud with Data Virtualization
A Successful Journey to the Cloud with Data Virtualization
Denodo 116 vues
ADV Slides: The Evolution of the Data Platform and What It Means to Enterpris... par DATAVERSITY
ADV Slides: The Evolution of the Data Platform and What It Means to Enterpris...ADV Slides: The Evolution of the Data Platform and What It Means to Enterpris...
ADV Slides: The Evolution of the Data Platform and What It Means to Enterpris...
DATAVERSITY829 vues
Azure Overview Csco par rajramab
Azure Overview CscoAzure Overview Csco
Azure Overview Csco
rajramab670 vues
Reinventing and Simplifying Data Management for a Successful Hybrid and Multi... par Denodo
Reinventing and Simplifying Data Management for a Successful Hybrid and Multi...Reinventing and Simplifying Data Management for a Successful Hybrid and Multi...
Reinventing and Simplifying Data Management for a Successful Hybrid and Multi...
Denodo 231 vues
Govern and Protect Your End User Information par Denodo
Govern and Protect Your End User InformationGovern and Protect Your End User Information
Govern and Protect Your End User Information
Denodo 212 vues
Dr. Christian Kurze from Denodo, "Data Virtualization: Fulfilling the Promise... par Dataconomy Media
Dr. Christian Kurze from Denodo, "Data Virtualization: Fulfilling the Promise...Dr. Christian Kurze from Denodo, "Data Virtualization: Fulfilling the Promise...
Dr. Christian Kurze from Denodo, "Data Virtualization: Fulfilling the Promise...
Dataconomy Media1.1K vues
Introduction to Modern Data Virtualization (US) par Denodo
Introduction to Modern Data Virtualization (US)Introduction to Modern Data Virtualization (US)
Introduction to Modern Data Virtualization (US)
Denodo 140 vues
ACdP Fiware.pdf par MASSAL3
ACdP Fiware.pdfACdP Fiware.pdf
ACdP Fiware.pdf
MASSAL318 vues
Delivering Data Democratization in the Cloud with Snowflake par Kent Graziano
Delivering Data Democratization in the Cloud with SnowflakeDelivering Data Democratization in the Cloud with Snowflake
Delivering Data Democratization in the Cloud with Snowflake
Kent Graziano801 vues
Windowsazureplatform Overviewlatest par rajramab
Windowsazureplatform OverviewlatestWindowsazureplatform Overviewlatest
Windowsazureplatform Overviewlatest
rajramab654 vues

Plus de Denodo

Mastering Cloud Data Cost Control: A FinOps Approach par
Mastering Cloud Data Cost Control: A FinOps ApproachMastering Cloud Data Cost Control: A FinOps Approach
Mastering Cloud Data Cost Control: A FinOps ApproachDenodo
4 vues24 diapositives
Data Services and Data Mesh projects made easy using Top-Down Modeling par
Data Services and Data Mesh projects made easy using Top-Down ModelingData Services and Data Mesh projects made easy using Top-Down Modeling
Data Services and Data Mesh projects made easy using Top-Down ModelingDenodo
3 vues1 diapositive
Lunch and Learn ANZ: Data Accessibility: The key to Industrialising Decision ... par
Lunch and Learn ANZ: Data Accessibility: The key to Industrialising Decision ...Lunch and Learn ANZ: Data Accessibility: The key to Industrialising Decision ...
Lunch and Learn ANZ: Data Accessibility: The key to Industrialising Decision ...Denodo
3 vues38 diapositives
Top Five Strategies for Modernizing Your Data Architecture (ASEAN) par
Top Five Strategies for Modernizing Your Data Architecture (ASEAN)Top Five Strategies for Modernizing Your Data Architecture (ASEAN)
Top Five Strategies for Modernizing Your Data Architecture (ASEAN)Denodo
7 vues29 diapositives
Mitigating Risk and Ensuring Compliance in Finance Using a Robust Data Govern... par
Mitigating Risk and Ensuring Compliance in Finance Using a Robust Data Govern...Mitigating Risk and Ensuring Compliance in Finance Using a Robust Data Govern...
Mitigating Risk and Ensuring Compliance in Finance Using a Robust Data Govern...Denodo
2 vues22 diapositives
MasterClass Series: Unlocking Data Sharing Velocity with Data Virtualization par
MasterClass Series: Unlocking Data Sharing Velocity with Data VirtualizationMasterClass Series: Unlocking Data Sharing Velocity with Data Virtualization
MasterClass Series: Unlocking Data Sharing Velocity with Data VirtualizationDenodo
3 vues21 diapositives

Plus de Denodo (20)

Mastering Cloud Data Cost Control: A FinOps Approach par Denodo
Mastering Cloud Data Cost Control: A FinOps ApproachMastering Cloud Data Cost Control: A FinOps Approach
Mastering Cloud Data Cost Control: A FinOps Approach
Denodo 4 vues
Data Services and Data Mesh projects made easy using Top-Down Modeling par Denodo
Data Services and Data Mesh projects made easy using Top-Down ModelingData Services and Data Mesh projects made easy using Top-Down Modeling
Data Services and Data Mesh projects made easy using Top-Down Modeling
Denodo 3 vues
Lunch and Learn ANZ: Data Accessibility: The key to Industrialising Decision ... par Denodo
Lunch and Learn ANZ: Data Accessibility: The key to Industrialising Decision ...Lunch and Learn ANZ: Data Accessibility: The key to Industrialising Decision ...
Lunch and Learn ANZ: Data Accessibility: The key to Industrialising Decision ...
Denodo 3 vues
Top Five Strategies for Modernizing Your Data Architecture (ASEAN) par Denodo
Top Five Strategies for Modernizing Your Data Architecture (ASEAN)Top Five Strategies for Modernizing Your Data Architecture (ASEAN)
Top Five Strategies for Modernizing Your Data Architecture (ASEAN)
Denodo 7 vues
Mitigating Risk and Ensuring Compliance in Finance Using a Robust Data Govern... par Denodo
Mitigating Risk and Ensuring Compliance in Finance Using a Robust Data Govern...Mitigating Risk and Ensuring Compliance in Finance Using a Robust Data Govern...
Mitigating Risk and Ensuring Compliance in Finance Using a Robust Data Govern...
Denodo 2 vues
MasterClass Series: Unlocking Data Sharing Velocity with Data Virtualization par Denodo
MasterClass Series: Unlocking Data Sharing Velocity with Data VirtualizationMasterClass Series: Unlocking Data Sharing Velocity with Data Virtualization
MasterClass Series: Unlocking Data Sharing Velocity with Data Virtualization
Denodo 3 vues
Data Fabric e Chat GPT - Unindo forças para a verdadeira democratização no ac... par Denodo
Data Fabric e Chat GPT - Unindo forças para a verdadeira democratização no ac...Data Fabric e Chat GPT - Unindo forças para a verdadeira democratização no ac...
Data Fabric e Chat GPT - Unindo forças para a verdadeira democratização no ac...
Denodo 7 vues
La gestione logica dei dati come chiave del successo per Data Scientist e Bus... par Denodo
La gestione logica dei dati come chiave del successo per Data Scientist e Bus...La gestione logica dei dati come chiave del successo per Data Scientist e Bus...
La gestione logica dei dati come chiave del successo per Data Scientist e Bus...
Denodo 5 vues
Partner Engagement Webinar Series: Highlights from DataFest North America par Denodo
Partner Engagement Webinar Series: Highlights from DataFest North AmericaPartner Engagement Webinar Series: Highlights from DataFest North America
Partner Engagement Webinar Series: Highlights from DataFest North America
Denodo 3 vues
Построение Data Mesh на основе Виртуальных Данных par Denodo
Построение Data Mesh на основе Виртуальных ДанныхПостроение Data Mesh на основе Виртуальных Данных
Построение Data Mesh на основе Виртуальных Данных
Denodo 8 vues
Achieving Self-service Analytics with a Governed Data Services Layer par Denodo
Achieving Self-service Analytics with a Governed Data Services LayerAchieving Self-service Analytics with a Governed Data Services Layer
Achieving Self-service Analytics with a Governed Data Services Layer
Denodo 11 vues
Top Five Strategies for Modernizing Your Data Architecture par Denodo
Top Five Strategies for Modernizing Your Data ArchitectureTop Five Strategies for Modernizing Your Data Architecture
Top Five Strategies for Modernizing Your Data Architecture
Denodo 6 vues
Tackling Data Risks Head-On: The Potential of Data Virtualization par Denodo
Tackling Data Risks Head-On: The Potential of Data VirtualizationTackling Data Risks Head-On: The Potential of Data Virtualization
Tackling Data Risks Head-On: The Potential of Data Virtualization
Denodo 8 vues
Green Data : à l'ère de l'emballement digital, comment engager la transition ... par Denodo
Green Data : à l'ère de l'emballement digital, comment engager la transition ...Green Data : à l'ère de l'emballement digital, comment engager la transition ...
Green Data : à l'ère de l'emballement digital, comment engager la transition ...
Denodo 10 vues
Denodo & FIN Cockpit (application de la virtualisation des données à la Finan... par Denodo
Denodo & FIN Cockpit (application de la virtualisation des données à la Finan...Denodo & FIN Cockpit (application de la virtualisation des données à la Finan...
Denodo & FIN Cockpit (application de la virtualisation des données à la Finan...
Denodo 20 vues
How to build Virtual Data Products in Denodo par Denodo
How to build Virtual Data Products in DenodoHow to build Virtual Data Products in Denodo
How to build Virtual Data Products in Denodo
Denodo 21 vues
Démonstration Denodo 8 par Denodo
Démonstration Denodo 8Démonstration Denodo 8
Démonstration Denodo 8
Denodo 7 vues
Modernizando o papel do Data Lake em uma arquitetura de Data Fabric par Denodo
Modernizando o papel do Data Lake em uma arquitetura de Data FabricModernizando o papel do Data Lake em uma arquitetura de Data Fabric
Modernizando o papel do Data Lake em uma arquitetura de Data Fabric
Denodo 28 vues
Importance of a Logical First Architecture in a Cloud First Data Landscape par Denodo
Importance of a Logical First Architecture in a Cloud First Data LandscapeImportance of a Logical First Architecture in a Cloud First Data Landscape
Importance of a Logical First Architecture in a Cloud First Data Landscape
Denodo 9 vues
Distributed Data Across Cloud and On-Premises: Opportunities and Challenges par Denodo
Distributed Data Across Cloud and On-Premises: Opportunities and ChallengesDistributed Data Across Cloud and On-Premises: Opportunities and Challenges
Distributed Data Across Cloud and On-Premises: Opportunities and Challenges
Denodo 13 vues

Dernier

SUPER STORE SQL PROJECT.pptx par
SUPER STORE SQL PROJECT.pptxSUPER STORE SQL PROJECT.pptx
SUPER STORE SQL PROJECT.pptxkhan888620
13 vues16 diapositives
OECD-Persol Holdings Workshop on Advancing Employee Well-being in Business an... par
OECD-Persol Holdings Workshop on Advancing Employee Well-being in Business an...OECD-Persol Holdings Workshop on Advancing Employee Well-being in Business an...
OECD-Persol Holdings Workshop on Advancing Employee Well-being in Business an...StatsCommunications
5 vues26 diapositives
LIVE OAK MEMORIAL PARK.pptx par
LIVE OAK MEMORIAL PARK.pptxLIVE OAK MEMORIAL PARK.pptx
LIVE OAK MEMORIAL PARK.pptxms2332always
7 vues6 diapositives
Infomatica-MDM.pptx par
Infomatica-MDM.pptxInfomatica-MDM.pptx
Infomatica-MDM.pptxKapil Rangwani
11 vues16 diapositives
[DSC Europe 23][AI:CSI] Dragan Pleskonjic - AI Impact on Cybersecurity and P... par
[DSC Europe 23][AI:CSI]  Dragan Pleskonjic - AI Impact on Cybersecurity and P...[DSC Europe 23][AI:CSI]  Dragan Pleskonjic - AI Impact on Cybersecurity and P...
[DSC Europe 23][AI:CSI] Dragan Pleskonjic - AI Impact on Cybersecurity and P...DataScienceConferenc1
8 vues36 diapositives
Data Journeys Hard Talk workshop final.pptx par
Data Journeys Hard Talk workshop final.pptxData Journeys Hard Talk workshop final.pptx
Data Journeys Hard Talk workshop final.pptxinfo828217
10 vues18 diapositives

Dernier(20)

SUPER STORE SQL PROJECT.pptx par khan888620
SUPER STORE SQL PROJECT.pptxSUPER STORE SQL PROJECT.pptx
SUPER STORE SQL PROJECT.pptx
khan88862013 vues
OECD-Persol Holdings Workshop on Advancing Employee Well-being in Business an... par StatsCommunications
OECD-Persol Holdings Workshop on Advancing Employee Well-being in Business an...OECD-Persol Holdings Workshop on Advancing Employee Well-being in Business an...
OECD-Persol Holdings Workshop on Advancing Employee Well-being in Business an...
[DSC Europe 23][AI:CSI] Dragan Pleskonjic - AI Impact on Cybersecurity and P... par DataScienceConferenc1
[DSC Europe 23][AI:CSI]  Dragan Pleskonjic - AI Impact on Cybersecurity and P...[DSC Europe 23][AI:CSI]  Dragan Pleskonjic - AI Impact on Cybersecurity and P...
[DSC Europe 23][AI:CSI] Dragan Pleskonjic - AI Impact on Cybersecurity and P...
Data Journeys Hard Talk workshop final.pptx par info828217
Data Journeys Hard Talk workshop final.pptxData Journeys Hard Talk workshop final.pptx
Data Journeys Hard Talk workshop final.pptx
info82821710 vues
Organic Shopping in Google Analytics 4.pdf par GA4 Tutorials
Organic Shopping in Google Analytics 4.pdfOrganic Shopping in Google Analytics 4.pdf
Organic Shopping in Google Analytics 4.pdf
GA4 Tutorials16 vues
[DSC Europe 23][AI:CSI] Aleksa Stojanovic - Applying AI for Threat Detection ... par DataScienceConferenc1
[DSC Europe 23][AI:CSI] Aleksa Stojanovic - Applying AI for Threat Detection ...[DSC Europe 23][AI:CSI] Aleksa Stojanovic - Applying AI for Threat Detection ...
[DSC Europe 23][AI:CSI] Aleksa Stojanovic - Applying AI for Threat Detection ...
Chapter 3b- Process Communication (1) (1)(1) (1).pptx par ayeshabaig2004
Chapter 3b- Process Communication (1) (1)(1) (1).pptxChapter 3b- Process Communication (1) (1)(1) (1).pptx
Chapter 3b- Process Communication (1) (1)(1) (1).pptx
[DSC Europe 23] Danijela Horak - The Innovator’s Dilemma: to Build or Not to ... par DataScienceConferenc1
[DSC Europe 23] Danijela Horak - The Innovator’s Dilemma: to Build or Not to ...[DSC Europe 23] Danijela Horak - The Innovator’s Dilemma: to Build or Not to ...
[DSC Europe 23] Danijela Horak - The Innovator’s Dilemma: to Build or Not to ...
[DSC Europe 23] Predrag Ilic & Simeon Rilling - From Data Lakes to Data Mesh ... par DataScienceConferenc1
[DSC Europe 23] Predrag Ilic & Simeon Rilling - From Data Lakes to Data Mesh ...[DSC Europe 23] Predrag Ilic & Simeon Rilling - From Data Lakes to Data Mesh ...
[DSC Europe 23] Predrag Ilic & Simeon Rilling - From Data Lakes to Data Mesh ...
CRM stick or twist workshop par info828217
CRM stick or twist workshopCRM stick or twist workshop
CRM stick or twist workshop
info82821711 vues

Data Driven Advanced Analytics using Denodo Platform on AWS

  • 2. Agenda 1. Introduction to Data Driven Everything on AWS 2. Challenges with Data Driven Cloud Modernization 3. Addressing Challenges with Denodo Platform for AWS 4. Denodo Platform Use Cases and Data Architectures. 5. Key Takeaways | Q&A
  • 3. 3 Modernizing leads to maximum innovation velocity and optimal total cost of ownership On-premises Lift and shift Move to managed databases Modernize with purpose-built databases Innovation velocity Total cost of ownership (TCO) Break-free from legacy databases
  • 4. 4
  • 5. 5
  • 6. 6 What are customers building? Backup & restore Non-disruptive Easy place to start Integrated with all major vendors Archive & compliance Media workflows Tape replacement Public Sector, FinServ, Healthcare/Life Sciences Home directories Simple to move Not sensitive to latency Significant cost savings Data lakes Variety of analytics tools Built for streaming data Data visualization Business- critical applications Integrated with major vendors Fully managed infrastructure Lift-and-shift migrations
  • 7. 7 AWS Customer- Analytics Challenges in a Distributed Data Landscape Point-to-point data integration approaches are challenging: § Extracting and moving data increases latency and cost, and decreases quality, thus lacking unified data access § Every project solves data access and integration in a different way, increasing IT dependency § Solutions are tightly coupled to data sources, impacting flexibility, agility and overall governance DATA SOURCE DATA CONSUMER Data Governance Tools DB, DW & Data Lakes Files BI Dashboard Report and Tools Data Science & Machine Learning Apps Mobile & Enterprise Apps Microservices Apps Cloud DB & SaaS Streaming Data & IoT Cube
  • 8. 8 • The business wants more useful data • Timely, curated, usable • IT can’t keep up • 67% of companies use less than half of their data* • IT stuck in old school thinking about data management • ‘Business as usual’ The ‘Useful Data’ Gap * Source: Denodo Global Cloud Survey 2022
  • 9. 9 AWS Analytics Data Strategy, Keynote Remember, re:Invent 2022
  • 10. 10 10 Businesses need a new approach to connect data silos in real-time to support various applications, insights, and analytics.
  • 11. 11 Modern Data Architectural Patterns & Data Driven Analytics Data Mesh Data Lakehouse Data Lake Data Fabric Cloud Data Warehouse
  • 12. 12 Real World Data Lake Example – AWS Trusted Data Zone Raw Data Zone Refined Data Zone Transformation Transformation Data Consumers Networking, Infrastructure & Security Data Ingestion Data Sources Data Catalog and Search – Asset Registry Workflow Orchestration, DevOps and CI/CD
  • 13. 13 Denodo + AWS – Simple and Complementary Recipe! • Embrace distributed data landscape • Embrace the fact that data resides in multiple locations or systems – on-prem, hybrid, multi- cloud. All data needs to be managed with consistency • Use a Logical approach to manage it • Consumers access data through a centralized semantic model, decoupled from data location and physical schemas, that can enforce security and governance requirements
  • 14. 14 Denodo Platform: ONE Logical Platform for All Your Data Ease of Use Fast Query Response Integrated, Active Data Catalog Universal Connectivity Modern Data Services API Layer Dynamic Data Masking Automated Cloud Management Key Differentiators 83% reduction in time-to-revenue 67% reduction in data preparation effort 65% decrease in delivery times over ETL Source: Forrester Total Economic ImpactTM of Data Virtualization, 2021 Hybrid/ Multi-Cloud Security & Governance Al/ML Recommendations Advanced Semantics Data Catalog Discover / Explore / Document BI Tools SQL / MDX Data Science Tools Data as a Service RESTful / Odata GraphQL/ GeoJSON Files Cubes Cloud Stores Traditional DB & DW INTEGRATE MANAGE DELIVER Disparate data in any location, format or latency Related data with a universal semantic model and AI / ML functionality enabling vital data governance And democratize data using BI & data science tools, data catalogs, and APIs Data Lake & NoSQL Query Optimization & Acceleration
  • 17. 17 Reduce the Business Impact 1 - Transition to the AWS Cloud (Minimize Business Disruption) Business Need § Transition to cloud – migrate EDW § Real-time analytics from Business Users and Data Scientists § Security and governance across multiple analytical tools need to be centralized § Acts as a single semantic layer § Homogeneous data access regardless of back-end technology § No need to deal with new languages and APIs: access to SFDC, Excel, Amazon Redshift, Oracle, Hadoop, other SaaS APIs, etc. § Consistent business data model across all consumers and reporting tools § Reusability of analytical objects across multiple tools and consuming applications § Abstracts access to disparate data sources § Change in the data sources buffered minimizing the impact on consumer business applications § New technology adoption with minimal impact on the business § Minimizes impact on consumers § Minimizes cross-environment connectivity § reducing risks of unauthorized access to data § Amazon Athena § Amazon S3 Buckets § Amazon Redshift § Amazon Aurora § AWS PaaS - RDBMs Denodo AWS
  • 18. 18 Transition to Cloud | Cloud Migration Acceleration Denodo becomes the common access layer for all on- premise and cloud systems: Access to all data from a single system The data can be accessed directly from the original system, without the need for replication The data can still be easily replicated and hidden if necessary Simplify data aggregation, regardless of the location or format of the data Allows semantic models definition, independent of the original formats and structures Advanced security for all data Documentation and usage statistics included in the Data Catalog
  • 19. • • • • Hybrid (Cloud and On-Premise) Data Integration – Customer 360 / Single View
  • 20. 20 AWS Cloud Modernization - LeasePlan Data Hub Architecture ` DATA ACQUISITION DATA SOURCES DATA STORE (RAW) ANALYTICS WAREHOUSE DATA SCIENCE DATA FABRIC DATA CONSUMER Next Gen Data Management (Meta-data, data quality, governance) Meta data management, data quality, data governance as central components guarding the overall data-asset of the corporation to allow trusted access to data for utilisation across the enterprise Structured Unstructured ETL/ELT ORCHESTRATION STREAMING Native Extraction No ETL Tool(s) AWS Kinesis Airflow SAP BW/4HANA + HANA Native Raw Quality Integration Consumption Glacier Archive BW/4HANA + HANA Native NG Finance 1 NG Insurance NG Procurement NG Marketing NG Sales NG Service NG Commerce NG Fleet Ops NG Supplier Engagement NG Policy Mgt. NG Portals NG Contact Center Legacy – NOLS/ DB2/AS400 etc. Other External Data: Telematics, IoT, GA, Social feeds, streams Analytics for Cloud Analysis for Office AWS SageMaker Power BI Role Based Access Control Caching
  • 21. 21 Take the right decision on accurate data 2 - Real-Time Analytics for Business Users Business Need § Transition to cloud – migrate EDW § Real-time analysis from Business Users and Data Scientists § Security and governance across multiple analytical tools need to be centralized § Enables Self-Service BI § IT delivers a governed layer of “business views” to business users § Business users can generate any report over those IT-governed business views § Business views can be adapted for every type of user making use of the same terminology and naming conventions for every Line of Business § Incorporate geospatial, IoT, and other streaming data, to enable real-time data services § Accelerate cloud analytics with Amazon’s elastic infrastructure (EC2, auto-scaling) § Data is immediately available for use without delays § Integrate and Manage data across Amazon Redshift, Amazon RDS, Amazon S3 in real-time to drive advanced analytics § Source data to Amazon Lambda serverless processes and expose them as data source for BI-Analytics § Visualize data and reports in real time with QuickSights Denodo AWS
  • 22. 22 How Does Denodo Platform Work? Development Lifecycle Mgmt Monitoring & Audit Governance Security Development Tools and SDK Scheduled Tasks Data Caching Query Optimizer JDBC/ODBC/ADO.Net SOAP / REST WS U Customer 360 View Virtual Data Mart View J Application Layer Business Layer Unified View Unified View Unified View Unified View A J J Derived View Derived View J J S Transformation & Cleansing Data Source Layer Base View Base View Base View Base View Base View Base View Base View Abstraction
  • 23. 23 FAA – Federal Aviation Administration – Streamline Operations/Analytics ü Reduced the IT Operations Cost by 99.8%, while accelerating data access by 96%. ü To reduce costs and streamline IT operations, the U.S. Federal Aviation Administration (FAA) wanted to consolidate multiple IT organizations – each supporting different mission areas – into a single office reporting to a single CIO. FAA leveraged the Denodo platform on AWS to:
  • 24. 24 Across multiple analytical tools 3 - Centralized Security and Governance Business Need § Transition to cloud – migrate EDW § Real-time analytics from Business Users and Data Scientists § Security and governance across multiple analytical tools need to be centralized § Unified Security Layer § Global Tag-based Policy Engine § Role-based authorization to all tables in the virtual layer (RBAC) § Attribute-based access control (ABAC) § Security is moved outside the reporting layer to avoid security bypasses § Centralized access point simplifies operations and auditing § Data Masking / Obfuscation § Centralized Governance Layer § Centralized metadata catalog accessible for both technical and business users § Data Source refresh, change impact analysis, full data lineage, etc. § Protects data sources from uncontrolled access through query throttling, limiting #concurrent queries over them, limiting resulting datasets sizes, enabling the cache for minimizing the access to data sources for some views, etc. Denodo AWS Services § Datawarehouse Built for the cloud § Athena § Redshift § Secured, Managed Access § With Amazon Resource Manager § Identity Management & SSO Amazon IAM
  • 25. 25 Data Fabric Overview Core Principles: ü Data Integration ü Data Governance ü Data Democratization ü Data Intelligence ü Data Interoperability
  • 26. 26 Data Mesh Powered by Denodo Data Virtualization SQL Operational EDW Data Lakes Files SaaS APIs REST GraphQL OData Event Product Customer Location Employee Common Domain Event Management Human Resources MDX 2.Domains connect their data sources ❷ 1.Each domain is given a separate virtual schema. A common domain may be useful to centralized data products common across domains ❶ 3.Metadata is mapped to relational views. No data is replicated ❸ 4.Domains SMEs can model their Data Products. Products can be used to define other products ❹ 5.For execution, Products can be served directly from their sources, or replicated to a central location, like a lake ❺ 6.A central team can set guidelines and governance to ensure interoperability ❻ 7.Products can be access via SQL, MDX or exposed as an API. No coding is required ❼ 8.Infrastructure can easily scale out in a cluster ❽ New architectural paradigm for data management | distributed organizational paradigm | Domains in charge of Data Products
  • 27. 27 Data Fabric & Data Mesh Powered by Data Virtualization
  • 28. Summary and Takeaways Benefits of Logical Data Architectures
  • 29. Benefits of a Logical Data Architecture “Now, we can do weekly releases. We’re able to add new data sources within 2 to 3 hours. We’re about 60% faster than we were in the old world.” VP of data and analytics, real estate “To me, it all boils down to speed to insights. Not having to wait to get the question that you have top-of-mind answered with data is huge.” VP of data and analytics, real estate 29
  • 30. 30 Try Denodo Platform on AWS – Get Started Today! • 30 days Free Trial of Denodo Professional via AWS Marketplace • AWS Marketplace Transactable Pay-Go/Private Offers • Denodo – AWS Test Drives (free hands-on learning in 2 hours) : Denodo-AWS BI Denodo-AWS Data Science Visit Denodo Platform and AWS https://www.denodo.com/en/denodo-platform/denodo-platform-for-aws
  • 31. Q&A
  • 32. Thanks! www.denodo.com info@denodo.com © Copyright Denodo Technologies. All rights reserved Unless otherwise specified, no part of this PDF file may be reproduced or utilized in any for or by any means, electronic or mechanical, including photocopying and microfilm, without prior the written authorization from Denodo Technologies.