SlideShare une entreprise Scribd logo
1  sur  33
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Silvia Wibowo
Solutions Architect
Pemahaman Pelanggan & Machine Learning
(Level 200 – 300)
Kenali Pelanggan Anda - Arsitektur Data Modern
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s go on a common customer journey
Meet EarEcstasy, as they move from B2B to B2C
* This case is representative of a common customer journey, but EarEcstasy isn’t an actual business
EarEcstasy manufacturers headsets. They ran
a traditional B2B business since 2005, selling
through distribution and retail channels.
2005
In 2018, they launched their first “Smart
Buds”. These wireless headsets have voice
enablement, GPS tracking, and heartrate
monitors built in, and the device syncs with
the users mobile phone via Bluetooth. The
mobile app also supports scene detection.
2018
EarEcstasy needs to answer new questions and move faster
Raymond, Head of ProductLim, Head of Finance
Which regions are the new earbuds selling well?
What is the demand forecast by product category?
What is the social sentiment about our products?
How do quality issues impact cost of production?
Can I look at supplier performance over time?
How can we reduce our inventory holding costs?
To answer new questions quickly, we look to a
modern data architecture design
Massive upfront costs
Overprovisioned capacity
Long implementation times
Pay as you go, for what you use
Decoupled pipelines and engines
Experimentation platform
Ingest/
Collect
Consume/
visualize
Store Process/
analyze
1 4
0 9
5
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Outcome 1: Modernize and consolidate
Start with a set of specific questions to answer, then work
backwards to the data required
Lim, Head of Finance
How do quality issues impact cost of production?
Can I look at supplier performance over time?
How can we reduce our inventory holding costs?
Order History /
Returns (CRM)
Inventory /
Production (ERP)
Ingest ServingData
sources
Modern data architecture
Insights to enhance business applications, new digital services
Transactions
ERP
Data analysts
DATA PIPELINES
Ingest/
Collect
Consume /
visualize
Store Process /
analyze
1 4
0 9
5
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Start small and iterate
Ingest ServingData
sources
Modern data architecture
Insights to enhance business applications, new digital services
Transactions
ERP
DATA PIPELINES
Data
Lake
expdp
Data Data analysts
Data Warehouse
Amazon Redshift
Direct Query
Amazon Athena
She asks for the SMALLEST amount of data to answer her questions.
If it isn’t good enough, she asks for another small slice to be loaded to the DATA LAKE
Amazon Redshift – Modern Data Warehousing
Fast, scalable, fully managed data warehouse at 1/10th the cost
Massively parallel, scales from gigabytes to exabytes
Queries data across your Redshift data warehouse and Amazon S3 data lake
Fast at scale
Columnar storage
technology to improve I/O
efficiency and scale query
performance
Open file formats
Analyze optimized data
formats on direct-attached
disks, and all open file
formats in S3
Cost-effective
Start at $0.25 per hour;
as low as $250-$333 per
uncompressed terabyte
per year
$
Secure
Audit everything; encrypt
data end-to-end; extensive
certification and compliance
Characteristics of a Data Lake
Future
Proof
Flexible
Access
Dive in
Anywhere
Collect
Anything
Start with a set of specific questions to answer, then work
backwards to the data required
Raymond, Head of Product
Which regions are the new earbuds selling well?
What is the demand forecast by product category?
What is the social sentiment about our products?
Trending /
Mentions (Social)
Order History /
Returns (CRM)
NOW IN THE DATA LAKE
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Experiment, validate, then scale
Ingest ServingData
sources
Modern data architecture
Insights to enhance business applications, new digital services
DATA PIPELINES
Data
Lake
He first looks to the DATA LAKE, and imports only the category data he needs
He imports JUST ENOUGH data to see if the market is responding to products.
Business users
Transactions
ERP
Social media
Data
Stream
Capture
Amazon
Kinesis
Events
Amazon
QuickSight
Data Warehouse
Amazon Redshift
Stream Data
Amazon
ElasticSearch
Common data pipeline configuration
Raw Data
Amazon S3
Highly decoupled configurations scale better, are more fault tolerant, and cost optimized
ETL (Hadoop)
Amazon EMR
Triggered Code
Amazon Lambda
Staged Data
(Data Lake)
Amazon S3
ETL & Catalog Management
AWS Glue
Data Warehouse
Amazon Redshift
Triggered Code
Amazon Lambda
Data security
and management
Encryption
Access Controls
Monitoring and Metrics
Audit Trails
Automation
Serverless Computing
Data Discovery and
Protection
Data Visualization
Data movement
Physical Appliances
Hybrid Storage
Private Networks
File Data
WAN Acceleration
Third-party Applications
Streaming Data
Complete set of building blocks
FileBlock
Object Archival
Storage types
Ingest ServingData
sources
Modern data architecture
Insights to enhance business applications, new digital services
Transactions
ERP
Data analysts
Business users
DATA PIPELINES
EVENT PIPELINES
Data
Event
Insights
Data
Lake
Social media
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Outcome 2: Innovate for new revenues
EarEcstasy has its first direct relationship with consumers
Krzysztof, Data ScientistBala, Head of Marketing
What are our customer segments, based on usage?
Can predict music preference from location and HR?
Are there additional signals in the voice commands?
Can we infer user activity, from scenes in pictures?
How are people using the Smart Buds?
How to understand what they listen to and when?
What kinds of people are in/decreasing usage?
Start with a set of specific questions to answer, then work
backwards to the data required
Bala, Head of Marketing
How are people using the Smart Buds?
How to understand what they listen to and when?
What kinds of people are in/decreasing usage?
Media
consumption
(Partner API)
Registration,
usage [time/place]
(Mobile app)
Start with a set of specific questions to answer, then work
backwards to the data required
Krzysztof, Data Scientist
What are our customer segments, based on usage?
Can predict music preference from location and HR?
Are there additional signals in the voice commands?
Can we infer user activity, from scenes in pictures?
HR, Voice, GPS,
Images (Device
data)
DATA LAKE, OR NOT?
Registration,
usage [time/place]
(Mobile app)
LOAD TO DATA LAKE
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Sandboxes - fast, cheap, low risk
Ingest ServingData
sources
Modern data architecture
Insights to enhance business applications, new digital services
Transactions
Data scientists
Business users
Connected
devices
DATA PIPELINES
EVENT PIPELINES
Data
Event
Insights
Data
Lake
Sandbox
ML / Analytics / DLWeb logs /
clickstream
Ingest ServingData
sources
Modern data architecture
Innovate for new revenues - personalization and forecasting
Transactions
ERP
Data analysts
Data scientists
Business users
Connected
devices
DATA PIPELINES
EVENT PIPELINES
Data
Event
Insights
Data
Lake
ML / Analytics
Social media
Web logs /
clickstream
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Outcome 3: Real-time engagement
EarEcstasy offers a personalized life soundtrack
Personalized, based on
past preferences,
people with similar behaviors,
and environments detected
Use EarEcstasy voice enablement to play music
I’m tired, play me
some music!
Amazon Transcribe
/ Comprehend
Action: PLAY
Category: MUSIC
Genre: <RECOMMEND>
Request content
HISTORY
Twenty One Pilots!
PEOPLE LIKE YOU
Amazon Kinesis
Streams
Connected device data
Location: <FIND GPS>
Mood: <FIND HR>
Use the mobile app to take a picture to identify
activity
A QUIET OFFICE
Amazon SageMaker
Image Classification
Amazon Rekognition
Image
CHAIR
LAPTOP
LAMP
DESK
97%
95%
88%
82%
Object Identification
WORKING!
<HISTORY>
Ingest ServingData
sources
Modern data architecture
Real-time engagement and interactive customer experiences
Transactions
ERP
Data analysts
Data scientists
Business users
Engagement platformsConnected
devices
Automation / events
DATA PIPELINES
EVENT PIPELINES
Data
Event Action
Insights
Data
Lake
ML / Analytics
Predict /
Recommend
AI Services
Social media
Web logs /
clickstream
Business Outcomes on a Modern Data Architecture
Outcome 1 : Modernize and consolidate
• Insights to enhance business applications and create new digital
services
Outcome 2 : Innovate for new revenues
• Personalization, demand forecasting, risk analysis
Outcome 3 : Real-time engagement
• Interactive customer experience, event-driven automation, fraud
detection
Ready to build better business from your ideas?
Short list projects that
directly impact
customer engagement
and adoption
Build simple data
pipelines that allow you
to test new ideas, and
fill your data lake
Ask our solution architects
and professional services
teams to help you build
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Thank you!

Contenu connexe

Tendances

Apache Hadoop India Summit 2011 talk "Informatica and Big Data" by Snajeev Kumar
Apache Hadoop India Summit 2011 talk "Informatica and Big Data" by Snajeev KumarApache Hadoop India Summit 2011 talk "Informatica and Big Data" by Snajeev Kumar
Apache Hadoop India Summit 2011 talk "Informatica and Big Data" by Snajeev KumarYahoo Developer Network
 
MongoDB_Spark
MongoDB_SparkMongoDB_Spark
MongoDB_SparkMat Keep
 
Growth hacking in the age of Data
Growth hacking in the age of DataGrowth hacking in the age of Data
Growth hacking in the age of DataDaniel Saito
 
Big Data LDN 2018: ACCELERATING YOUR ANALYTICS JOURNEY WITH REAL-TIME AI
Big Data LDN 2018: ACCELERATING YOUR ANALYTICS JOURNEY WITH REAL-TIME AIBig Data LDN 2018: ACCELERATING YOUR ANALYTICS JOURNEY WITH REAL-TIME AI
Big Data LDN 2018: ACCELERATING YOUR ANALYTICS JOURNEY WITH REAL-TIME AIMatt Stubbs
 
Transforming Your Data: A Worked Example
Transforming Your Data: A Worked ExampleTransforming Your Data: A Worked Example
Transforming Your Data: A Worked ExampleNeo4j
 
Big Data LDN 2018: THE THIRD REVOLUTION IN ANALYTICS
Big Data LDN 2018: THE THIRD REVOLUTION IN ANALYTICSBig Data LDN 2018: THE THIRD REVOLUTION IN ANALYTICS
Big Data LDN 2018: THE THIRD REVOLUTION IN ANALYTICSMatt Stubbs
 
Accelerate Digital Transformation Through AI-powered Cloud Analytics Moderniz...
Accelerate Digital Transformation Through AI-powered Cloud Analytics Moderniz...Accelerate Digital Transformation Through AI-powered Cloud Analytics Moderniz...
Accelerate Digital Transformation Through AI-powered Cloud Analytics Moderniz...Amazon Web Services
 
Customer Case Studies of Self-Service Big Data Analytics
Customer Case Studies of Self-Service Big Data AnalyticsCustomer Case Studies of Self-Service Big Data Analytics
Customer Case Studies of Self-Service Big Data AnalyticsDatameer
 
Data Culture London 12th April Keynote
Data Culture London 12th April KeynoteData Culture London 12th April Keynote
Data Culture London 12th April KeynoteJonathan Woodward
 
MongoDB World 2019: Managing a Heterogeneous Data Stack with Informatica and ...
MongoDB World 2019: Managing a Heterogeneous Data Stack with Informatica and ...MongoDB World 2019: Managing a Heterogeneous Data Stack with Informatica and ...
MongoDB World 2019: Managing a Heterogeneous Data Stack with Informatica and ...MongoDB
 
Big Data LDN 2017: How to leverage the cloud for Business Solutions
Big Data LDN 2017: How to leverage the cloud for Business SolutionsBig Data LDN 2017: How to leverage the cloud for Business Solutions
Big Data LDN 2017: How to leverage the cloud for Business SolutionsMatt Stubbs
 
Optimize your cloud strategy for machine learning and analytics
Optimize your cloud strategy for machine learning and analyticsOptimize your cloud strategy for machine learning and analytics
Optimize your cloud strategy for machine learning and analyticsCloudera, Inc.
 
Too Small to Get Hacked? Think Again (Webinar)
Too Small to Get Hacked? Think Again (Webinar)Too Small to Get Hacked? Think Again (Webinar)
Too Small to Get Hacked? Think Again (Webinar)OnRamp
 
Advanced Analytics and New Big Data
Advanced Analytics and New Big DataAdvanced Analytics and New Big Data
Advanced Analytics and New Big DataDataWorks Summit
 
Reveal the Intelligence in your Data with Talend Data Fabric
Reveal the Intelligence in your Data with Talend Data FabricReveal the Intelligence in your Data with Talend Data Fabric
Reveal the Intelligence in your Data with Talend Data FabricJean-Michel Franco
 
S ba0881 big-data-use-cases-pearson-edge2015-v7
S ba0881 big-data-use-cases-pearson-edge2015-v7S ba0881 big-data-use-cases-pearson-edge2015-v7
S ba0881 big-data-use-cases-pearson-edge2015-v7Tony Pearson
 
Big Data & Analytics Architecture
Big Data & Analytics ArchitectureBig Data & Analytics Architecture
Big Data & Analytics ArchitectureArvind Sathi
 

Tendances (20)

Apache Hadoop India Summit 2011 talk "Informatica and Big Data" by Snajeev Kumar
Apache Hadoop India Summit 2011 talk "Informatica and Big Data" by Snajeev KumarApache Hadoop India Summit 2011 talk "Informatica and Big Data" by Snajeev Kumar
Apache Hadoop India Summit 2011 talk "Informatica and Big Data" by Snajeev Kumar
 
Non-Relational Revolution
Non-Relational RevolutionNon-Relational Revolution
Non-Relational Revolution
 
MongoDB_Spark
MongoDB_SparkMongoDB_Spark
MongoDB_Spark
 
Growth hacking in the age of Data
Growth hacking in the age of DataGrowth hacking in the age of Data
Growth hacking in the age of Data
 
Big Data LDN 2018: ACCELERATING YOUR ANALYTICS JOURNEY WITH REAL-TIME AI
Big Data LDN 2018: ACCELERATING YOUR ANALYTICS JOURNEY WITH REAL-TIME AIBig Data LDN 2018: ACCELERATING YOUR ANALYTICS JOURNEY WITH REAL-TIME AI
Big Data LDN 2018: ACCELERATING YOUR ANALYTICS JOURNEY WITH REAL-TIME AI
 
Transforming Your Data: A Worked Example
Transforming Your Data: A Worked ExampleTransforming Your Data: A Worked Example
Transforming Your Data: A Worked Example
 
Big Data LDN 2018: THE THIRD REVOLUTION IN ANALYTICS
Big Data LDN 2018: THE THIRD REVOLUTION IN ANALYTICSBig Data LDN 2018: THE THIRD REVOLUTION IN ANALYTICS
Big Data LDN 2018: THE THIRD REVOLUTION IN ANALYTICS
 
Accelerate Digital Transformation Through AI-powered Cloud Analytics Moderniz...
Accelerate Digital Transformation Through AI-powered Cloud Analytics Moderniz...Accelerate Digital Transformation Through AI-powered Cloud Analytics Moderniz...
Accelerate Digital Transformation Through AI-powered Cloud Analytics Moderniz...
 
Customer Case Studies of Self-Service Big Data Analytics
Customer Case Studies of Self-Service Big Data AnalyticsCustomer Case Studies of Self-Service Big Data Analytics
Customer Case Studies of Self-Service Big Data Analytics
 
Data Culture London 12th April Keynote
Data Culture London 12th April KeynoteData Culture London 12th April Keynote
Data Culture London 12th April Keynote
 
MongoDB World 2019: Managing a Heterogeneous Data Stack with Informatica and ...
MongoDB World 2019: Managing a Heterogeneous Data Stack with Informatica and ...MongoDB World 2019: Managing a Heterogeneous Data Stack with Informatica and ...
MongoDB World 2019: Managing a Heterogeneous Data Stack with Informatica and ...
 
Big Data LDN 2017: How to leverage the cloud for Business Solutions
Big Data LDN 2017: How to leverage the cloud for Business SolutionsBig Data LDN 2017: How to leverage the cloud for Business Solutions
Big Data LDN 2017: How to leverage the cloud for Business Solutions
 
Optimize your cloud strategy for machine learning and analytics
Optimize your cloud strategy for machine learning and analyticsOptimize your cloud strategy for machine learning and analytics
Optimize your cloud strategy for machine learning and analytics
 
Too Small to Get Hacked? Think Again (Webinar)
Too Small to Get Hacked? Think Again (Webinar)Too Small to Get Hacked? Think Again (Webinar)
Too Small to Get Hacked? Think Again (Webinar)
 
Advanced Analytics and New Big Data
Advanced Analytics and New Big DataAdvanced Analytics and New Big Data
Advanced Analytics and New Big Data
 
Reveal the Intelligence in your Data with Talend Data Fabric
Reveal the Intelligence in your Data with Talend Data FabricReveal the Intelligence in your Data with Talend Data Fabric
Reveal the Intelligence in your Data with Talend Data Fabric
 
S ba0881 big-data-use-cases-pearson-edge2015-v7
S ba0881 big-data-use-cases-pearson-edge2015-v7S ba0881 big-data-use-cases-pearson-edge2015-v7
S ba0881 big-data-use-cases-pearson-edge2015-v7
 
Big Data & Analytics Architecture
Big Data & Analytics ArchitectureBig Data & Analytics Architecture
Big Data & Analytics Architecture
 
Deep Dive on Big Data
Deep Dive on Big Data Deep Dive on Big Data
Deep Dive on Big Data
 
How to Streamline DataOps on AWS
How to Streamline DataOps on AWSHow to Streamline DataOps on AWS
How to Streamline DataOps on AWS
 

Similaire à Pemahaman Pelanggan & Machine Learning (Level 200 – 300) | Kenali Pelanggan Anda - Arsitektur Data Modern

Data Analytics를 통한 비지니스 혁신::Craig Stries::AWS Summit Seoul 2018
Data Analytics를 통한 비지니스 혁신::Craig Stries::AWS Summit Seoul 2018Data Analytics를 통한 비지니스 혁신::Craig Stries::AWS Summit Seoul 2018
Data Analytics를 통한 비지니스 혁신::Craig Stries::AWS Summit Seoul 2018Amazon Web Services Korea
 
AWS Summit Singapore - Get to Know Your Customers - Modern Data Architecture
AWS Summit Singapore - Get to Know Your Customers - Modern Data ArchitectureAWS Summit Singapore - Get to Know Your Customers - Modern Data Architecture
AWS Summit Singapore - Get to Know Your Customers - Modern Data ArchitectureAmazon Web Services
 
AWS Summit Singapore - Get to Know Your Customers - Modern Data Architecture
AWS Summit Singapore - Get to Know Your Customers - Modern Data ArchitectureAWS Summit Singapore - Get to Know Your Customers - Modern Data Architecture
AWS Summit Singapore - Get to Know Your Customers - Modern Data ArchitectureAmazon Web Services
 
AWS Summit Webinar Edition | Modern Data Architecture | Microsoft Application...
AWS Summit Webinar Edition | Modern Data Architecture | Microsoft Application...AWS Summit Webinar Edition | Modern Data Architecture | Microsoft Application...
AWS Summit Webinar Edition | Modern Data Architecture | Microsoft Application...Amazon Web Services
 
Better Business From Exploring Ideas - AWS Summit Sydney 2018
Better Business From Exploring Ideas - AWS Summit Sydney 2018Better Business From Exploring Ideas - AWS Summit Sydney 2018
Better Business From Exploring Ideas - AWS Summit Sydney 2018Amazon Web Services
 
雲上打造資料湖 (Data Lake):智能化駕馭商機 (Level 300)
雲上打造資料湖 (Data Lake):智能化駕馭商機 (Level 300)雲上打造資料湖 (Data Lake):智能化駕馭商機 (Level 300)
雲上打造資料湖 (Data Lake):智能化駕馭商機 (Level 300)Amazon Web Services
 
Get to Know Your Customers - Build and Innovate with a Modern Data Architecture
Get to Know Your Customers - Build and Innovate with a Modern Data ArchitectureGet to Know Your Customers - Build and Innovate with a Modern Data Architecture
Get to Know Your Customers - Build and Innovate with a Modern Data ArchitectureAmazon Web Services
 
Preparing Your Data for Cloud Analytics & AI/ML
Preparing Your Data for Cloud Analytics & AI/ML Preparing Your Data for Cloud Analytics & AI/ML
Preparing Your Data for Cloud Analytics & AI/ML Amazon Web Services
 
Build and Innovate with a Modern Data Architecture
Build and Innovate with a Modern Data ArchitectureBuild and Innovate with a Modern Data Architecture
Build and Innovate with a Modern Data ArchitectureAmazon Web Services
 
An Overview of Machine Learning on AWS
An Overview of Machine Learning on AWSAn Overview of Machine Learning on AWS
An Overview of Machine Learning on AWSAmazon Web Services
 
Building a Data Lake in Amazon S3 & Amazon Glacier (STG401-R1) - AWS re:Inven...
Building a Data Lake in Amazon S3 & Amazon Glacier (STG401-R1) - AWS re:Inven...Building a Data Lake in Amazon S3 & Amazon Glacier (STG401-R1) - AWS re:Inven...
Building a Data Lake in Amazon S3 & Amazon Glacier (STG401-R1) - AWS re:Inven...Amazon Web Services
 
Building with AWS Databases: Match Your Workload to the Right Database | AWS ...
Building with AWS Databases: Match Your Workload to the Right Database | AWS ...Building with AWS Databases: Match Your Workload to the Right Database | AWS ...
Building with AWS Databases: Match Your Workload to the Right Database | AWS ...Amazon Web Services
 
Building with AWS Databases: Match Your Workload to the Right Database | AWS ...
Building with AWS Databases: Match Your Workload to the Right Database | AWS ...Building with AWS Databases: Match Your Workload to the Right Database | AWS ...
Building with AWS Databases: Match Your Workload to the Right Database | AWS ...AWS Summits
 
AWS Summit Singapore 2019 | Big Data Analytics Architectural Patterns and Bes...
AWS Summit Singapore 2019 | Big Data Analytics Architectural Patterns and Bes...AWS Summit Singapore 2019 | Big Data Analytics Architectural Patterns and Bes...
AWS Summit Singapore 2019 | Big Data Analytics Architectural Patterns and Bes...AWS Summits
 
Modern Cloud Data Warehousing ft. Equinox Fitness Clubs: Optimize Analytics P...
Modern Cloud Data Warehousing ft. Equinox Fitness Clubs: Optimize Analytics P...Modern Cloud Data Warehousing ft. Equinox Fitness Clubs: Optimize Analytics P...
Modern Cloud Data Warehousing ft. Equinox Fitness Clubs: Optimize Analytics P...Amazon Web Services
 
Welcome and AWS Big Data Solution Overview
Welcome and AWS Big Data Solution OverviewWelcome and AWS Big Data Solution Overview
Welcome and AWS Big Data Solution OverviewAmazon Web Services
 
Driving Business Insights with a Modern Data Architecture AWS Summit SG 2017
Driving Business Insights with a Modern Data Architecture  AWS Summit SG 2017Driving Business Insights with a Modern Data Architecture  AWS Summit SG 2017
Driving Business Insights with a Modern Data Architecture AWS Summit SG 2017Amazon Web Services
 
Big Data on AWS - To infinity and beyond! - Tel Aviv Summit 2018
Big Data on AWS - To infinity and beyond! - Tel Aviv Summit 2018Big Data on AWS - To infinity and beyond! - Tel Aviv Summit 2018
Big Data on AWS - To infinity and beyond! - Tel Aviv Summit 2018Amazon Web Services
 
Building Your Geospatial Data Lake (WPS324) - AWS re:Invent 2018
Building Your Geospatial Data Lake (WPS324) - AWS re:Invent 2018Building Your Geospatial Data Lake (WPS324) - AWS re:Invent 2018
Building Your Geospatial Data Lake (WPS324) - AWS re:Invent 2018Amazon Web Services
 
BI & Analytics - A Datalake on AWS
BI & Analytics - A Datalake on AWSBI & Analytics - A Datalake on AWS
BI & Analytics - A Datalake on AWSAmazon Web Services
 

Similaire à Pemahaman Pelanggan & Machine Learning (Level 200 – 300) | Kenali Pelanggan Anda - Arsitektur Data Modern (20)

Data Analytics를 통한 비지니스 혁신::Craig Stries::AWS Summit Seoul 2018
Data Analytics를 통한 비지니스 혁신::Craig Stries::AWS Summit Seoul 2018Data Analytics를 통한 비지니스 혁신::Craig Stries::AWS Summit Seoul 2018
Data Analytics를 통한 비지니스 혁신::Craig Stries::AWS Summit Seoul 2018
 
AWS Summit Singapore - Get to Know Your Customers - Modern Data Architecture
AWS Summit Singapore - Get to Know Your Customers - Modern Data ArchitectureAWS Summit Singapore - Get to Know Your Customers - Modern Data Architecture
AWS Summit Singapore - Get to Know Your Customers - Modern Data Architecture
 
AWS Summit Singapore - Get to Know Your Customers - Modern Data Architecture
AWS Summit Singapore - Get to Know Your Customers - Modern Data ArchitectureAWS Summit Singapore - Get to Know Your Customers - Modern Data Architecture
AWS Summit Singapore - Get to Know Your Customers - Modern Data Architecture
 
AWS Summit Webinar Edition | Modern Data Architecture | Microsoft Application...
AWS Summit Webinar Edition | Modern Data Architecture | Microsoft Application...AWS Summit Webinar Edition | Modern Data Architecture | Microsoft Application...
AWS Summit Webinar Edition | Modern Data Architecture | Microsoft Application...
 
Better Business From Exploring Ideas - AWS Summit Sydney 2018
Better Business From Exploring Ideas - AWS Summit Sydney 2018Better Business From Exploring Ideas - AWS Summit Sydney 2018
Better Business From Exploring Ideas - AWS Summit Sydney 2018
 
雲上打造資料湖 (Data Lake):智能化駕馭商機 (Level 300)
雲上打造資料湖 (Data Lake):智能化駕馭商機 (Level 300)雲上打造資料湖 (Data Lake):智能化駕馭商機 (Level 300)
雲上打造資料湖 (Data Lake):智能化駕馭商機 (Level 300)
 
Get to Know Your Customers - Build and Innovate with a Modern Data Architecture
Get to Know Your Customers - Build and Innovate with a Modern Data ArchitectureGet to Know Your Customers - Build and Innovate with a Modern Data Architecture
Get to Know Your Customers - Build and Innovate with a Modern Data Architecture
 
Preparing Your Data for Cloud Analytics & AI/ML
Preparing Your Data for Cloud Analytics & AI/ML Preparing Your Data for Cloud Analytics & AI/ML
Preparing Your Data for Cloud Analytics & AI/ML
 
Build and Innovate with a Modern Data Architecture
Build and Innovate with a Modern Data ArchitectureBuild and Innovate with a Modern Data Architecture
Build and Innovate with a Modern Data Architecture
 
An Overview of Machine Learning on AWS
An Overview of Machine Learning on AWSAn Overview of Machine Learning on AWS
An Overview of Machine Learning on AWS
 
Building a Data Lake in Amazon S3 & Amazon Glacier (STG401-R1) - AWS re:Inven...
Building a Data Lake in Amazon S3 & Amazon Glacier (STG401-R1) - AWS re:Inven...Building a Data Lake in Amazon S3 & Amazon Glacier (STG401-R1) - AWS re:Inven...
Building a Data Lake in Amazon S3 & Amazon Glacier (STG401-R1) - AWS re:Inven...
 
Building with AWS Databases: Match Your Workload to the Right Database | AWS ...
Building with AWS Databases: Match Your Workload to the Right Database | AWS ...Building with AWS Databases: Match Your Workload to the Right Database | AWS ...
Building with AWS Databases: Match Your Workload to the Right Database | AWS ...
 
Building with AWS Databases: Match Your Workload to the Right Database | AWS ...
Building with AWS Databases: Match Your Workload to the Right Database | AWS ...Building with AWS Databases: Match Your Workload to the Right Database | AWS ...
Building with AWS Databases: Match Your Workload to the Right Database | AWS ...
 
AWS Summit Singapore 2019 | Big Data Analytics Architectural Patterns and Bes...
AWS Summit Singapore 2019 | Big Data Analytics Architectural Patterns and Bes...AWS Summit Singapore 2019 | Big Data Analytics Architectural Patterns and Bes...
AWS Summit Singapore 2019 | Big Data Analytics Architectural Patterns and Bes...
 
Modern Cloud Data Warehousing ft. Equinox Fitness Clubs: Optimize Analytics P...
Modern Cloud Data Warehousing ft. Equinox Fitness Clubs: Optimize Analytics P...Modern Cloud Data Warehousing ft. Equinox Fitness Clubs: Optimize Analytics P...
Modern Cloud Data Warehousing ft. Equinox Fitness Clubs: Optimize Analytics P...
 
Welcome and AWS Big Data Solution Overview
Welcome and AWS Big Data Solution OverviewWelcome and AWS Big Data Solution Overview
Welcome and AWS Big Data Solution Overview
 
Driving Business Insights with a Modern Data Architecture AWS Summit SG 2017
Driving Business Insights with a Modern Data Architecture  AWS Summit SG 2017Driving Business Insights with a Modern Data Architecture  AWS Summit SG 2017
Driving Business Insights with a Modern Data Architecture AWS Summit SG 2017
 
Big Data on AWS - To infinity and beyond! - Tel Aviv Summit 2018
Big Data on AWS - To infinity and beyond! - Tel Aviv Summit 2018Big Data on AWS - To infinity and beyond! - Tel Aviv Summit 2018
Big Data on AWS - To infinity and beyond! - Tel Aviv Summit 2018
 
Building Your Geospatial Data Lake (WPS324) - AWS re:Invent 2018
Building Your Geospatial Data Lake (WPS324) - AWS re:Invent 2018Building Your Geospatial Data Lake (WPS324) - AWS re:Invent 2018
Building Your Geospatial Data Lake (WPS324) - AWS re:Invent 2018
 
BI & Analytics - A Datalake on AWS
BI & Analytics - A Datalake on AWSBI & Analytics - A Datalake on AWS
BI & Analytics - A Datalake on AWS
 

Plus de Amazon Web Services

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Amazon Web Services
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Amazon Web Services
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateAmazon Web Services
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSAmazon Web Services
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Amazon Web Services
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Amazon Web Services
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...Amazon Web Services
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsAmazon Web Services
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareAmazon Web Services
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSAmazon Web Services
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAmazon Web Services
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareAmazon Web Services
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWSAmazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckAmazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without serversAmazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...Amazon Web Services
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceAmazon Web Services
 

Plus de Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

Pemahaman Pelanggan & Machine Learning (Level 200 – 300) | Kenali Pelanggan Anda - Arsitektur Data Modern

  • 1. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Silvia Wibowo Solutions Architect Pemahaman Pelanggan & Machine Learning (Level 200 – 300) Kenali Pelanggan Anda - Arsitektur Data Modern
  • 2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Let’s go on a common customer journey
  • 3. Meet EarEcstasy, as they move from B2B to B2C * This case is representative of a common customer journey, but EarEcstasy isn’t an actual business EarEcstasy manufacturers headsets. They ran a traditional B2B business since 2005, selling through distribution and retail channels. 2005 In 2018, they launched their first “Smart Buds”. These wireless headsets have voice enablement, GPS tracking, and heartrate monitors built in, and the device syncs with the users mobile phone via Bluetooth. The mobile app also supports scene detection. 2018
  • 4. EarEcstasy needs to answer new questions and move faster Raymond, Head of ProductLim, Head of Finance Which regions are the new earbuds selling well? What is the demand forecast by product category? What is the social sentiment about our products? How do quality issues impact cost of production? Can I look at supplier performance over time? How can we reduce our inventory holding costs?
  • 5. To answer new questions quickly, we look to a modern data architecture design Massive upfront costs Overprovisioned capacity Long implementation times Pay as you go, for what you use Decoupled pipelines and engines Experimentation platform Ingest/ Collect Consume/ visualize Store Process/ analyze 1 4 0 9 5
  • 6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Outcome 1: Modernize and consolidate
  • 7. Start with a set of specific questions to answer, then work backwards to the data required Lim, Head of Finance How do quality issues impact cost of production? Can I look at supplier performance over time? How can we reduce our inventory holding costs? Order History / Returns (CRM) Inventory / Production (ERP)
  • 8. Ingest ServingData sources Modern data architecture Insights to enhance business applications, new digital services Transactions ERP Data analysts DATA PIPELINES Ingest/ Collect Consume / visualize Store Process / analyze 1 4 0 9 5
  • 9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Start small and iterate
  • 10. Ingest ServingData sources Modern data architecture Insights to enhance business applications, new digital services Transactions ERP DATA PIPELINES Data Lake expdp Data Data analysts Data Warehouse Amazon Redshift Direct Query Amazon Athena She asks for the SMALLEST amount of data to answer her questions. If it isn’t good enough, she asks for another small slice to be loaded to the DATA LAKE
  • 11. Amazon Redshift – Modern Data Warehousing Fast, scalable, fully managed data warehouse at 1/10th the cost Massively parallel, scales from gigabytes to exabytes Queries data across your Redshift data warehouse and Amazon S3 data lake Fast at scale Columnar storage technology to improve I/O efficiency and scale query performance Open file formats Analyze optimized data formats on direct-attached disks, and all open file formats in S3 Cost-effective Start at $0.25 per hour; as low as $250-$333 per uncompressed terabyte per year $ Secure Audit everything; encrypt data end-to-end; extensive certification and compliance
  • 12. Characteristics of a Data Lake Future Proof Flexible Access Dive in Anywhere Collect Anything
  • 13. Start with a set of specific questions to answer, then work backwards to the data required Raymond, Head of Product Which regions are the new earbuds selling well? What is the demand forecast by product category? What is the social sentiment about our products? Trending / Mentions (Social) Order History / Returns (CRM) NOW IN THE DATA LAKE
  • 14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Experiment, validate, then scale
  • 15. Ingest ServingData sources Modern data architecture Insights to enhance business applications, new digital services DATA PIPELINES Data Lake He first looks to the DATA LAKE, and imports only the category data he needs He imports JUST ENOUGH data to see if the market is responding to products. Business users Transactions ERP Social media Data Stream Capture Amazon Kinesis Events Amazon QuickSight Data Warehouse Amazon Redshift Stream Data Amazon ElasticSearch
  • 16. Common data pipeline configuration Raw Data Amazon S3 Highly decoupled configurations scale better, are more fault tolerant, and cost optimized ETL (Hadoop) Amazon EMR Triggered Code Amazon Lambda Staged Data (Data Lake) Amazon S3 ETL & Catalog Management AWS Glue Data Warehouse Amazon Redshift Triggered Code Amazon Lambda
  • 17. Data security and management Encryption Access Controls Monitoring and Metrics Audit Trails Automation Serverless Computing Data Discovery and Protection Data Visualization Data movement Physical Appliances Hybrid Storage Private Networks File Data WAN Acceleration Third-party Applications Streaming Data Complete set of building blocks FileBlock Object Archival Storage types
  • 18. Ingest ServingData sources Modern data architecture Insights to enhance business applications, new digital services Transactions ERP Data analysts Business users DATA PIPELINES EVENT PIPELINES Data Event Insights Data Lake Social media
  • 19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Outcome 2: Innovate for new revenues
  • 20. EarEcstasy has its first direct relationship with consumers Krzysztof, Data ScientistBala, Head of Marketing What are our customer segments, based on usage? Can predict music preference from location and HR? Are there additional signals in the voice commands? Can we infer user activity, from scenes in pictures? How are people using the Smart Buds? How to understand what they listen to and when? What kinds of people are in/decreasing usage?
  • 21. Start with a set of specific questions to answer, then work backwards to the data required Bala, Head of Marketing How are people using the Smart Buds? How to understand what they listen to and when? What kinds of people are in/decreasing usage? Media consumption (Partner API) Registration, usage [time/place] (Mobile app)
  • 22. Start with a set of specific questions to answer, then work backwards to the data required Krzysztof, Data Scientist What are our customer segments, based on usage? Can predict music preference from location and HR? Are there additional signals in the voice commands? Can we infer user activity, from scenes in pictures? HR, Voice, GPS, Images (Device data) DATA LAKE, OR NOT? Registration, usage [time/place] (Mobile app) LOAD TO DATA LAKE
  • 23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Sandboxes - fast, cheap, low risk
  • 24. Ingest ServingData sources Modern data architecture Insights to enhance business applications, new digital services Transactions Data scientists Business users Connected devices DATA PIPELINES EVENT PIPELINES Data Event Insights Data Lake Sandbox ML / Analytics / DLWeb logs / clickstream
  • 25. Ingest ServingData sources Modern data architecture Innovate for new revenues - personalization and forecasting Transactions ERP Data analysts Data scientists Business users Connected devices DATA PIPELINES EVENT PIPELINES Data Event Insights Data Lake ML / Analytics Social media Web logs / clickstream
  • 26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Outcome 3: Real-time engagement
  • 27. EarEcstasy offers a personalized life soundtrack Personalized, based on past preferences, people with similar behaviors, and environments detected
  • 28. Use EarEcstasy voice enablement to play music I’m tired, play me some music! Amazon Transcribe / Comprehend Action: PLAY Category: MUSIC Genre: <RECOMMEND> Request content HISTORY Twenty One Pilots! PEOPLE LIKE YOU Amazon Kinesis Streams Connected device data Location: <FIND GPS> Mood: <FIND HR>
  • 29. Use the mobile app to take a picture to identify activity A QUIET OFFICE Amazon SageMaker Image Classification Amazon Rekognition Image CHAIR LAPTOP LAMP DESK 97% 95% 88% 82% Object Identification WORKING! <HISTORY>
  • 30. Ingest ServingData sources Modern data architecture Real-time engagement and interactive customer experiences Transactions ERP Data analysts Data scientists Business users Engagement platformsConnected devices Automation / events DATA PIPELINES EVENT PIPELINES Data Event Action Insights Data Lake ML / Analytics Predict / Recommend AI Services Social media Web logs / clickstream
  • 31. Business Outcomes on a Modern Data Architecture Outcome 1 : Modernize and consolidate • Insights to enhance business applications and create new digital services Outcome 2 : Innovate for new revenues • Personalization, demand forecasting, risk analysis Outcome 3 : Real-time engagement • Interactive customer experience, event-driven automation, fraud detection
  • 32. Ready to build better business from your ideas? Short list projects that directly impact customer engagement and adoption Build simple data pipelines that allow you to test new ideas, and fill your data lake Ask our solution architects and professional services teams to help you build
  • 33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Thank you!