SlideShare une entreprise Scribd logo
1  sur  19
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Build Text Analytics Solutions with AWS ML Services
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The Amazon Machine Learning Stack
PLATFORM SERVICES
APPLICATION SERVICES
FRAMEWORKS & INTERFACES
Caffe2 CNTK
Apache
MXNet
PyTorch TensorFlow Torch Keras Gluon
AWS Deep Learning AMIs
Amazon SageMaker
Rekognition Transcribe Translate Polly Comprehend Lex
Amazon Mechanical Turk
AWS
DeepLens
EDUCATION
Build Text Analytics Solutions with AWS ML Services
What are we going to do today?
Easily build a system that collects, translates, understands, and visualizes twitter
information based on your terms
Data
Catalog
Data Lake
• Capture Tweets in real-time
• Machine Translation
• Entity and KeyPhrase
• Sentiment Analysis
• Durably Save results
Amazon
Kinesis Firehose
<bucket>/enriche
d
<bucket>/raw
Amazon Translate
Amazon Comprehend
Amazon
Athena
Amazon
QuickSight
AWS Glue
Data Catalog
Reference Architecture
The diagram shows both the ingest (blue) and query (yellow) flows
Collection/Storage of Real-time Data
Amazon
Kinesis
Firehose
Amazon
S3
<bucket>/raw
Twitter
Reader
EC2
ECS
Fargate
Amazon Kinesis – Real-Time Analytics
Easily collect, process, and analyze video and data streams in real time
Capture, process, and
store video streams
for analytics
Load data streams
into AWS data stores
Analyze data streams
with SQL
Build custom
applications that
analyze data streams
Kinesis Video Streams Kinesis Data Streams Kinesis Data Firehose Kinesis Data Analytics
Processing the tweets
Amazon
S3
<bucket>/raw
Process New
Tweets
Amazon Translate
Amazon Comprehend
Amazon
Kinesis Firehose
<bucket>/enriched
Amazon Comprehend
A fully managed and continuously trained service that helps you extract insights
from unstructured text.
Sentiment Entities LanguagesKey phrases
Topic
modeling
Another Example:
Amazon Translate
A fully managed and continuously trained neural machine translation service that
translates text from one language to another
English <> Arabic, Simplified
Chinese, French, German,
Spanish and Portuguese
Language detection via
Amazon Comprehend
AWS Security Standards Available in US East (N,
Virginia), US East (Ohio),
US West (Oregon), and EU
(Ireland)
Easy to use and integrate via
CLI or SDKs
Best in class return on
investment
Translated text input
tagged inputs, e.g. HTML
Real-time translation of
~30 words, i.e. <500ms
Easy to Use & Integrate
• Use through Command Line Tools or AWS SDKs
• Integrate into your application or call externally
• Python example:
import boto3
Amazon.translate = boto3.client(service_name=‘translate')
result = Amazon.translate(Text="Hello, World",
SourceLanguageCode="en", TargetLanguageCode="de")
print('TranslatedText: ' + result.get('TranslatedText'))
Querying our Data Lake
Amazon
S3
<bucket>/raw
<bucket>/enriched
AWS Glue Data
Catalog
Describes
Amazon
Athena
SQL
Uses
Queries
Building a dashboard
Amazon
S3
<bucket>/raw
<bucket>/enriche
d
Amazon
Athena
SQL
Queries
Amazon
QuickSight
Demo
Build a Social Media Dashboard
Amazon
Kinesis Firehose
<bucket>/enriche
d
<bucket>/raw
Amazon Translate
Amazon Comprehend
Amazon
Athena
Amazon
QuickSight
AWS Glue
Data Catalog
Recap
The diagram shows both the ingest (blue) and query (yellow) flows
Resources
The AWS CloudFormation template will create all the ingestion components shown
in this session, except for the Amazon S3 notification for AWS Lambda (depicted as
the dotted blue line). In the AWS Management Console, launch the CloudFormation
Template. Refer to the blog more details: https://aws.amazon.com/blogs/machine-
learning/build-a-social-media-dashboard-using-machine-learning-and-bi-services/
Webinar: https://www.youtube.com/watch?v=wwOQvjogc7Q
Additional questions about the demo? Reach to snivelyb@amazon.com
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
aws.amazon.com/activate
Everything and Anything Startups
Need to Get Started on AWS

Contenu connexe

Tendances

Building a Modern Data Platform on AWS
Building a Modern Data Platform on AWSBuilding a Modern Data Platform on AWS
Building a Modern Data Platform on AWS
Amazon Web Services
 
[DSC Europe 23] Tamara Stankovic - From Prompt To Product Microsoft 365 Copil...
[DSC Europe 23] Tamara Stankovic - From Prompt To Product Microsoft 365 Copil...[DSC Europe 23] Tamara Stankovic - From Prompt To Product Microsoft 365 Copil...
[DSC Europe 23] Tamara Stankovic - From Prompt To Product Microsoft 365 Copil...
DataScienceConferenc1
 
SharePoint Online vs. On-Premise
SharePoint Online vs. On-PremiseSharePoint Online vs. On-Premise
SharePoint Online vs. On-Premise
Evan Hodges
 
Cloud migration strategies
Cloud migration strategiesCloud migration strategies
Cloud migration strategies
SogetiLabs
 

Tendances (20)

Building a Modern Data Platform on AWS
Building a Modern Data Platform on AWSBuilding a Modern Data Platform on AWS
Building a Modern Data Platform on AWS
 
ServiceNow & Jira Integration
ServiceNow & Jira IntegrationServiceNow & Jira Integration
ServiceNow & Jira Integration
 
Winning Enterprise Cloud Engagements
Winning Enterprise Cloud EngagementsWinning Enterprise Cloud Engagements
Winning Enterprise Cloud Engagements
 
[DSC Europe 23] Tamara Stankovic - From Prompt To Product Microsoft 365 Copil...
[DSC Europe 23] Tamara Stankovic - From Prompt To Product Microsoft 365 Copil...[DSC Europe 23] Tamara Stankovic - From Prompt To Product Microsoft 365 Copil...
[DSC Europe 23] Tamara Stankovic - From Prompt To Product Microsoft 365 Copil...
 
Microsoft Teams - Doorway to the Modern Workplace
Microsoft Teams - Doorway to the Modern WorkplaceMicrosoft Teams - Doorway to the Modern Workplace
Microsoft Teams - Doorway to the Modern Workplace
 
Understanding DataOps and Its Impact on Application Quality
Understanding DataOps and Its Impact on Application QualityUnderstanding DataOps and Its Impact on Application Quality
Understanding DataOps and Its Impact on Application Quality
 
Creating the Cloud Business Case
Creating the Cloud Business CaseCreating the Cloud Business Case
Creating the Cloud Business Case
 
Database Migration Using AWS DMS and AWS SCT (GPSCT307) - AWS re:Invent 2018
Database Migration Using AWS DMS and AWS SCT (GPSCT307) - AWS re:Invent 2018Database Migration Using AWS DMS and AWS SCT (GPSCT307) - AWS re:Invent 2018
Database Migration Using AWS DMS and AWS SCT (GPSCT307) - AWS re:Invent 2018
 
Best Practices in Planning a Large-Scale Migration to AWS - AWS Online Tech T...
Best Practices in Planning a Large-Scale Migration to AWS - AWS Online Tech T...Best Practices in Planning a Large-Scale Migration to AWS - AWS Online Tech T...
Best Practices in Planning a Large-Scale Migration to AWS - AWS Online Tech T...
 
Infrastructure Continuous Delivery Using AWS CloudFormation
Infrastructure Continuous Delivery Using AWS CloudFormationInfrastructure Continuous Delivery Using AWS CloudFormation
Infrastructure Continuous Delivery Using AWS CloudFormation
 
Mainframe Possible: Migrating a Mainframe to AWS
Mainframe Possible: Migrating a Mainframe to AWSMainframe Possible: Migrating a Mainframe to AWS
Mainframe Possible: Migrating a Mainframe to AWS
 
AWS Lake Formation Deep Dive
AWS Lake Formation Deep DiveAWS Lake Formation Deep Dive
AWS Lake Formation Deep Dive
 
AWS for Backup and Recovery
AWS for Backup and RecoveryAWS for Backup and Recovery
AWS for Backup and Recovery
 
AWS Service Catalog
AWS Service CatalogAWS Service Catalog
AWS Service Catalog
 
SharePoint Online vs. On-Premise
SharePoint Online vs. On-PremiseSharePoint Online vs. On-Premise
SharePoint Online vs. On-Premise
 
Cloud migration strategies
Cloud migration strategiesCloud migration strategies
Cloud migration strategies
 
Introduction of Cloud computing
Introduction of Cloud computingIntroduction of Cloud computing
Introduction of Cloud computing
 
Making a cloud first strategy a practical reality
Making a cloud first strategy a practical realityMaking a cloud first strategy a practical reality
Making a cloud first strategy a practical reality
 
An Overview of Machine Learning on AWS
An Overview of Machine Learning on AWSAn Overview of Machine Learning on AWS
An Overview of Machine Learning on AWS
 
Cloud Migration: A How-To Guide
Cloud Migration: A How-To GuideCloud Migration: A How-To Guide
Cloud Migration: A How-To Guide
 

Similaire à Build Text Analytics Solutions with Amazon Comprehend & Amazon Translate

Similaire à Build Text Analytics Solutions with Amazon Comprehend & Amazon Translate (20)

Kate Werling - Build text analytics solutions with AWS ML Services (300) _BP.pdf
Kate Werling - Build text analytics solutions with AWS ML Services (300) _BP.pdfKate Werling - Build text analytics solutions with AWS ML Services (300) _BP.pdf
Kate Werling - Build text analytics solutions with AWS ML Services (300) _BP.pdf
 
Build text analytics solutions with AWS ML Services
Build text analytics solutions with AWS ML ServicesBuild text analytics solutions with AWS ML Services
Build text analytics solutions with AWS ML Services
 
Build Text Analytics Solutions with Amazon Comprehend and Amazon Translate
Build Text Analytics Solutions with Amazon Comprehend and Amazon TranslateBuild Text Analytics Solutions with Amazon Comprehend and Amazon Translate
Build Text Analytics Solutions with Amazon Comprehend and Amazon Translate
 
AWS Machine Learning Week SF: Build text analytics solutions with AWS ML Serv...
AWS Machine Learning Week SF: Build text analytics solutions with AWS ML Serv...AWS Machine Learning Week SF: Build text analytics solutions with AWS ML Serv...
AWS Machine Learning Week SF: Build text analytics solutions with AWS ML Serv...
 
Build Text Analytics Solutions with Amazon Comprehend and Amazon Translate
Build Text Analytics Solutions with Amazon Comprehend and Amazon TranslateBuild Text Analytics Solutions with Amazon Comprehend and Amazon Translate
Build Text Analytics Solutions with Amazon Comprehend and Amazon Translate
 
Build Text Analytics Solutions with Amazon Comprehend & Amazon Translate: Mac...
Build Text Analytics Solutions with Amazon Comprehend & Amazon Translate: Mac...Build Text Analytics Solutions with Amazon Comprehend & Amazon Translate: Mac...
Build Text Analytics Solutions with Amazon Comprehend & Amazon Translate: Mac...
 
Build text analytics solutions with AWS ML Services
Build text analytics solutions with AWS ML ServicesBuild text analytics solutions with AWS ML Services
Build text analytics solutions with AWS ML Services
 
Build Text Analytics Solutions with AWS ML Services: Machine Learning Worksho...
Build Text Analytics Solutions with AWS ML Services: Machine Learning Worksho...Build Text Analytics Solutions with AWS ML Services: Machine Learning Worksho...
Build Text Analytics Solutions with AWS ML Services: Machine Learning Worksho...
 
Capture Voice of Customer Insights with NLP & Analytics (AIM415-R1) - AWS re:...
Capture Voice of Customer Insights with NLP & Analytics (AIM415-R1) - AWS re:...Capture Voice of Customer Insights with NLP & Analytics (AIM415-R1) - AWS re:...
Capture Voice of Customer Insights with NLP & Analytics (AIM415-R1) - AWS re:...
 
Building Data Lakes and Analytics on AWS; Patterns and Best Practices - BDA30...
Building Data Lakes and Analytics on AWS; Patterns and Best Practices - BDA30...Building Data Lakes and Analytics on AWS; Patterns and Best Practices - BDA30...
Building Data Lakes and Analytics on AWS; Patterns and Best Practices - BDA30...
 
Data & AI Platforms — Open Source Vs Managed Services (AWS vs Azure vs GCP)
Data & AI Platforms — Open Source Vs Managed Services (AWS vs Azure vs GCP)Data & AI Platforms — Open Source Vs Managed Services (AWS vs Azure vs GCP)
Data & AI Platforms — Open Source Vs Managed Services (AWS vs Azure vs GCP)
 
ABD315_Serverless ETL with AWS Glue
ABD315_Serverless ETL with AWS GlueABD315_Serverless ETL with AWS Glue
ABD315_Serverless ETL with AWS Glue
 
Build Data Lakes & Analytics on AWS: Patterns & Best Practices - BDA305 - Ana...
Build Data Lakes & Analytics on AWS: Patterns & Best Practices - BDA305 - Ana...Build Data Lakes & Analytics on AWS: Patterns & Best Practices - BDA305 - Ana...
Build Data Lakes & Analytics on AWS: Patterns & Best Practices - BDA305 - Ana...
 
AWS Reinvent Recap 2018
AWS Reinvent Recap 2018 AWS Reinvent Recap 2018
AWS Reinvent Recap 2018
 
Building a Data Processing Pipeline on AWS
Building a Data Processing Pipeline on AWSBuilding a Data Processing Pipeline on AWS
Building a Data Processing Pipeline on AWS
 
Building a Data Processing Pipeline on AWS - AWS Summit SG 2017
Building a Data Processing Pipeline on AWS - AWS Summit SG 2017Building a Data Processing Pipeline on AWS - AWS Summit SG 2017
Building a Data Processing Pipeline on AWS - AWS Summit SG 2017
 
AWS 101: Introduction to AWS
AWS 101: Introduction to AWSAWS 101: Introduction to AWS
AWS 101: Introduction to AWS
 
AWS reInvent 2018 recap edition
AWS reInvent 2018 recap editionAWS reInvent 2018 recap edition
AWS reInvent 2018 recap edition
 
Full Stack Analytics on AWS - AWS Summit Cape Town 2017
Full Stack Analytics on AWS - AWS Summit Cape Town 2017 Full Stack Analytics on AWS - AWS Summit Cape Town 2017
Full Stack Analytics on AWS - AWS Summit Cape Town 2017
 
"Fast Start to Building on AWS", Igor Ivaniuk
"Fast Start to Building on AWS", Igor Ivaniuk"Fast Start to Building on AWS", Igor Ivaniuk
"Fast Start to Building on AWS", Igor Ivaniuk
 

Plus de Amazon Web Services

Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
Amazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
Amazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
Amazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
Amazon Web Services
 

Plus de Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

Build Text Analytics Solutions with Amazon Comprehend & Amazon Translate

  • 1. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Build Text Analytics Solutions with AWS ML Services
  • 2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. The Amazon Machine Learning Stack PLATFORM SERVICES APPLICATION SERVICES FRAMEWORKS & INTERFACES Caffe2 CNTK Apache MXNet PyTorch TensorFlow Torch Keras Gluon AWS Deep Learning AMIs Amazon SageMaker Rekognition Transcribe Translate Polly Comprehend Lex Amazon Mechanical Turk AWS DeepLens EDUCATION
  • 3. Build Text Analytics Solutions with AWS ML Services
  • 4. What are we going to do today? Easily build a system that collects, translates, understands, and visualizes twitter information based on your terms Data Catalog Data Lake • Capture Tweets in real-time • Machine Translation • Entity and KeyPhrase • Sentiment Analysis • Durably Save results
  • 5. Amazon Kinesis Firehose <bucket>/enriche d <bucket>/raw Amazon Translate Amazon Comprehend Amazon Athena Amazon QuickSight AWS Glue Data Catalog Reference Architecture The diagram shows both the ingest (blue) and query (yellow) flows
  • 6. Collection/Storage of Real-time Data Amazon Kinesis Firehose Amazon S3 <bucket>/raw Twitter Reader EC2 ECS Fargate
  • 7. Amazon Kinesis – Real-Time Analytics Easily collect, process, and analyze video and data streams in real time Capture, process, and store video streams for analytics Load data streams into AWS data stores Analyze data streams with SQL Build custom applications that analyze data streams Kinesis Video Streams Kinesis Data Streams Kinesis Data Firehose Kinesis Data Analytics
  • 8. Processing the tweets Amazon S3 <bucket>/raw Process New Tweets Amazon Translate Amazon Comprehend Amazon Kinesis Firehose <bucket>/enriched
  • 9. Amazon Comprehend A fully managed and continuously trained service that helps you extract insights from unstructured text. Sentiment Entities LanguagesKey phrases Topic modeling
  • 11. Amazon Translate A fully managed and continuously trained neural machine translation service that translates text from one language to another English <> Arabic, Simplified Chinese, French, German, Spanish and Portuguese Language detection via Amazon Comprehend AWS Security Standards Available in US East (N, Virginia), US East (Ohio), US West (Oregon), and EU (Ireland) Easy to use and integrate via CLI or SDKs Best in class return on investment Translated text input tagged inputs, e.g. HTML Real-time translation of ~30 words, i.e. <500ms
  • 12. Easy to Use & Integrate • Use through Command Line Tools or AWS SDKs • Integrate into your application or call externally • Python example: import boto3 Amazon.translate = boto3.client(service_name=‘translate') result = Amazon.translate(Text="Hello, World", SourceLanguageCode="en", TargetLanguageCode="de") print('TranslatedText: ' + result.get('TranslatedText'))
  • 13. Querying our Data Lake Amazon S3 <bucket>/raw <bucket>/enriched AWS Glue Data Catalog Describes Amazon Athena SQL Uses Queries
  • 15. Demo Build a Social Media Dashboard
  • 16. Amazon Kinesis Firehose <bucket>/enriche d <bucket>/raw Amazon Translate Amazon Comprehend Amazon Athena Amazon QuickSight AWS Glue Data Catalog Recap The diagram shows both the ingest (blue) and query (yellow) flows
  • 17. Resources The AWS CloudFormation template will create all the ingestion components shown in this session, except for the Amazon S3 notification for AWS Lambda (depicted as the dotted blue line). In the AWS Management Console, launch the CloudFormation Template. Refer to the blog more details: https://aws.amazon.com/blogs/machine- learning/build-a-social-media-dashboard-using-machine-learning-and-bi-services/ Webinar: https://www.youtube.com/watch?v=wwOQvjogc7Q Additional questions about the demo? Reach to snivelyb@amazon.com
  • 18.
  • 19. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. aws.amazon.com/activate Everything and Anything Startups Need to Get Started on AWS