Contenu connexe Similaire à Building Text Analytics Applications on AWS using Amazon Comprehend - AWS Online Tech Talks (20) Plus de Amazon Web Services (20) Building Text Analytics Applications on AWS using Amazon Comprehend - AWS Online Tech Talks1. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Nino Bice, Product Manager
Ben Snively, Service Architect
Amazon Comprehend
Fully Managed, Continuously Trained NLP Service
2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Frameworks
&
Infrastructure
AWS Deep Learning AMI
GPU
(P3 Instances)
MobileCPU
IoT
(Greengrass)
Vision:
Rekognition Image
Rekognition Video
Speech:
Polly
Transcribe
Language:
Lex Translate
Comprehend
Apache
MXNet
PyTorch
Cognitive
Toolkit
Keras
Caffe2
& Caffe
TensorFlow Gluon
Application
Services
Platform
Services
Amazon Machine
Learning
Mechanical
Turk
Spark &
EMR
Amazon
SageMaker
AWS
DeepLens
Amazon confidential
AWS ML Stack
3. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Transcribe
Automatic conversion of speech into accurate, grammatically
correct text
Amazon Translate Natural and fluent language translation
Amazon Polly Turn text into lifelike speech using deep learning
Amazon Comprehend Discover insights and relationships in text
Amazon Lex
Conversational interfaces for text-based and voice-based
applications
Powerful language capabilities
4. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Comprehend
A fully managed and continuously trained service that
helps you extract insights from unstructured text
5. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Comprehend
Sentiment Entities LanguagesKey phrases Topic modeling
6. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Comprehend: Natural Language Processing
A m a z o n . c o m , I n c . i s l o c a t e d i n
S e a t t l e , WA a n d w a s f o u n d e d
J u l y 5 t h , 1 9 9 4 b y J e f f B e z o s .
O u r c u s t o m e r s l o v e b u y i n g
e v e r y t h i n g f r o m b o o k s t o
b l e n d e r s a t g r e a t p r i c e s
N a m e d E n t i t i e s
• A m a z o n . c o m :
O r g a n i z a t i o n
• S e a t t l e , W A : L o c a t i o n
• J u l y 5 t h , 1 9 9 4 : D a t e
• J e f f B e z o s : P e r s o n
K e y p h r a s e s
• O u r c u s t o m e r s
• b o o k s
• b l e n d e r s
• g r e a t p r i c e s
S e n t i m e n t
• P o s i t i v e
L a n g u a g e
• E n g l i s h
7. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Topic Modeling
Document Topic Proportion
Doc.txt 0 .89
Doc.txt 1 .67
Doc.txt 2 .91
Topic Term Weight
0 Washington .89
1 Silicon Valley .67
2 Roasting .91
Keywords Topic Groups Document Relationship to Topics
8. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Data
Collection
Web
Crawling
Internal
Data
Warehouse
Purchase
Datasets
Annotation
Orchestration
Data
Cleansing
Annotation Evaluation
Model
Training
Build Experiment Optimize
Deploy Dockerize Deploy Host
Continuous
Improvement
Sample
Data
Annotate
and
Evaluate
Repeat
Steps 3 - 5
1.
2.
3.
4.
5.
Continuously Training
9. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Comprehend Portal
10. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Text Analytics
11. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Popular Text Analytics Use Cases
Content Personalization: Customers are using Comprehend NLP output to understand related documents
based on entities, phrases or even topic similarities for trends analysis, to drive content personalization and
recommendations
Semantic Search: Customers using Amazon Comprehend to index entities for boosting and ranking
search results.
Intelligent data warehouse: Customers are using Amazon Comprehend to query unstructured data in
relational databases, processing data within the data lake (S3) and then inserting it back into the data
warehouse
Social Analytics: Customers are using Amazon Comprehend to ingest, process and analyze trends from
entities and sentiment from social media posts across Twitter and Facebook.
12. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Text Analytics Workload
Amazon Kinesis
Amazon ES
Amazon Redshift
Amazon EMR
• Semantic
• Rich Filtering
• Grouping, Trends
• Joining, Correlating
• Clustering
• Graph, Search
• Near real-time
• Alerts
Amazon S3
Social Media, Support
Amazon Aurora
Articles, Documents
13. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Comprehend and Glue
14. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
UDF to Call Comprehend
15. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Comprehend and RDS
16. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Stored Procedure to Comprehend
17. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Demo: Comprehend and RDS
18. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
19. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Comprehend and Elasticsearch
20. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Comprehend and SageMaker
21. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.