SlideShare une entreprise Scribd logo
1  sur  21
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Nino Bice, Product Manager
Ben Snively, Service Architect
Amazon Comprehend
Fully Managed, Continuously Trained NLP Service
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Frameworks
&
Infrastructure
AWS Deep Learning AMI
GPU
(P3 Instances)
MobileCPU
IoT
(Greengrass)
Vision:
Rekognition Image
Rekognition Video
Speech:
Polly
Transcribe
Language:
Lex Translate
Comprehend
Apache
MXNet
PyTorch
Cognitive
Toolkit
Keras
Caffe2
& Caffe
TensorFlow Gluon
Application
Services
Platform
Services
Amazon Machine
Learning
Mechanical
Turk
Spark &
EMR
Amazon
SageMaker
AWS
DeepLens
Amazon confidential
AWS ML Stack
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Transcribe
Automatic conversion of speech into accurate, grammatically
correct text
Amazon Translate Natural and fluent language translation
Amazon Polly Turn text into lifelike speech using deep learning
Amazon Comprehend Discover insights and relationships in text
Amazon Lex
Conversational interfaces for text-based and voice-based
applications
Powerful language capabilities
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Comprehend
A fully managed and continuously trained service that
helps you extract insights from unstructured text
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Comprehend
Sentiment Entities LanguagesKey phrases Topic modeling
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Comprehend: Natural Language Processing
A m a z o n . c o m , I n c . i s l o c a t e d i n
S e a t t l e , WA a n d w a s f o u n d e d
J u l y 5 t h , 1 9 9 4 b y J e f f B e z o s .
O u r c u s t o m e r s l o v e b u y i n g
e v e r y t h i n g f r o m b o o k s t o
b l e n d e r s a t g r e a t p r i c e s
N a m e d E n t i t i e s
• A m a z o n . c o m :
O r g a n i z a t i o n
• S e a t t l e , W A : L o c a t i o n
• J u l y 5 t h , 1 9 9 4 : D a t e
• J e f f B e z o s : P e r s o n
K e y p h r a s e s
• O u r c u s t o m e r s
• b o o k s
• b l e n d e r s
• g r e a t p r i c e s
S e n t i m e n t
• P o s i t i v e
L a n g u a g e
• E n g l i s h
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Topic Modeling
Document Topic Proportion
Doc.txt 0 .89
Doc.txt 1 .67
Doc.txt 2 .91
Topic Term Weight
0 Washington .89
1 Silicon Valley .67
2 Roasting .91
Keywords Topic Groups Document Relationship to Topics
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Data
Collection
Web
Crawling
Internal
Data
Warehouse
Purchase
Datasets
Annotation
Orchestration
Data
Cleansing
Annotation Evaluation
Model
Training
Build Experiment Optimize
Deploy Dockerize Deploy Host
Continuous
Improvement
Sample
Data
Annotate
and
Evaluate
Repeat
Steps 3 - 5
1.
2.
3.
4.
5.
Continuously Training
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Comprehend Portal
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Text Analytics
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Popular Text Analytics Use Cases
Content Personalization: Customers are using Comprehend NLP output to understand related documents
based on entities, phrases or even topic similarities for trends analysis, to drive content personalization and
recommendations
Semantic Search: Customers using Amazon Comprehend to index entities for boosting and ranking
search results.
Intelligent data warehouse: Customers are using Amazon Comprehend to query unstructured data in
relational databases, processing data within the data lake (S3) and then inserting it back into the data
warehouse
Social Analytics: Customers are using Amazon Comprehend to ingest, process and analyze trends from
entities and sentiment from social media posts across Twitter and Facebook.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Text Analytics Workload
Amazon Kinesis
Amazon ES
Amazon Redshift
Amazon EMR
• Semantic
• Rich Filtering
• Grouping, Trends
• Joining, Correlating
• Clustering
• Graph, Search
• Near real-time
• Alerts
Amazon S3
Social Media, Support
Amazon Aurora
Articles, Documents
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Comprehend and Glue
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
UDF to Call Comprehend
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Comprehend and RDS
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Stored Procedure to Comprehend
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Demo: Comprehend and RDS
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Comprehend and Elasticsearch
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Comprehend and SageMaker
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Contenu connexe

Tendances

Tendances (20)

How to Enhance your Application using Amazon Comprehend for NLP - AWS Online ...
How to Enhance your Application using Amazon Comprehend for NLP - AWS Online ...How to Enhance your Application using Amazon Comprehend for NLP - AWS Online ...
How to Enhance your Application using Amazon Comprehend for NLP - AWS Online ...
 
Introducing Amazon SageMaker
Introducing Amazon SageMakerIntroducing Amazon SageMaker
Introducing Amazon SageMaker
 
Amazon Rekognition: Deep Learning-Based Image and Video Analysis
Amazon Rekognition: Deep Learning-Based Image and Video AnalysisAmazon Rekognition: Deep Learning-Based Image and Video Analysis
Amazon Rekognition: Deep Learning-Based Image and Video Analysis
 
Deep Dive and Best Practices for Real Time Streaming Applications
Deep Dive and Best Practices for Real Time Streaming ApplicationsDeep Dive and Best Practices for Real Time Streaming Applications
Deep Dive and Best Practices for Real Time Streaming Applications
 
Building-a-Data-Lake-on-AWS
Building-a-Data-Lake-on-AWSBuilding-a-Data-Lake-on-AWS
Building-a-Data-Lake-on-AWS
 
스플렁크를 이용한 AWS운영 인텔리전스 확보:: Splunk 최승돈 :: AWS Summit Seoul 2016
스플렁크를 이용한 AWS운영 인텔리전스 확보:: Splunk 최승돈 :: AWS Summit Seoul 2016스플렁크를 이용한 AWS운영 인텔리전스 확보:: Splunk 최승돈 :: AWS Summit Seoul 2016
스플렁크를 이용한 AWS운영 인텔리전스 확보:: Splunk 최승돈 :: AWS Summit Seoul 2016
 
[금융사를 위한 AWS Generative AI Day 2023] 2_세상을 바꾸고 있는 Generative AI에...
[금융사를 위한 AWS Generative AI Day 2023] 2_세상을 바꾸고 있는 Generative AI에...[금융사를 위한 AWS Generative AI Day 2023] 2_세상을 바꾸고 있는 Generative AI에...
[금융사를 위한 AWS Generative AI Day 2023] 2_세상을 바꾸고 있는 Generative AI에...
 
introduction Azure OpenAI by Usama wahab khan
introduction  Azure OpenAI by Usama wahab khanintroduction  Azure OpenAI by Usama wahab khan
introduction Azure OpenAI by Usama wahab khan
 
Backing Up Amazon EC2 with Amazon EBS Snapshots (CMP301-R1) - AWS re:Invent 2018
Backing Up Amazon EC2 with Amazon EBS Snapshots (CMP301-R1) - AWS re:Invent 2018Backing Up Amazon EC2 with Amazon EBS Snapshots (CMP301-R1) - AWS re:Invent 2018
Backing Up Amazon EC2 with Amazon EBS Snapshots (CMP301-R1) - AWS re:Invent 2018
 
BDA301 An Introduction to Amazon Rekognition
BDA301 An Introduction to Amazon RekognitionBDA301 An Introduction to Amazon Rekognition
BDA301 An Introduction to Amazon Rekognition
 
Big Data Analytics Architectural Patterns and Best Practices (ANT201-R1) - AW...
Big Data Analytics Architectural Patterns and Best Practices (ANT201-R1) - AW...Big Data Analytics Architectural Patterns and Best Practices (ANT201-R1) - AW...
Big Data Analytics Architectural Patterns and Best Practices (ANT201-R1) - AW...
 
개인화 및 추천 기능의 맞춤형 AI 서비스 혁명: Amazon Personalize - 남궁영환 솔루션즈 아키텍트, AWS / 강성문 솔루...
개인화 및 추천 기능의 맞춤형 AI 서비스 혁명: Amazon Personalize - 남궁영환 솔루션즈 아키텍트, AWS / 강성문 솔루...개인화 및 추천 기능의 맞춤형 AI 서비스 혁명: Amazon Personalize - 남궁영환 솔루션즈 아키텍트, AWS / 강성문 솔루...
개인화 및 추천 기능의 맞춤형 AI 서비스 혁명: Amazon Personalize - 남궁영환 솔루션즈 아키텍트, AWS / 강성문 솔루...
 
[금융사를 위한 AWS Generative AI Day 2023] 4_AWS Generative AI 서비스의 활용 방ᄇ...
[금융사를 위한 AWS Generative AI Day 2023] 4_AWS Generative AI 서비스의 활용 방ᄇ...[금융사를 위한 AWS Generative AI Day 2023] 4_AWS Generative AI 서비스의 활용 방ᄇ...
[금융사를 위한 AWS Generative AI Day 2023] 4_AWS Generative AI 서비스의 활용 방ᄇ...
 
Building Advanced Workflows with AWS Glue (ANT333) - AWS re:Invent 2018
Building Advanced Workflows with AWS Glue (ANT333) - AWS re:Invent 2018Building Advanced Workflows with AWS Glue (ANT333) - AWS re:Invent 2018
Building Advanced Workflows with AWS Glue (ANT333) - AWS re:Invent 2018
 
Use Amazon Rekognition to Build a Facial Recognition System
Use Amazon Rekognition to Build a Facial Recognition SystemUse Amazon Rekognition to Build a Facial Recognition System
Use Amazon Rekognition to Build a Facial Recognition System
 
Deep Dive on Amazon S3 Security and Management (E2471STG303-R1) - AWS re:Inve...
Deep Dive on Amazon S3 Security and Management (E2471STG303-R1) - AWS re:Inve...Deep Dive on Amazon S3 Security and Management (E2471STG303-R1) - AWS re:Inve...
Deep Dive on Amazon S3 Security and Management (E2471STG303-R1) - AWS re:Inve...
 
Cost optimization on AWS
Cost optimization on AWSCost optimization on AWS
Cost optimization on AWS
 
Storage with Amazon S3 and Amazon Glacier
Storage with Amazon S3 and Amazon GlacierStorage with Amazon S3 and Amazon Glacier
Storage with Amazon S3 and Amazon Glacier
 
AWS IoT를 통해 클라우드로 세상을 연결하는 방법 - 이종화 솔루션즈 아키텍트, AWS / 최원근 솔루션즈 아키텍트, AWS :: AW...
AWS IoT를 통해 클라우드로 세상을 연결하는 방법 - 이종화 솔루션즈 아키텍트, AWS / 최원근 솔루션즈 아키텍트, AWS :: AW...AWS IoT를 통해 클라우드로 세상을 연결하는 방법 - 이종화 솔루션즈 아키텍트, AWS / 최원근 솔루션즈 아키텍트, AWS :: AW...
AWS IoT를 통해 클라우드로 세상을 연결하는 방법 - 이종화 솔루션즈 아키텍트, AWS / 최원근 솔루션즈 아키텍트, AWS :: AW...
 
Build a Serverless Application using GraphQL & AWS AppSync
Build a Serverless Application using GraphQL & AWS AppSyncBuild a Serverless Application using GraphQL & AWS AppSync
Build a Serverless Application using GraphQL & AWS AppSync
 

Similaire à Building Text Analytics Applications on AWS using Amazon Comprehend - AWS Online Tech Talks

AWS의 새로운 언어, 음성, 텍스트 처리 인공지능 서비스::Vikram Anbazhagan::AWS Summit Seoul 2018
AWS의 새로운 언어, 음성, 텍스트 처리 인공지능 서비스::Vikram Anbazhagan::AWS Summit Seoul 2018AWS의 새로운 언어, 음성, 텍스트 처리 인공지능 서비스::Vikram Anbazhagan::AWS Summit Seoul 2018
AWS의 새로운 언어, 음성, 텍스트 처리 인공지능 서비스::Vikram Anbazhagan::AWS Summit Seoul 2018
Amazon Web Services Korea
 

Similaire à Building Text Analytics Applications on AWS using Amazon Comprehend - AWS Online Tech Talks (20)

Create Advanced Text Analytics Solutions with NLP - BDA310 - New York AWS Sum...
Create Advanced Text Analytics Solutions with NLP - BDA310 - New York AWS Sum...Create Advanced Text Analytics Solutions with NLP - BDA310 - New York AWS Sum...
Create Advanced Text Analytics Solutions with NLP - BDA310 - New York AWS Sum...
 
Serverless Text Analytics with Amazon Comprehend
Serverless Text Analytics with Amazon ComprehendServerless Text Analytics with Amazon Comprehend
Serverless Text Analytics with Amazon Comprehend
 
AWS Machine Learning Week SF: Build Intelligent Applications with AWS ML Serv...
AWS Machine Learning Week SF: Build Intelligent Applications with AWS ML Serv...AWS Machine Learning Week SF: Build Intelligent Applications with AWS ML Serv...
AWS Machine Learning Week SF: Build Intelligent Applications with AWS ML Serv...
 
Add Intelligence to Applications with AWS ML Services: Machine Learning Week ...
Add Intelligence to Applications with AWS ML Services: Machine Learning Week ...Add Intelligence to Applications with AWS ML Services: Machine Learning Week ...
Add Intelligence to Applications with AWS ML Services: Machine Learning Week ...
 
Add Intelligence to Applications with AWS ML Services
Add Intelligence to Applications with AWS ML ServicesAdd Intelligence to Applications with AWS ML Services
Add Intelligence to Applications with AWS ML Services
 
BDA302 Building Intelligent Apps with AWS Machine Learning Language Services
BDA302 Building Intelligent Apps with AWS Machine Learning Language ServicesBDA302 Building Intelligent Apps with AWS Machine Learning Language Services
BDA302 Building Intelligent Apps with AWS Machine Learning Language Services
 
Building Text Analytics Solutions with AWS ML Services
Building Text Analytics Solutions with AWS ML ServicesBuilding Text Analytics Solutions with AWS ML Services
Building Text Analytics Solutions with AWS ML Services
 
Add Intelligence to Applications with AWS ML Services
Add Intelligence to Applications with AWS ML ServicesAdd Intelligence to Applications with AWS ML Services
Add Intelligence to Applications with AWS ML Services
 
Sviluppare applicazioni voice-first con AWS e Amazon Alexa
Sviluppare applicazioni voice-first con AWS e Amazon AlexaSviluppare applicazioni voice-first con AWS e Amazon Alexa
Sviluppare applicazioni voice-first con AWS e Amazon Alexa
 
Build Intelligent Apps with Amazon ML
Build Intelligent Apps with Amazon ML Build Intelligent Apps with Amazon ML
Build Intelligent Apps with Amazon ML
 
Mike Gillespie - Build Intelligent Applications with AWS ML Services (200).pdf
Mike Gillespie - Build Intelligent Applications with AWS ML Services (200).pdfMike Gillespie - Build Intelligent Applications with AWS ML Services (200).pdf
Mike Gillespie - Build Intelligent Applications with AWS ML Services (200).pdf
 
Introduction to AWS ML Application Services - BDA202 - Toronto AWS Summit
Introduction to AWS ML Application Services - BDA202 - Toronto AWS SummitIntroduction to AWS ML Application Services - BDA202 - Toronto AWS Summit
Introduction to AWS ML Application Services - BDA202 - Toronto AWS Summit
 
AWS의 새로운 언어, 음성, 텍스트 처리 인공지능 서비스::Vikram Anbazhagan::AWS Summit Seoul 2018
AWS의 새로운 언어, 음성, 텍스트 처리 인공지능 서비스::Vikram Anbazhagan::AWS Summit Seoul 2018AWS의 새로운 언어, 음성, 텍스트 처리 인공지능 서비스::Vikram Anbazhagan::AWS Summit Seoul 2018
AWS의 새로운 언어, 음성, 텍스트 처리 인공지능 서비스::Vikram Anbazhagan::AWS Summit Seoul 2018
 
Use Amazon Comprehend and Amazon SageMaker to Gain Insight from Text
Use Amazon Comprehend and Amazon SageMaker to Gain Insight from TextUse Amazon Comprehend and Amazon SageMaker to Gain Insight from Text
Use Amazon Comprehend and Amazon SageMaker to Gain Insight from Text
 
Add Intelligence to Applications with AWS ML: Machine Learning Workshops SF
Add Intelligence to Applications with AWS ML: Machine Learning Workshops SFAdd Intelligence to Applications with AWS ML: Machine Learning Workshops SF
Add Intelligence to Applications with AWS ML: Machine Learning Workshops SF
 
NEW LAUNCH! Natural Language Processing for Data Analytics - MCL343 - re:Inve...
NEW LAUNCH! Natural Language Processing for Data Analytics - MCL343 - re:Inve...NEW LAUNCH! Natural Language Processing for Data Analytics - MCL343 - re:Inve...
NEW LAUNCH! Natural Language Processing for Data Analytics - MCL343 - re:Inve...
 
Social Media Analytics using Amazon QuickSight - AWS Online Tech Talks
Social Media Analytics using Amazon QuickSight - AWS Online Tech TalksSocial Media Analytics using Amazon QuickSight - AWS Online Tech Talks
Social Media Analytics using Amazon QuickSight - AWS Online Tech Talks
 
Darin_Briskman_AWS_Machine_Learning_Beyond_the_Hype
Darin_Briskman_AWS_Machine_Learning_Beyond_the_HypeDarin_Briskman_AWS_Machine_Learning_Beyond_the_Hype
Darin_Briskman_AWS_Machine_Learning_Beyond_the_Hype
 
Build Intelligent Apps with Amazon ML - Language Services - BDA302 - Chicago ...
Build Intelligent Apps with Amazon ML - Language Services - BDA302 - Chicago ...Build Intelligent Apps with Amazon ML - Language Services - BDA302 - Chicago ...
Build Intelligent Apps with Amazon ML - Language Services - BDA302 - Chicago ...
 
Build Text Analytics Solutions with Amazon Comprehend and Amazon Translate
Build Text Analytics Solutions with Amazon Comprehend and Amazon TranslateBuild Text Analytics Solutions with Amazon Comprehend and Amazon Translate
Build Text Analytics Solutions with Amazon Comprehend and Amazon Translate
 

Plus de Amazon Web Services

Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
Amazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
Amazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
Amazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
Amazon Web Services
 

Plus de Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

Building Text Analytics Applications on AWS using Amazon Comprehend - AWS Online Tech Talks

  • 1. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Nino Bice, Product Manager Ben Snively, Service Architect Amazon Comprehend Fully Managed, Continuously Trained NLP Service
  • 2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Frameworks & Infrastructure AWS Deep Learning AMI GPU (P3 Instances) MobileCPU IoT (Greengrass) Vision: Rekognition Image Rekognition Video Speech: Polly Transcribe Language: Lex Translate Comprehend Apache MXNet PyTorch Cognitive Toolkit Keras Caffe2 & Caffe TensorFlow Gluon Application Services Platform Services Amazon Machine Learning Mechanical Turk Spark & EMR Amazon SageMaker AWS DeepLens Amazon confidential AWS ML Stack
  • 3. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Transcribe Automatic conversion of speech into accurate, grammatically correct text Amazon Translate Natural and fluent language translation Amazon Polly Turn text into lifelike speech using deep learning Amazon Comprehend Discover insights and relationships in text Amazon Lex Conversational interfaces for text-based and voice-based applications Powerful language capabilities
  • 4. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Comprehend A fully managed and continuously trained service that helps you extract insights from unstructured text
  • 5. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Comprehend Sentiment Entities LanguagesKey phrases Topic modeling
  • 6. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Comprehend: Natural Language Processing A m a z o n . c o m , I n c . i s l o c a t e d i n S e a t t l e , WA a n d w a s f o u n d e d J u l y 5 t h , 1 9 9 4 b y J e f f B e z o s . O u r c u s t o m e r s l o v e b u y i n g e v e r y t h i n g f r o m b o o k s t o b l e n d e r s a t g r e a t p r i c e s N a m e d E n t i t i e s • A m a z o n . c o m : O r g a n i z a t i o n • S e a t t l e , W A : L o c a t i o n • J u l y 5 t h , 1 9 9 4 : D a t e • J e f f B e z o s : P e r s o n K e y p h r a s e s • O u r c u s t o m e r s • b o o k s • b l e n d e r s • g r e a t p r i c e s S e n t i m e n t • P o s i t i v e L a n g u a g e • E n g l i s h
  • 7. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Topic Modeling Document Topic Proportion Doc.txt 0 .89 Doc.txt 1 .67 Doc.txt 2 .91 Topic Term Weight 0 Washington .89 1 Silicon Valley .67 2 Roasting .91 Keywords Topic Groups Document Relationship to Topics
  • 8. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Data Collection Web Crawling Internal Data Warehouse Purchase Datasets Annotation Orchestration Data Cleansing Annotation Evaluation Model Training Build Experiment Optimize Deploy Dockerize Deploy Host Continuous Improvement Sample Data Annotate and Evaluate Repeat Steps 3 - 5 1. 2. 3. 4. 5. Continuously Training
  • 9. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Comprehend Portal
  • 10. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS Text Analytics
  • 11. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Popular Text Analytics Use Cases Content Personalization: Customers are using Comprehend NLP output to understand related documents based on entities, phrases or even topic similarities for trends analysis, to drive content personalization and recommendations Semantic Search: Customers using Amazon Comprehend to index entities for boosting and ranking search results. Intelligent data warehouse: Customers are using Amazon Comprehend to query unstructured data in relational databases, processing data within the data lake (S3) and then inserting it back into the data warehouse Social Analytics: Customers are using Amazon Comprehend to ingest, process and analyze trends from entities and sentiment from social media posts across Twitter and Facebook.
  • 12. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS Text Analytics Workload Amazon Kinesis Amazon ES Amazon Redshift Amazon EMR • Semantic • Rich Filtering • Grouping, Trends • Joining, Correlating • Clustering • Graph, Search • Near real-time • Alerts Amazon S3 Social Media, Support Amazon Aurora Articles, Documents
  • 13. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Comprehend and Glue
  • 14. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. UDF to Call Comprehend
  • 15. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Comprehend and RDS
  • 16. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Stored Procedure to Comprehend
  • 17. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Demo: Comprehend and RDS
  • 18. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 19. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Comprehend and Elasticsearch
  • 20. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Comprehend and SageMaker
  • 21. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.