SlideShare une entreprise Scribd logo
1  sur  43
Natural Language Processing with Python Certification Course www.edureka.co
Natural Language Processing with Python Certification Course www.edureka.co
Text Mining
&
NLP
Natural Language Processing with Python Certification Course www.edureka.co
Today’s Training Topics
❖ Evolution of Human Language
❖ What is Text Mining?
❖ Text Mining and Natural Language Processing?
❖ Applications of NLP
❖ NLP Components and Demo
Natural Language Processing with Python Certification Course www.edureka.co
The Human Language
LANGUAGE
ALPHABETS
字母 वर्णमाला
ALFABETOS
‫األبجدية‬ எழுத்துக்கள்
Natural Language Processing with Python Certification Course www.edureka.co
The Human Language
LANGUAGE
ALPHABETS
字母 वर्णमाला ALFABETOS
‫األبجدية‬ எழுத்துக்கள்
Words form Sentences
Natural Language Processing with Python Certification Course www.edureka.co
The Human Language
LANGUAGE
ALPHABETS
字母 वर्णमाला ALFABETOS
‫األبجدية‬ எழுத்துக்கள்
Words form Sentences
Natural Language Processing with Python Certification Course www.edureka.co
The 21st Century
21 %
STRUCTURED
DATA
Natural Language Processing with Python Certification Course www.edureka.co
The 21st Century
STRUCTURED
DATA21 %
Unstructured
Natural Language Processing with Python Certification Course www.edureka.co
What is Text Mining ?
Text Mining / Text Analytics is the process of deriving
meaningful information from natural language text
Natural Language Processing with Python Certification Course www.edureka.co
Text Mining and NLP
As, Text Mining refers to
the process of deriving high quality
information from the text .
The overall goal is, essentially to turn
text into data for analysis, via
application of Natural Language
Processing (NLP)
Natural Language Processing with Python Certification Course www.edureka.co
What is NLP?
NLP: Natural Language Processing is a part of computer science
and artificial intelligence which deals with human languages.
Natural Language Processing with Python Certification Course www.edureka.co
Basic Structure of a NLP Application
Natural Language Processing with Python Certification Course www.edureka.co
Applications of NLP
Sentimental
Analysis
Speech
Recognition
Chatbot
Machine
Translation
Natural Language Processing with Python Certification Course www.edureka.co
Applications of NLP and Text Mining
Spell
Checking
Keyword
Search
Information
Extraction
Advertisement
Matching
Natural Language Processing with Python Certification Course www.edureka.co
Natural Language Processing with Python Certification Course www.edureka.co
NLP : Components
Natural Language Processing with Python Certification Course www.edureka.co
NLP : Components
Natural Language
Understanding
Natural Language
Generation
Natural Language Processing with Python Certification Course www.edureka.co
NLP : Components
Natural Language
Understanding
Natural Language
Generation
• Mapping input to useful representations
• Analyzing different aspects of the
language
• Text Planning
• Sentence Planning
• Text Realization
Natural Language Processing with Python Certification Course www.edureka.co
NLP : Ambiguity
Natural Language
Understanding
Lexical Ambiguity
Syntactic Ambiguity
Referential Ambiguity
Natural Language Processing with Python Certification Course www.edureka.co
NLU : Ambiguity
Lexical Ambiguity
Syntactic Ambiguity
Referential Ambiguity
She is looking for a match.
The fisherman went to the bank.
Natural Language Processing with Python Certification Course www.edureka.co
NLU : Ambiguity
Lexical Ambiguity
Syntactic Ambiguity
Referential Ambiguity
She is looking for a match.
The fisherman went to the bank.
The chicken is ready to eat.
Visiting relatives can be boring.
I saw the man with the binoculars.
Natural Language Processing with Python Certification Course www.edureka.co
NLU : Ambiguity
Lexical Ambiguity
Syntactic Ambiguity
Referential Ambiguity
She is looking for a match.
The fisherman went to the bank.
The chicken is ready to eat.
Visiting relatives can be boring.
I saw the man with the binoculars.
The boy told his father the theft. He was very upset
Natural Language Processing with Python Certification Course www.edureka.co
NLTK
Natural Language Processing with Python Certification Course www.edureka.co
NLTK
NLTK
Natural Language Processing with Python Certification Course www.edureka.co
NLTK
NLTK
Natural Language Processing with Python Certification Course www.edureka.co
Tokenization
01 Break a complex sentence into words
02 Understand the importance of each of the words with respect to the
sentence
03 Produce a structural description on an input sentence
Tokenization is the first step in NLP
Natural Language Processing with Python Certification Course www.edureka.co
Tokenization
01 Break a complex sentence into words
02 Understand the importance of each of the words with respect to the
sentence
03 Produce a structural description on an input sentence
Tokenization is the first step in NLP
Natural Language Processing with Python Certification Course www.edureka.co
Tokenization
Natural Language Processing with Python Certification Course www.edureka.co
Stemming
Affectation Affected Affection AffectingAffectionsAffects
Normalize words into its base form or root form
Natural Language Processing with Python Certification Course www.edureka.co
Stemming
Affect
Normalize words into its base form or root form
Natural Language Processing with Python Certification Course www.edureka.co
• Groups together different inflected forms of a
word, called Lemma
• Somehow similar to Stemming, as it maps
several words into one common root
• Output of Lemmatisation is a proper word
• For example, a Lemmatiser should
map gone, going and went into go
Lemmatization
Natural Language Processing with Python Certification Course www.edureka.co
Stop Words
Are they Helpful or Not
Natural Language Processing with Python Certification Course www.edureka.co
POS : Parts of Speech
Natural Language Processing with Python Certification Course www.edureka.co
POS : Tags and Descriptions
Natural Language Processing with Python Certification Course www.edureka.co
POS : Examples
The Dog killed the bat
DT NN VBD DT NN
SENTENCE
Natural Language Processing with Python Certification Course www.edureka.co
What are Named Entity Recognition ?
MOVIE
LOCATION
MONETARY VALUE
QUANTITIES
ORGANIZATION
PERSON
Natural Language Processing with Python Certification Course www.edureka.co
NER : Named Entity Recognition
Google’s CEO Sundar Pichai introduced the new Pixel at Minnesota Roi Centre Event
Organization Person Location Organization
Natural Language Processing with Python Certification Course www.edureka.co
Syntax
Natural Language Processing with Python Certification Course www.edureka.co
Phase Structure Rules
Natural Language Processing with Python Certification Course www.edureka.co
Syntax Tree
Syntax Tree is a tree representation of syntactic
structure of sentences or strings
Natural Language Processing with Python Certification Course www.edureka.co
Chunking
Picking up Individual pieces of Information and Grouping them into bigger Pieces
CHUNK
Natural Language Processing with Python Certification Course www.edureka.co
Chunking
CHUNKs
PRP VBD DT JJ NN
NP NP
We Caught the Black Panther
Natural Language Processing (NLP) & Text Mining Tutorial Using NLTK | NLP Training | Edureka

Contenu connexe

Tendances

Machine Learning Tutorial | Machine Learning Basics | Machine Learning Algori...
Machine Learning Tutorial | Machine Learning Basics | Machine Learning Algori...Machine Learning Tutorial | Machine Learning Basics | Machine Learning Algori...
Machine Learning Tutorial | Machine Learning Basics | Machine Learning Algori...Simplilearn
 
Text summarization
Text summarizationText summarization
Text summarizationkareemhashem
 
Natural language processing
Natural language processingNatural language processing
Natural language processingYogendra Tamang
 
Natural language processing (NLP) introduction
Natural language processing (NLP) introductionNatural language processing (NLP) introduction
Natural language processing (NLP) introductionRobert Lujo
 
Introduction to Natural Language Processing
Introduction to Natural Language ProcessingIntroduction to Natural Language Processing
Introduction to Natural Language ProcessingPranav Gupta
 
Natural Language Processing
Natural Language ProcessingNatural Language Processing
Natural Language ProcessingRishikese MR
 
Natural language processing (nlp)
Natural language processing (nlp)Natural language processing (nlp)
Natural language processing (nlp)Kuppusamy P
 
Natural language processing and transformer models
Natural language processing and transformer modelsNatural language processing and transformer models
Natural language processing and transformer modelsDing Li
 
Natural Language processing
Natural Language processingNatural Language processing
Natural Language processingSanzid Kawsar
 
Machine Learning Course | Edureka
Machine Learning Course | EdurekaMachine Learning Course | Edureka
Machine Learning Course | EdurekaEdureka!
 
An introduction to the Transformers architecture and BERT
An introduction to the Transformers architecture and BERTAn introduction to the Transformers architecture and BERT
An introduction to the Transformers architecture and BERTSuman Debnath
 
NLP using transformers
NLP using transformers NLP using transformers
NLP using transformers Arvind Devaraj
 
Introduction to Natural Language Processing (NLP)
Introduction to Natural Language Processing (NLP)Introduction to Natural Language Processing (NLP)
Introduction to Natural Language Processing (NLP)VenkateshMurugadas
 
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingBERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingMinh Pham
 
Question Answering System using machine learning approach
Question Answering System using machine learning approachQuestion Answering System using machine learning approach
Question Answering System using machine learning approachGarima Nanda
 
Natural language processing
Natural language processingNatural language processing
Natural language processingHansi Thenuwara
 

Tendances (20)

Machine Learning Tutorial | Machine Learning Basics | Machine Learning Algori...
Machine Learning Tutorial | Machine Learning Basics | Machine Learning Algori...Machine Learning Tutorial | Machine Learning Basics | Machine Learning Algori...
Machine Learning Tutorial | Machine Learning Basics | Machine Learning Algori...
 
Text summarization
Text summarizationText summarization
Text summarization
 
Text Classification
Text ClassificationText Classification
Text Classification
 
Natural language processing
Natural language processingNatural language processing
Natural language processing
 
Natural language processing (NLP) introduction
Natural language processing (NLP) introductionNatural language processing (NLP) introduction
Natural language processing (NLP) introduction
 
Introduction to Natural Language Processing
Introduction to Natural Language ProcessingIntroduction to Natural Language Processing
Introduction to Natural Language Processing
 
Natural Language Processing
Natural Language ProcessingNatural Language Processing
Natural Language Processing
 
Natural language processing (nlp)
Natural language processing (nlp)Natural language processing (nlp)
Natural language processing (nlp)
 
Natural language processing and transformer models
Natural language processing and transformer modelsNatural language processing and transformer models
Natural language processing and transformer models
 
Natural Language processing
Natural Language processingNatural Language processing
Natural Language processing
 
Machine Learning Course | Edureka
Machine Learning Course | EdurekaMachine Learning Course | Edureka
Machine Learning Course | Edureka
 
An introduction to the Transformers architecture and BERT
An introduction to the Transformers architecture and BERTAn introduction to the Transformers architecture and BERT
An introduction to the Transformers architecture and BERT
 
NLP using transformers
NLP using transformers NLP using transformers
NLP using transformers
 
NLP
NLPNLP
NLP
 
Introduction to Natural Language Processing (NLP)
Introduction to Natural Language Processing (NLP)Introduction to Natural Language Processing (NLP)
Introduction to Natural Language Processing (NLP)
 
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingBERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
 
Question Answering System using machine learning approach
Question Answering System using machine learning approachQuestion Answering System using machine learning approach
Question Answering System using machine learning approach
 
Bert
BertBert
Bert
 
Natural language processing
Natural language processingNatural language processing
Natural language processing
 
Question answering
Question answeringQuestion answering
Question answering
 

Similaire à Natural Language Processing (NLP) & Text Mining Tutorial Using NLTK | NLP Training | Edureka

Natural Language Processing (NLP)
Natural Language Processing (NLP)Natural Language Processing (NLP)
Natural Language Processing (NLP)Abdullah al Mamun
 
Language Learning & Technology with Young Learners
Language Learning & Technology with Young LearnersLanguage Learning & Technology with Young Learners
Language Learning & Technology with Young LearnersGraham Stanley
 
How to make multilingual plugins and themes
How to make multilingual plugins and themesHow to make multilingual plugins and themes
How to make multilingual plugins and themesjohnpbloch
 
AWS re:Invent 2016: NEW LAUNCH! Introducing Amazon Polly (MAC204)
AWS re:Invent 2016: NEW LAUNCH! Introducing Amazon Polly (MAC204)AWS re:Invent 2016: NEW LAUNCH! Introducing Amazon Polly (MAC204)
AWS re:Invent 2016: NEW LAUNCH! Introducing Amazon Polly (MAC204)Amazon Web Services
 
Verb conjugation class 601
Verb conjugation class 601Verb conjugation class 601
Verb conjugation class 601Barbara M. King
 
Pycon India 2018 Natural Language Processing Workshop
Pycon India 2018   Natural Language Processing WorkshopPycon India 2018   Natural Language Processing Workshop
Pycon India 2018 Natural Language Processing WorkshopLakshya Sivaramakrishnan
 
From Programming to Modeling And Back Again
From Programming to Modeling And Back AgainFrom Programming to Modeling And Back Again
From Programming to Modeling And Back AgainMarkus Voelter
 
NLTK: Natural Language Processing made easy
NLTK: Natural Language Processing made easyNLTK: Natural Language Processing made easy
NLTK: Natural Language Processing made easyoutsider2
 
Natural Language Processing made easy
Natural Language Processing made easyNatural Language Processing made easy
Natural Language Processing made easyGopi Krishnan Nambiar
 
Google BERT - SMX London 2020 Virtual Conference
Google BERT - SMX London 2020 Virtual ConferenceGoogle BERT - SMX London 2020 Virtual Conference
Google BERT - SMX London 2020 Virtual ConferenceDawn Anderson MSc DigM
 
Using OpenNLP with Solr to improve search relevance and to extract named enti...
Using OpenNLP with Solr to improve search relevance and to extract named enti...Using OpenNLP with Solr to improve search relevance and to extract named enti...
Using OpenNLP with Solr to improve search relevance and to extract named enti...Steve Rowe
 
Isabelle jones-lost in translation
Isabelle jones-lost in translationIsabelle jones-lost in translation
Isabelle jones-lost in translationIsabelle Jones
 
Apps: Moving Beyond Drill & Practice
Apps: Moving Beyond Drill & PracticeApps: Moving Beyond Drill & Practice
Apps: Moving Beyond Drill & Practicetousignantp
 
Google BERT - What SEOs and Marketers Need to Know
Google BERT - What SEOs and Marketers Need to KnowGoogle BERT - What SEOs and Marketers Need to Know
Google BERT - What SEOs and Marketers Need to KnowDawn Anderson MSc DigM
 
Apps: Moving Beyond Drill & Practice
Apps: Moving Beyond Drill & PracticeApps: Moving Beyond Drill & Practice
Apps: Moving Beyond Drill & Practicetousignantp
 
PPP to TBL Different approaches to language presentation
PPP to TBL Different approaches to language presentationPPP to TBL Different approaches to language presentation
PPP to TBL Different approaches to language presentationJo Gakonga
 

Similaire à Natural Language Processing (NLP) & Text Mining Tutorial Using NLTK | NLP Training | Edureka (20)

Unit Plan
Unit PlanUnit Plan
Unit Plan
 
NLP 1.pptx
NLP 1.pptxNLP 1.pptx
NLP 1.pptx
 
Natural Language Processing (NLP)
Natural Language Processing (NLP)Natural Language Processing (NLP)
Natural Language Processing (NLP)
 
Language Learning & Technology with Young Learners
Language Learning & Technology with Young LearnersLanguage Learning & Technology with Young Learners
Language Learning & Technology with Young Learners
 
How to make multilingual plugins and themes
How to make multilingual plugins and themesHow to make multilingual plugins and themes
How to make multilingual plugins and themes
 
AWS re:Invent 2016: NEW LAUNCH! Introducing Amazon Polly (MAC204)
AWS re:Invent 2016: NEW LAUNCH! Introducing Amazon Polly (MAC204)AWS re:Invent 2016: NEW LAUNCH! Introducing Amazon Polly (MAC204)
AWS re:Invent 2016: NEW LAUNCH! Introducing Amazon Polly (MAC204)
 
Python overview
Python overviewPython overview
Python overview
 
Verb conjugation class 601
Verb conjugation class 601Verb conjugation class 601
Verb conjugation class 601
 
Wordpower for ks3
Wordpower for ks3Wordpower for ks3
Wordpower for ks3
 
Pycon India 2018 Natural Language Processing Workshop
Pycon India 2018   Natural Language Processing WorkshopPycon India 2018   Natural Language Processing Workshop
Pycon India 2018 Natural Language Processing Workshop
 
From Programming to Modeling And Back Again
From Programming to Modeling And Back AgainFrom Programming to Modeling And Back Again
From Programming to Modeling And Back Again
 
NLTK: Natural Language Processing made easy
NLTK: Natural Language Processing made easyNLTK: Natural Language Processing made easy
NLTK: Natural Language Processing made easy
 
Natural Language Processing made easy
Natural Language Processing made easyNatural Language Processing made easy
Natural Language Processing made easy
 
Google BERT - SMX London 2020 Virtual Conference
Google BERT - SMX London 2020 Virtual ConferenceGoogle BERT - SMX London 2020 Virtual Conference
Google BERT - SMX London 2020 Virtual Conference
 
Using OpenNLP with Solr to improve search relevance and to extract named enti...
Using OpenNLP with Solr to improve search relevance and to extract named enti...Using OpenNLP with Solr to improve search relevance and to extract named enti...
Using OpenNLP with Solr to improve search relevance and to extract named enti...
 
Isabelle jones-lost in translation
Isabelle jones-lost in translationIsabelle jones-lost in translation
Isabelle jones-lost in translation
 
Apps: Moving Beyond Drill & Practice
Apps: Moving Beyond Drill & PracticeApps: Moving Beyond Drill & Practice
Apps: Moving Beyond Drill & Practice
 
Google BERT - What SEOs and Marketers Need to Know
Google BERT - What SEOs and Marketers Need to KnowGoogle BERT - What SEOs and Marketers Need to Know
Google BERT - What SEOs and Marketers Need to Know
 
Apps: Moving Beyond Drill & Practice
Apps: Moving Beyond Drill & PracticeApps: Moving Beyond Drill & Practice
Apps: Moving Beyond Drill & Practice
 
PPP to TBL Different approaches to language presentation
PPP to TBL Different approaches to language presentationPPP to TBL Different approaches to language presentation
PPP to TBL Different approaches to language presentation
 

Plus de Edureka!

What to learn during the 21 days Lockdown | Edureka
What to learn during the 21 days Lockdown | EdurekaWhat to learn during the 21 days Lockdown | Edureka
What to learn during the 21 days Lockdown | EdurekaEdureka!
 
Top 10 Dying Programming Languages in 2020 | Edureka
Top 10 Dying Programming Languages in 2020 | EdurekaTop 10 Dying Programming Languages in 2020 | Edureka
Top 10 Dying Programming Languages in 2020 | EdurekaEdureka!
 
Top 5 Trending Business Intelligence Tools | Edureka
Top 5 Trending Business Intelligence Tools | EdurekaTop 5 Trending Business Intelligence Tools | Edureka
Top 5 Trending Business Intelligence Tools | EdurekaEdureka!
 
Tableau Tutorial for Data Science | Edureka
Tableau Tutorial for Data Science | EdurekaTableau Tutorial for Data Science | Edureka
Tableau Tutorial for Data Science | EdurekaEdureka!
 
Python Programming Tutorial | Edureka
Python Programming Tutorial | EdurekaPython Programming Tutorial | Edureka
Python Programming Tutorial | EdurekaEdureka!
 
Top 5 PMP Certifications | Edureka
Top 5 PMP Certifications | EdurekaTop 5 PMP Certifications | Edureka
Top 5 PMP Certifications | EdurekaEdureka!
 
Top Maven Interview Questions in 2020 | Edureka
Top Maven Interview Questions in 2020 | EdurekaTop Maven Interview Questions in 2020 | Edureka
Top Maven Interview Questions in 2020 | EdurekaEdureka!
 
Linux Mint Tutorial | Edureka
Linux Mint Tutorial | EdurekaLinux Mint Tutorial | Edureka
Linux Mint Tutorial | EdurekaEdureka!
 
How to Deploy Java Web App in AWS| Edureka
How to Deploy Java Web App in AWS| EdurekaHow to Deploy Java Web App in AWS| Edureka
How to Deploy Java Web App in AWS| EdurekaEdureka!
 
Importance of Digital Marketing | Edureka
Importance of Digital Marketing | EdurekaImportance of Digital Marketing | Edureka
Importance of Digital Marketing | EdurekaEdureka!
 
RPA in 2020 | Edureka
RPA in 2020 | EdurekaRPA in 2020 | Edureka
RPA in 2020 | EdurekaEdureka!
 
Email Notifications in Jenkins | Edureka
Email Notifications in Jenkins | EdurekaEmail Notifications in Jenkins | Edureka
Email Notifications in Jenkins | EdurekaEdureka!
 
EA Algorithm in Machine Learning | Edureka
EA Algorithm in Machine Learning | EdurekaEA Algorithm in Machine Learning | Edureka
EA Algorithm in Machine Learning | EdurekaEdureka!
 
Cognitive AI Tutorial | Edureka
Cognitive AI Tutorial | EdurekaCognitive AI Tutorial | Edureka
Cognitive AI Tutorial | EdurekaEdureka!
 
AWS Cloud Practitioner Tutorial | Edureka
AWS Cloud Practitioner Tutorial | EdurekaAWS Cloud Practitioner Tutorial | Edureka
AWS Cloud Practitioner Tutorial | EdurekaEdureka!
 
Blue Prism Top Interview Questions | Edureka
Blue Prism Top Interview Questions | EdurekaBlue Prism Top Interview Questions | Edureka
Blue Prism Top Interview Questions | EdurekaEdureka!
 
Big Data on AWS Tutorial | Edureka
Big Data on AWS Tutorial | Edureka Big Data on AWS Tutorial | Edureka
Big Data on AWS Tutorial | Edureka Edureka!
 
A star algorithm | A* Algorithm in Artificial Intelligence | Edureka
A star algorithm | A* Algorithm in Artificial Intelligence | EdurekaA star algorithm | A* Algorithm in Artificial Intelligence | Edureka
A star algorithm | A* Algorithm in Artificial Intelligence | EdurekaEdureka!
 
Kubernetes Installation on Ubuntu | Edureka
Kubernetes Installation on Ubuntu | EdurekaKubernetes Installation on Ubuntu | Edureka
Kubernetes Installation on Ubuntu | EdurekaEdureka!
 
Introduction to DevOps | Edureka
Introduction to DevOps | EdurekaIntroduction to DevOps | Edureka
Introduction to DevOps | EdurekaEdureka!
 

Plus de Edureka! (20)

What to learn during the 21 days Lockdown | Edureka
What to learn during the 21 days Lockdown | EdurekaWhat to learn during the 21 days Lockdown | Edureka
What to learn during the 21 days Lockdown | Edureka
 
Top 10 Dying Programming Languages in 2020 | Edureka
Top 10 Dying Programming Languages in 2020 | EdurekaTop 10 Dying Programming Languages in 2020 | Edureka
Top 10 Dying Programming Languages in 2020 | Edureka
 
Top 5 Trending Business Intelligence Tools | Edureka
Top 5 Trending Business Intelligence Tools | EdurekaTop 5 Trending Business Intelligence Tools | Edureka
Top 5 Trending Business Intelligence Tools | Edureka
 
Tableau Tutorial for Data Science | Edureka
Tableau Tutorial for Data Science | EdurekaTableau Tutorial for Data Science | Edureka
Tableau Tutorial for Data Science | Edureka
 
Python Programming Tutorial | Edureka
Python Programming Tutorial | EdurekaPython Programming Tutorial | Edureka
Python Programming Tutorial | Edureka
 
Top 5 PMP Certifications | Edureka
Top 5 PMP Certifications | EdurekaTop 5 PMP Certifications | Edureka
Top 5 PMP Certifications | Edureka
 
Top Maven Interview Questions in 2020 | Edureka
Top Maven Interview Questions in 2020 | EdurekaTop Maven Interview Questions in 2020 | Edureka
Top Maven Interview Questions in 2020 | Edureka
 
Linux Mint Tutorial | Edureka
Linux Mint Tutorial | EdurekaLinux Mint Tutorial | Edureka
Linux Mint Tutorial | Edureka
 
How to Deploy Java Web App in AWS| Edureka
How to Deploy Java Web App in AWS| EdurekaHow to Deploy Java Web App in AWS| Edureka
How to Deploy Java Web App in AWS| Edureka
 
Importance of Digital Marketing | Edureka
Importance of Digital Marketing | EdurekaImportance of Digital Marketing | Edureka
Importance of Digital Marketing | Edureka
 
RPA in 2020 | Edureka
RPA in 2020 | EdurekaRPA in 2020 | Edureka
RPA in 2020 | Edureka
 
Email Notifications in Jenkins | Edureka
Email Notifications in Jenkins | EdurekaEmail Notifications in Jenkins | Edureka
Email Notifications in Jenkins | Edureka
 
EA Algorithm in Machine Learning | Edureka
EA Algorithm in Machine Learning | EdurekaEA Algorithm in Machine Learning | Edureka
EA Algorithm in Machine Learning | Edureka
 
Cognitive AI Tutorial | Edureka
Cognitive AI Tutorial | EdurekaCognitive AI Tutorial | Edureka
Cognitive AI Tutorial | Edureka
 
AWS Cloud Practitioner Tutorial | Edureka
AWS Cloud Practitioner Tutorial | EdurekaAWS Cloud Practitioner Tutorial | Edureka
AWS Cloud Practitioner Tutorial | Edureka
 
Blue Prism Top Interview Questions | Edureka
Blue Prism Top Interview Questions | EdurekaBlue Prism Top Interview Questions | Edureka
Blue Prism Top Interview Questions | Edureka
 
Big Data on AWS Tutorial | Edureka
Big Data on AWS Tutorial | Edureka Big Data on AWS Tutorial | Edureka
Big Data on AWS Tutorial | Edureka
 
A star algorithm | A* Algorithm in Artificial Intelligence | Edureka
A star algorithm | A* Algorithm in Artificial Intelligence | EdurekaA star algorithm | A* Algorithm in Artificial Intelligence | Edureka
A star algorithm | A* Algorithm in Artificial Intelligence | Edureka
 
Kubernetes Installation on Ubuntu | Edureka
Kubernetes Installation on Ubuntu | EdurekaKubernetes Installation on Ubuntu | Edureka
Kubernetes Installation on Ubuntu | Edureka
 
Introduction to DevOps | Edureka
Introduction to DevOps | EdurekaIntroduction to DevOps | Edureka
Introduction to DevOps | Edureka
 

Dernier

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesrafiqahmad00786416
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Victor Rentea
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelDeepika Singh
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century educationjfdjdjcjdnsjd
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...Zilliz
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Victor Rentea
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDropbox
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...apidays
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodJuan lago vázquez
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsNanddeep Nachan
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontologyjohnbeverley2021
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...apidays
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businesspanagenda
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdfSandro Moreira
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...apidays
 

Dernier (20)

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 

Natural Language Processing (NLP) & Text Mining Tutorial Using NLTK | NLP Training | Edureka

  • 1. Natural Language Processing with Python Certification Course www.edureka.co
  • 2. Natural Language Processing with Python Certification Course www.edureka.co Text Mining & NLP
  • 3. Natural Language Processing with Python Certification Course www.edureka.co Today’s Training Topics ❖ Evolution of Human Language ❖ What is Text Mining? ❖ Text Mining and Natural Language Processing? ❖ Applications of NLP ❖ NLP Components and Demo
  • 4. Natural Language Processing with Python Certification Course www.edureka.co The Human Language LANGUAGE ALPHABETS 字母 वर्णमाला ALFABETOS ‫األبجدية‬ எழுத்துக்கள்
  • 5. Natural Language Processing with Python Certification Course www.edureka.co The Human Language LANGUAGE ALPHABETS 字母 वर्णमाला ALFABETOS ‫األبجدية‬ எழுத்துக்கள் Words form Sentences
  • 6. Natural Language Processing with Python Certification Course www.edureka.co The Human Language LANGUAGE ALPHABETS 字母 वर्णमाला ALFABETOS ‫األبجدية‬ எழுத்துக்கள் Words form Sentences
  • 7. Natural Language Processing with Python Certification Course www.edureka.co The 21st Century 21 % STRUCTURED DATA
  • 8. Natural Language Processing with Python Certification Course www.edureka.co The 21st Century STRUCTURED DATA21 % Unstructured
  • 9. Natural Language Processing with Python Certification Course www.edureka.co What is Text Mining ? Text Mining / Text Analytics is the process of deriving meaningful information from natural language text
  • 10. Natural Language Processing with Python Certification Course www.edureka.co Text Mining and NLP As, Text Mining refers to the process of deriving high quality information from the text . The overall goal is, essentially to turn text into data for analysis, via application of Natural Language Processing (NLP)
  • 11. Natural Language Processing with Python Certification Course www.edureka.co What is NLP? NLP: Natural Language Processing is a part of computer science and artificial intelligence which deals with human languages.
  • 12. Natural Language Processing with Python Certification Course www.edureka.co Basic Structure of a NLP Application
  • 13. Natural Language Processing with Python Certification Course www.edureka.co Applications of NLP Sentimental Analysis Speech Recognition Chatbot Machine Translation
  • 14. Natural Language Processing with Python Certification Course www.edureka.co Applications of NLP and Text Mining Spell Checking Keyword Search Information Extraction Advertisement Matching
  • 15. Natural Language Processing with Python Certification Course www.edureka.co
  • 16. Natural Language Processing with Python Certification Course www.edureka.co NLP : Components
  • 17. Natural Language Processing with Python Certification Course www.edureka.co NLP : Components Natural Language Understanding Natural Language Generation
  • 18. Natural Language Processing with Python Certification Course www.edureka.co NLP : Components Natural Language Understanding Natural Language Generation • Mapping input to useful representations • Analyzing different aspects of the language • Text Planning • Sentence Planning • Text Realization
  • 19. Natural Language Processing with Python Certification Course www.edureka.co NLP : Ambiguity Natural Language Understanding Lexical Ambiguity Syntactic Ambiguity Referential Ambiguity
  • 20. Natural Language Processing with Python Certification Course www.edureka.co NLU : Ambiguity Lexical Ambiguity Syntactic Ambiguity Referential Ambiguity She is looking for a match. The fisherman went to the bank.
  • 21. Natural Language Processing with Python Certification Course www.edureka.co NLU : Ambiguity Lexical Ambiguity Syntactic Ambiguity Referential Ambiguity She is looking for a match. The fisherman went to the bank. The chicken is ready to eat. Visiting relatives can be boring. I saw the man with the binoculars.
  • 22. Natural Language Processing with Python Certification Course www.edureka.co NLU : Ambiguity Lexical Ambiguity Syntactic Ambiguity Referential Ambiguity She is looking for a match. The fisherman went to the bank. The chicken is ready to eat. Visiting relatives can be boring. I saw the man with the binoculars. The boy told his father the theft. He was very upset
  • 23. Natural Language Processing with Python Certification Course www.edureka.co NLTK
  • 24. Natural Language Processing with Python Certification Course www.edureka.co NLTK NLTK
  • 25. Natural Language Processing with Python Certification Course www.edureka.co NLTK NLTK
  • 26. Natural Language Processing with Python Certification Course www.edureka.co Tokenization 01 Break a complex sentence into words 02 Understand the importance of each of the words with respect to the sentence 03 Produce a structural description on an input sentence Tokenization is the first step in NLP
  • 27. Natural Language Processing with Python Certification Course www.edureka.co Tokenization 01 Break a complex sentence into words 02 Understand the importance of each of the words with respect to the sentence 03 Produce a structural description on an input sentence Tokenization is the first step in NLP
  • 28. Natural Language Processing with Python Certification Course www.edureka.co Tokenization
  • 29. Natural Language Processing with Python Certification Course www.edureka.co Stemming Affectation Affected Affection AffectingAffectionsAffects Normalize words into its base form or root form
  • 30. Natural Language Processing with Python Certification Course www.edureka.co Stemming Affect Normalize words into its base form or root form
  • 31. Natural Language Processing with Python Certification Course www.edureka.co • Groups together different inflected forms of a word, called Lemma • Somehow similar to Stemming, as it maps several words into one common root • Output of Lemmatisation is a proper word • For example, a Lemmatiser should map gone, going and went into go Lemmatization
  • 32. Natural Language Processing with Python Certification Course www.edureka.co Stop Words Are they Helpful or Not
  • 33. Natural Language Processing with Python Certification Course www.edureka.co POS : Parts of Speech
  • 34. Natural Language Processing with Python Certification Course www.edureka.co POS : Tags and Descriptions
  • 35. Natural Language Processing with Python Certification Course www.edureka.co POS : Examples The Dog killed the bat DT NN VBD DT NN SENTENCE
  • 36. Natural Language Processing with Python Certification Course www.edureka.co What are Named Entity Recognition ? MOVIE LOCATION MONETARY VALUE QUANTITIES ORGANIZATION PERSON
  • 37. Natural Language Processing with Python Certification Course www.edureka.co NER : Named Entity Recognition Google’s CEO Sundar Pichai introduced the new Pixel at Minnesota Roi Centre Event Organization Person Location Organization
  • 38. Natural Language Processing with Python Certification Course www.edureka.co Syntax
  • 39. Natural Language Processing with Python Certification Course www.edureka.co Phase Structure Rules
  • 40. Natural Language Processing with Python Certification Course www.edureka.co Syntax Tree Syntax Tree is a tree representation of syntactic structure of sentences or strings
  • 41. Natural Language Processing with Python Certification Course www.edureka.co Chunking Picking up Individual pieces of Information and Grouping them into bigger Pieces CHUNK
  • 42. Natural Language Processing with Python Certification Course www.edureka.co Chunking CHUNKs PRP VBD DT JJ NN NP NP We Caught the Black Panther