SlideShare une entreprise Scribd logo
1  sur  65
Lec-15 Natural language processing NLU Techniques  Prepared by Shah khalid Department  of Computer Science, University of Peshawar Lecture 15   بسم الله الرحمن الرحيم
Department  of Computer Science, University of Peshawar Typical NLP System Natural Language input parsing generation Internal representation Natural Language output Inference/retrieval
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],NLP Department  of Computer Science, University of Peshawar Recap
[object Object],[object Object],[object Object],[object Object],[object Object],NLP Department  of Computer Science, University of Peshawar
NLP Department  of Computer Science, University of Peshawar Department  of Computer Science, University of Peshawar There were two man blocking my escape. One held a hammer; one had nothing in his hands. I knew that I could not hit both of them. I hit a man with the hammer. Problem  Solution  Ambiguity  Put the idea in context.  Imprecision  Relate the idea to a familiar situation. Incompleteness  Complete the idea based on our expectations of likely events. Inaccuracy  Infer the intended meaning by recognizing familiar patterns.
How can a machine understand these differences? ,[object Object],/26 NLP Department  of Computer Science, University of Peshawar
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],NLP Department  of Computer Science, University of Peshawar
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Department  of Computer Science, University of Peshawar NLU TECHNIQUES.
[object Object],[object Object],[object Object],Department  of Computer Science, University of Peshawar Syntax analysis
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Department  of Computer Science, University of Peshawar Parsing
7 Traditional POS Categories ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],/39 Syntax analysis Department  of Computer Science, University of Peshawar
The main structure rules ,[object Object],[object Object],[object Object],[object Object],Parsing Department  of Computer Science, University of Peshawar
[object Object],Department  of Computer Science, University of Peshawar Parse Tree sentence noun phrase verb phrase article  adjective noun verb  noun phrase article  adjective  noun The  large  cat  eats  the  small  rat
Example  The children put the toy in the box V PP in NP P the Det N box The N put S NP VP Det children NP the Det N toy Parse Tree Department  of Computer Science, University of Peshawar
Draw the tree diagram. ,[object Object],[object Object],[object Object],[object Object],[object Object],Parsing Department  of Computer Science, University of Peshawar
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Department  of Computer Science, University of Peshawar Semantic analysis
[object Object],[object Object],[object Object],[object Object],Department  of Computer Science, University of Peshawar MORPHOLOGY
[object Object],[object Object],[object Object],Department  of Computer Science, University of Peshawar PRAGMATICS.
[object Object],[object Object],Department  of Computer Science, University of Peshawar DISCOURSE ANALYSIS
[object Object],[object Object],[object Object],[object Object],[object Object],Department  of Computer Science, University of Peshawar NLG
Lec-16 MACHINE TRANSLATION ( MT ) Prepared by Shah khalid Department  of Computer Science, University of Peshawar Lecture 16   بسم الله الرحمن الرحيم
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Department  of Computer Science, University of Peshawar Machine translation (MT)
[object Object],Machine translation (MT) Department  of Computer Science, University of Peshawar Arabic  Bulgarian  Catalan  Chinese Croatian  Czech  Danish  Dutch  Filipino  Finnish  French German  Greek  Hebrew  Hindi  Indonesian  Italian  Japanese  Korean  Latvian  Lithuanian Norwegian Polish  Portuguese  Romanian  Russian  Serbian  Slovak  Slovenian  Spanish  Swedish  Ukrainian  Vietnamese
Machine translation (MT) Department  of Computer Science, University of Peshawar
“ BBC found similar support”!!! Machine translation (MT) Department  of Computer Science, University of Peshawar
Department  of Computer Science, University of Peshawar Machine Translation
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Department  of Computer Science, University of Peshawar Translation
[object Object],[object Object],[object Object],Department  of Computer Science, University of Peshawar Types of MT
[object Object],[object Object],[object Object],[object Object],[object Object],Department  of Computer Science, University of Peshawar Advantages of MT
[object Object],[object Object],[object Object],[object Object],Advantages of MT Department  of Computer Science, University of Peshawar
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Department  of Computer Science, University of Peshawar Causes Of Failure
[object Object],[object Object],[object Object],Causes Of Failure Department  of Computer Science, University of Peshawar
Translation Divergences  English John  swam  across the river quickly Spanish Juan cruzó rapidamente el río nadando Gloss: John  crossed  fast the river swimming Arabic اسرع جون عبور النهر سباحة Gloss:  sped  john crossing the-river swimming Chinese 约翰   快速   地   游   过   这   条   河 Gloss: John  quickly  (DE)  swam   cross    the  (Quantifier)    river Russian Джон быстро переплыл реку  Gloss: John quickly  cross-swam  river
Multilingual Challenges ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Multilingual Challenges  Morphological Variations ,[object Object],Needs of MT Department  of Computer Science, University of Peshawar write  writt en كتب    م كت و ب kill  kill ed قتل  م قت و ل do  do ne فعل  م فع و ل conj noun plural article And   the  car s  and   the   car s و ال سيار ات  w   Al   SyAr At Et   le s  voiture s  et   le   voiture s
[object Object],[object Object],[object Object],[object Object],Department  of Computer Science, University of Peshawar Needs of MT
[object Object],[object Object],[object Object],Department  of Computer Science, University of Peshawar Various MT strategies
[object Object],[object Object],[object Object],[object Object],[object Object],Department  of Computer Science, University of Peshawar Direct strategy
[object Object],[object Object],[object Object],[object Object],[object Object],Department  of Computer Science, University of Peshawar Transfer approach
[object Object],[object Object],[object Object],[object Object],Department  of Computer Science, University of Peshawar Interlingua strategy SL Intermediate representation TL
Interlingua Syntactic Parsing Semantic  Analysis Sentence Planning Text Generation Source (Arabic) Target (English) Transfer Rules Department  of Computer Science, University of Peshawar MT
LECTURE 17 Dictionary    BY:  SHAH KHALID DICTIONARY Department  of Computer Science, University of Peshawar
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Department  of Computer Science, University of Peshawar DICTIONARY
Dictionaries  are books that list all the words in a language.  DICTIONARY Department  of Computer Science, University of Peshawar
To make dictionaries easier to use, the words are organized in  alphabetical order .  So to use a dictionary  easily , you must know how to alphabetize words. Department  of Computer Science, University of Peshawar DICTIONARY
Since there are so many words in a dictionary,  guide words  are used to help you locate a word quickly. What are  guide words ? Department  of Computer Science, University of Peshawar
Guide words  are found at the top of each page.  They tell you the  first  and  last  word that is found on that page. Department  of Computer Science, University of Peshawar DICTIONARY
How do  guide words  help you find a word quickly? Instead of looking at each word on a page, which could take forever, you just look at the  guide words  and then use what you know about alphabetizing words to decide if your word would be found on that page. Department  of Computer Science, University of Peshawar DICTIONARY
Let’s see what that means- Let’s pretend we are looking up the word,  science .  First we would turn to the  S  section.   Department  of Computer Science, University of Peshawar DICTIONARY
Then we would use the guide words and what we know about alphabetizing words to decide the correct page in the  S  section. Department  of Computer Science, University of Peshawar DICTIONARY
We would look at the guide words at the top of each page and decide between which ones our word would come in alphabetical order. Department  of Computer Science, University of Peshawar DICTIONARY
Let’s do that for the word  science - Which one of these pages would contain the word  science ? Department  of Computer Science, University of Peshawar DICTIONARY
The page with the guide words- stamp - summer Or the page with the guide words- sandwich - seventy science Department  of Computer Science, University of Peshawar DICTIONARY
AN INTRODUCTION TO MECHANICAL DICTIONARIES What do they mean? Department  of Computer Science, University of Peshawar DICTIONARY
Monolingual Dictionary  ,[object Object],[object Object],[object Object],[object Object],Department  of Computer Science, University of Peshawar DICTIONARY
[object Object],[object Object],Department  of Computer Science, University of Peshawar DICTIONARY
[object Object],[object Object],Department  of Computer Science, University of Peshawar DICTIONARY
[object Object],[object Object],[object Object],The word being defined is followed by the pronunciation in parenthesis. Department  of Computer Science, University of Peshawar DICTIONARY
[object Object],[object Object],[object Object],The first word tells the word’s part of speech Department  of Computer Science, University of Peshawar DICTIONARY
[object Object],[object Object],The next section is the actual definition of the word. Department  of Computer Science, University of Peshawar DICTIONARY
[object Object],[object Object],Finally, you might see a sentence showing how the word is used.  Especially if the use is not the most common for the word. Department  of Computer Science, University of Peshawar DICTIONARY
Let’s see what you’ve learned! mischief (miss-chif) noun  Playful behavior that may cause annoyance or harm to others.  My brother is always up to some sort of mischief. Department  of Computer Science, University of Peshawar DICTIONARY
[object Object],[object Object],[object Object],Department  of Computer Science, University of Peshawar DICTIONARY
Now you know the definition of  definition ! Department  of Computer Science, University of Peshawar DICTIONARY
Thank you very  much!!! Shah NLP Department  of Computer Science, University of Peshawar

Contenu connexe

Tendances

Amharic WSD using WordNet
Amharic WSD using WordNetAmharic WSD using WordNet
Amharic WSD using WordNetSeid Hassen
 
Natural language processing with python and amharic syntax parse tree by dani...
Natural language processing with python and amharic syntax parse tree by dani...Natural language processing with python and amharic syntax parse tree by dani...
Natural language processing with python and amharic syntax parse tree by dani...Daniel Adenew
 
Language translation english to hindi
Language translation english to hindiLanguage translation english to hindi
Language translation english to hindiRAJENDRA VERMA
 
Artificially Generatedof Concatenative Syllable based Text to Speech Synthesi...
Artificially Generatedof Concatenative Syllable based Text to Speech Synthesi...Artificially Generatedof Concatenative Syllable based Text to Speech Synthesi...
Artificially Generatedof Concatenative Syllable based Text to Speech Synthesi...iosrjce
 
A ROBUST THREE-STAGE HYBRID FRAMEWORK FOR ENGLISH TO BANGLA TRANSLITERATION
A ROBUST THREE-STAGE HYBRID FRAMEWORK FOR ENGLISH TO BANGLA TRANSLITERATIONA ROBUST THREE-STAGE HYBRID FRAMEWORK FOR ENGLISH TO BANGLA TRANSLITERATION
A ROBUST THREE-STAGE HYBRID FRAMEWORK FOR ENGLISH TO BANGLA TRANSLITERATIONkevig
 
Past, Present, and Future: Machine Translation & Natural Language Processing ...
Past, Present, and Future: Machine Translation & Natural Language Processing ...Past, Present, and Future: Machine Translation & Natural Language Processing ...
Past, Present, and Future: Machine Translation & Natural Language Processing ...John Tinsley
 
MORPHOLOGICAL ANALYZER USING THE BILSTM MODEL ONLY FOR JAPANESE HIRAGANA SENT...
MORPHOLOGICAL ANALYZER USING THE BILSTM MODEL ONLY FOR JAPANESE HIRAGANA SENT...MORPHOLOGICAL ANALYZER USING THE BILSTM MODEL ONLY FOR JAPANESE HIRAGANA SENT...
MORPHOLOGICAL ANALYZER USING THE BILSTM MODEL ONLY FOR JAPANESE HIRAGANA SENT...kevig
 
INTEGRATION OF PHONOTACTIC FEATURES FOR LANGUAGE IDENTIFICATION ON CODE-SWITC...
INTEGRATION OF PHONOTACTIC FEATURES FOR LANGUAGE IDENTIFICATION ON CODE-SWITC...INTEGRATION OF PHONOTACTIC FEATURES FOR LANGUAGE IDENTIFICATION ON CODE-SWITC...
INTEGRATION OF PHONOTACTIC FEATURES FOR LANGUAGE IDENTIFICATION ON CODE-SWITC...kevig
 
Natural Language Processing Theory, Applications and Difficulties
Natural Language Processing Theory, Applications and DifficultiesNatural Language Processing Theory, Applications and Difficulties
Natural Language Processing Theory, Applications and Difficultiesijtsrd
 
EXTRACTING LINGUISTIC SPEECH PATTERNS OF JAPANESE FICTIONAL CHARACTERS USING ...
EXTRACTING LINGUISTIC SPEECH PATTERNS OF JAPANESE FICTIONAL CHARACTERS USING ...EXTRACTING LINGUISTIC SPEECH PATTERNS OF JAPANESE FICTIONAL CHARACTERS USING ...
EXTRACTING LINGUISTIC SPEECH PATTERNS OF JAPANESE FICTIONAL CHARACTERS USING ...kevig
 
Natural Language Processing in Alternative and Augmentative Communication
Natural Language Processing in Alternative and Augmentative CommunicationNatural Language Processing in Alternative and Augmentative Communication
Natural Language Processing in Alternative and Augmentative CommunicationDivya Sugumar
 
Hindi –tamil text translation
Hindi –tamil text translationHindi –tamil text translation
Hindi –tamil text translationVaibhav Agarwal
 
Techniques in translation, computer assisted, machine translation, subtitling...
Techniques in translation, computer assisted, machine translation, subtitling...Techniques in translation, computer assisted, machine translation, subtitling...
Techniques in translation, computer assisted, machine translation, subtitling...Moses Altovar
 
Tutorial - Speech Synthesis System
Tutorial - Speech Synthesis SystemTutorial - Speech Synthesis System
Tutorial - Speech Synthesis SystemIJERA Editor
 

Tendances (20)

Amharic WSD using WordNet
Amharic WSD using WordNetAmharic WSD using WordNet
Amharic WSD using WordNet
 
Natural language processing with python and amharic syntax parse tree by dani...
Natural language processing with python and amharic syntax parse tree by dani...Natural language processing with python and amharic syntax parse tree by dani...
Natural language processing with python and amharic syntax parse tree by dani...
 
Machine translation
Machine translationMachine translation
Machine translation
 
Language translation english to hindi
Language translation english to hindiLanguage translation english to hindi
Language translation english to hindi
 
Artificially Generatedof Concatenative Syllable based Text to Speech Synthesi...
Artificially Generatedof Concatenative Syllable based Text to Speech Synthesi...Artificially Generatedof Concatenative Syllable based Text to Speech Synthesi...
Artificially Generatedof Concatenative Syllable based Text to Speech Synthesi...
 
Machine translator Introduction
Machine translator IntroductionMachine translator Introduction
Machine translator Introduction
 
A ROBUST THREE-STAGE HYBRID FRAMEWORK FOR ENGLISH TO BANGLA TRANSLITERATION
A ROBUST THREE-STAGE HYBRID FRAMEWORK FOR ENGLISH TO BANGLA TRANSLITERATIONA ROBUST THREE-STAGE HYBRID FRAMEWORK FOR ENGLISH TO BANGLA TRANSLITERATION
A ROBUST THREE-STAGE HYBRID FRAMEWORK FOR ENGLISH TO BANGLA TRANSLITERATION
 
Past, Present, and Future: Machine Translation & Natural Language Processing ...
Past, Present, and Future: Machine Translation & Natural Language Processing ...Past, Present, and Future: Machine Translation & Natural Language Processing ...
Past, Present, and Future: Machine Translation & Natural Language Processing ...
 
Machine Tanslation
Machine TanslationMachine Tanslation
Machine Tanslation
 
MORPHOLOGICAL ANALYZER USING THE BILSTM MODEL ONLY FOR JAPANESE HIRAGANA SENT...
MORPHOLOGICAL ANALYZER USING THE BILSTM MODEL ONLY FOR JAPANESE HIRAGANA SENT...MORPHOLOGICAL ANALYZER USING THE BILSTM MODEL ONLY FOR JAPANESE HIRAGANA SENT...
MORPHOLOGICAL ANALYZER USING THE BILSTM MODEL ONLY FOR JAPANESE HIRAGANA SENT...
 
**JUNK** (no subject)
**JUNK** (no subject)**JUNK** (no subject)
**JUNK** (no subject)
 
INTEGRATION OF PHONOTACTIC FEATURES FOR LANGUAGE IDENTIFICATION ON CODE-SWITC...
INTEGRATION OF PHONOTACTIC FEATURES FOR LANGUAGE IDENTIFICATION ON CODE-SWITC...INTEGRATION OF PHONOTACTIC FEATURES FOR LANGUAGE IDENTIFICATION ON CODE-SWITC...
INTEGRATION OF PHONOTACTIC FEATURES FOR LANGUAGE IDENTIFICATION ON CODE-SWITC...
 
Natural Language Processing Theory, Applications and Difficulties
Natural Language Processing Theory, Applications and DifficultiesNatural Language Processing Theory, Applications and Difficulties
Natural Language Processing Theory, Applications and Difficulties
 
Machine Translation
Machine TranslationMachine Translation
Machine Translation
 
EXTRACTING LINGUISTIC SPEECH PATTERNS OF JAPANESE FICTIONAL CHARACTERS USING ...
EXTRACTING LINGUISTIC SPEECH PATTERNS OF JAPANESE FICTIONAL CHARACTERS USING ...EXTRACTING LINGUISTIC SPEECH PATTERNS OF JAPANESE FICTIONAL CHARACTERS USING ...
EXTRACTING LINGUISTIC SPEECH PATTERNS OF JAPANESE FICTIONAL CHARACTERS USING ...
 
NLPinAAC
NLPinAACNLPinAAC
NLPinAAC
 
Natural Language Processing in Alternative and Augmentative Communication
Natural Language Processing in Alternative and Augmentative CommunicationNatural Language Processing in Alternative and Augmentative Communication
Natural Language Processing in Alternative and Augmentative Communication
 
Hindi –tamil text translation
Hindi –tamil text translationHindi –tamil text translation
Hindi –tamil text translation
 
Techniques in translation, computer assisted, machine translation, subtitling...
Techniques in translation, computer assisted, machine translation, subtitling...Techniques in translation, computer assisted, machine translation, subtitling...
Techniques in translation, computer assisted, machine translation, subtitling...
 
Tutorial - Speech Synthesis System
Tutorial - Speech Synthesis SystemTutorial - Speech Synthesis System
Tutorial - Speech Synthesis System
 

En vedette

13. Constantin Orasan (UoW) Natural Language Processing for Translation
13. Constantin Orasan (UoW) Natural Language Processing for Translation13. Constantin Orasan (UoW) Natural Language Processing for Translation
13. Constantin Orasan (UoW) Natural Language Processing for TranslationRIILP
 
Smart Data Webinar: Advances in Natural Language Processing
Smart Data Webinar: Advances in Natural Language ProcessingSmart Data Webinar: Advances in Natural Language Processing
Smart Data Webinar: Advances in Natural Language ProcessingDATAVERSITY
 
NLTK: Natural Language Processing made easy
NLTK: Natural Language Processing made easyNLTK: Natural Language Processing made easy
NLTK: Natural Language Processing made easyoutsider2
 
Agile Data Science 2.0
Agile Data Science 2.0Agile Data Science 2.0
Agile Data Science 2.0Russell Jurney
 
Introduction to PySpark
Introduction to PySparkIntroduction to PySpark
Introduction to PySparkRussell Jurney
 
Agile Data Science 2.0 - Big Data Science Meetup
Agile Data Science 2.0 - Big Data Science MeetupAgile Data Science 2.0 - Big Data Science Meetup
Agile Data Science 2.0 - Big Data Science MeetupRussell Jurney
 
Study: The Future of VR, AR and Self-Driving Cars
Study: The Future of VR, AR and Self-Driving CarsStudy: The Future of VR, AR and Self-Driving Cars
Study: The Future of VR, AR and Self-Driving CarsLinkedIn
 

En vedette (10)

13. Constantin Orasan (UoW) Natural Language Processing for Translation
13. Constantin Orasan (UoW) Natural Language Processing for Translation13. Constantin Orasan (UoW) Natural Language Processing for Translation
13. Constantin Orasan (UoW) Natural Language Processing for Translation
 
Pxc3898474
Pxc3898474Pxc3898474
Pxc3898474
 
Agile Science
Agile ScienceAgile Science
Agile Science
 
Smart Data Webinar: Advances in Natural Language Processing
Smart Data Webinar: Advances in Natural Language ProcessingSmart Data Webinar: Advances in Natural Language Processing
Smart Data Webinar: Advances in Natural Language Processing
 
NLTK: Natural Language Processing made easy
NLTK: Natural Language Processing made easyNLTK: Natural Language Processing made easy
NLTK: Natural Language Processing made easy
 
Agile Data Science 2.0
Agile Data Science 2.0Agile Data Science 2.0
Agile Data Science 2.0
 
Introduction to PySpark
Introduction to PySparkIntroduction to PySpark
Introduction to PySpark
 
Agile Data Science 2.0 - Big Data Science Meetup
Agile Data Science 2.0 - Big Data Science MeetupAgile Data Science 2.0 - Big Data Science Meetup
Agile Data Science 2.0 - Big Data Science Meetup
 
Discourse Analysis ppt
Discourse Analysis pptDiscourse Analysis ppt
Discourse Analysis ppt
 
Study: The Future of VR, AR and Self-Driving Cars
Study: The Future of VR, AR and Self-Driving CarsStudy: The Future of VR, AR and Self-Driving Cars
Study: The Future of VR, AR and Self-Driving Cars
 

Similaire à Lec 15,16,17 NLP.machine translation

Natural language procssing
Natural language procssing Natural language procssing
Natural language procssing Rajnish Raj
 
Introduction to development of lexical databases
Introduction to development of lexical databasesIntroduction to development of lexical databases
Introduction to development of lexical databasesMuhammad Shoaib Chaudhary
 
Segmentation Words for Speech Synthesis in Persian Language Based On Silence
Segmentation Words for Speech Synthesis in Persian Language Based On SilenceSegmentation Words for Speech Synthesis in Persian Language Based On Silence
Segmentation Words for Speech Synthesis in Persian Language Based On Silencepaperpublications3
 
Moore_slides.ppt
Moore_slides.pptMoore_slides.ppt
Moore_slides.pptbutest
 
Segmentation Words for Speech Synthesis in Persian Language Based On Silence
Segmentation Words for Speech Synthesis in Persian Language Based On SilenceSegmentation Words for Speech Synthesis in Persian Language Based On Silence
Segmentation Words for Speech Synthesis in Persian Language Based On Silencepaperpublications3
 
Artificial Intelligence Notes Unit 4
Artificial Intelligence Notes Unit 4Artificial Intelligence Notes Unit 4
Artificial Intelligence Notes Unit 4DigiGurukul
 
NLP introduced and in 47 slides Lecture 1.ppt
NLP introduced and in 47 slides Lecture 1.pptNLP introduced and in 47 slides Lecture 1.ppt
NLP introduced and in 47 slides Lecture 1.pptOlusolaTop
 
A SURVEY OF GRAMMAR CHECKERS FOR NATURAL LANGUAGES
A SURVEY OF GRAMMAR CHECKERS FOR NATURAL LANGUAGESA SURVEY OF GRAMMAR CHECKERS FOR NATURAL LANGUAGES
A SURVEY OF GRAMMAR CHECKERS FOR NATURAL LANGUAGESLinda Garcia
 
Shallow parser for hindi language with an input from a transliterator
Shallow parser for hindi language with an input from a transliteratorShallow parser for hindi language with an input from a transliterator
Shallow parser for hindi language with an input from a transliteratorShashank Shisodia
 
A performance of svm with modified lesk approach for word sense disambiguatio...
A performance of svm with modified lesk approach for word sense disambiguatio...A performance of svm with modified lesk approach for word sense disambiguatio...
A performance of svm with modified lesk approach for word sense disambiguatio...eSAT Journals
 
Natural language processing
Natural language processingNatural language processing
Natural language processingRobert Antony
 
Natural language processing
Natural language processingNatural language processing
Natural language processingprashantdahake
 

Similaire à Lec 15,16,17 NLP.machine translation (20)

Natural language procssing
Natural language procssing Natural language procssing
Natural language procssing
 
NLP-my-lecture (3).ppt
NLP-my-lecture (3).pptNLP-my-lecture (3).ppt
NLP-my-lecture (3).ppt
 
Nlp
NlpNlp
Nlp
 
Introduction to development of lexical databases
Introduction to development of lexical databasesIntroduction to development of lexical databases
Introduction to development of lexical databases
 
NLP
NLPNLP
NLP
 
NLP
NLPNLP
NLP
 
REPORT.doc
REPORT.docREPORT.doc
REPORT.doc
 
Segmentation Words for Speech Synthesis in Persian Language Based On Silence
Segmentation Words for Speech Synthesis in Persian Language Based On SilenceSegmentation Words for Speech Synthesis in Persian Language Based On Silence
Segmentation Words for Speech Synthesis in Persian Language Based On Silence
 
Moore_slides.ppt
Moore_slides.pptMoore_slides.ppt
Moore_slides.ppt
 
Segmentation Words for Speech Synthesis in Persian Language Based On Silence
Segmentation Words for Speech Synthesis in Persian Language Based On SilenceSegmentation Words for Speech Synthesis in Persian Language Based On Silence
Segmentation Words for Speech Synthesis in Persian Language Based On Silence
 
Artificial Intelligence Notes Unit 4
Artificial Intelligence Notes Unit 4Artificial Intelligence Notes Unit 4
Artificial Intelligence Notes Unit 4
 
NLP introduced and in 47 slides Lecture 1.ppt
NLP introduced and in 47 slides Lecture 1.pptNLP introduced and in 47 slides Lecture 1.ppt
NLP introduced and in 47 slides Lecture 1.ppt
 
A SURVEY OF GRAMMAR CHECKERS FOR NATURAL LANGUAGES
A SURVEY OF GRAMMAR CHECKERS FOR NATURAL LANGUAGESA SURVEY OF GRAMMAR CHECKERS FOR NATURAL LANGUAGES
A SURVEY OF GRAMMAR CHECKERS FOR NATURAL LANGUAGES
 
NLP
NLPNLP
NLP
 
Ijetcas14 458
Ijetcas14 458Ijetcas14 458
Ijetcas14 458
 
Shallow parser for hindi language with an input from a transliterator
Shallow parser for hindi language with an input from a transliteratorShallow parser for hindi language with an input from a transliterator
Shallow parser for hindi language with an input from a transliterator
 
Translationusing moses1
Translationusing moses1Translationusing moses1
Translationusing moses1
 
A performance of svm with modified lesk approach for word sense disambiguatio...
A performance of svm with modified lesk approach for word sense disambiguatio...A performance of svm with modified lesk approach for word sense disambiguatio...
A performance of svm with modified lesk approach for word sense disambiguatio...
 
Natural language processing
Natural language processingNatural language processing
Natural language processing
 
Natural language processing
Natural language processingNatural language processing
Natural language processing
 

Dernier

A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?Igalia
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsJoaquim Jorge
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessPixlogix Infotech
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 

Dernier (20)

A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 

Lec 15,16,17 NLP.machine translation

  • 1. Lec-15 Natural language processing NLU Techniques Prepared by Shah khalid Department of Computer Science, University of Peshawar Lecture 15 بسم الله الرحمن الرحيم
  • 2. Department of Computer Science, University of Peshawar Typical NLP System Natural Language input parsing generation Internal representation Natural Language output Inference/retrieval
  • 3.
  • 4.
  • 5. NLP Department of Computer Science, University of Peshawar Department of Computer Science, University of Peshawar There were two man blocking my escape. One held a hammer; one had nothing in his hands. I knew that I could not hit both of them. I hit a man with the hammer. Problem Solution Ambiguity Put the idea in context. Imprecision Relate the idea to a familiar situation. Incompleteness Complete the idea based on our expectations of likely events. Inaccuracy Infer the intended meaning by recognizing familiar patterns.
  • 6.
  • 7.
  • 8.
  • 9.
  • 10.
  • 11.
  • 12.
  • 13.
  • 14. Example The children put the toy in the box V PP in NP P the Det N box The N put S NP VP Det children NP the Det N toy Parse Tree Department of Computer Science, University of Peshawar
  • 15.
  • 16.
  • 17.
  • 18.
  • 19.
  • 20.
  • 21. Lec-16 MACHINE TRANSLATION ( MT ) Prepared by Shah khalid Department of Computer Science, University of Peshawar Lecture 16 بسم الله الرحمن الرحيم
  • 22.
  • 23.
  • 24. Machine translation (MT) Department of Computer Science, University of Peshawar
  • 25. “ BBC found similar support”!!! Machine translation (MT) Department of Computer Science, University of Peshawar
  • 26. Department of Computer Science, University of Peshawar Machine Translation
  • 27.
  • 28.
  • 29.
  • 30.
  • 31.
  • 32.
  • 33. Translation Divergences English John swam across the river quickly Spanish Juan cruzó rapidamente el río nadando Gloss: John crossed fast the river swimming Arabic اسرع جون عبور النهر سباحة Gloss: sped john crossing the-river swimming Chinese 约翰 快速 地 游 过 这 条 河 Gloss: John quickly  (DE) swam  cross  the (Quantifier)    river Russian Джон быстро переплыл реку Gloss: John quickly cross-swam river
  • 34.
  • 35.
  • 36.
  • 37.
  • 38.
  • 39.
  • 40.
  • 41. Interlingua Syntactic Parsing Semantic Analysis Sentence Planning Text Generation Source (Arabic) Target (English) Transfer Rules Department of Computer Science, University of Peshawar MT
  • 42. LECTURE 17 Dictionary BY: SHAH KHALID DICTIONARY Department of Computer Science, University of Peshawar
  • 43.
  • 44. Dictionaries are books that list all the words in a language. DICTIONARY Department of Computer Science, University of Peshawar
  • 45. To make dictionaries easier to use, the words are organized in alphabetical order . So to use a dictionary easily , you must know how to alphabetize words. Department of Computer Science, University of Peshawar DICTIONARY
  • 46. Since there are so many words in a dictionary, guide words are used to help you locate a word quickly. What are guide words ? Department of Computer Science, University of Peshawar
  • 47. Guide words are found at the top of each page. They tell you the first and last word that is found on that page. Department of Computer Science, University of Peshawar DICTIONARY
  • 48. How do guide words help you find a word quickly? Instead of looking at each word on a page, which could take forever, you just look at the guide words and then use what you know about alphabetizing words to decide if your word would be found on that page. Department of Computer Science, University of Peshawar DICTIONARY
  • 49. Let’s see what that means- Let’s pretend we are looking up the word, science . First we would turn to the S section. Department of Computer Science, University of Peshawar DICTIONARY
  • 50. Then we would use the guide words and what we know about alphabetizing words to decide the correct page in the S section. Department of Computer Science, University of Peshawar DICTIONARY
  • 51. We would look at the guide words at the top of each page and decide between which ones our word would come in alphabetical order. Department of Computer Science, University of Peshawar DICTIONARY
  • 52. Let’s do that for the word science - Which one of these pages would contain the word science ? Department of Computer Science, University of Peshawar DICTIONARY
  • 53. The page with the guide words- stamp - summer Or the page with the guide words- sandwich - seventy science Department of Computer Science, University of Peshawar DICTIONARY
  • 54. AN INTRODUCTION TO MECHANICAL DICTIONARIES What do they mean? Department of Computer Science, University of Peshawar DICTIONARY
  • 55.
  • 56.
  • 57.
  • 58.
  • 59.
  • 60.
  • 61.
  • 62. Let’s see what you’ve learned! mischief (miss-chif) noun Playful behavior that may cause annoyance or harm to others. My brother is always up to some sort of mischief. Department of Computer Science, University of Peshawar DICTIONARY
  • 63.
  • 64. Now you know the definition of definition ! Department of Computer Science, University of Peshawar DICTIONARY
  • 65. Thank you very much!!! Shah NLP Department of Computer Science, University of Peshawar

Notes de l'éditeur

  1. My work on palestinian, arabic mt and arabic hebrew mt Highlight similarities and differences A lot of similarities/differences not included