SlideShare une entreprise Scribd logo
Vol-1 Issue-2 2015 IJARIIE-ISSN(O)-2395-4396
1177 www.ijariie.com 326
A Literature review on Emotion Recognition
System Using Various Facial Expression
Dipika Raval1
, Mukesh Sakle2
1
Student, Information Technology, Parul Institute of Engineering & Technology, Gujarat, India
2
Assistant. Professor, Information Technology, Parul Institute of Engineering & Technology, Gujarat,
India
ABSTRACT
Recognition and extracting various emotions and then validating those emotions from the facial expressions has
become important for improving the overall human computer interaction. So this paper also describe about Emotion
Recognition Techniques. Emotion Recognition has become a progressive research area and it plays a major role in
Human-Computer-Interaction. For any Facial Expression Recognition, it is necessary to extract the features of face
that can be possibly used to detect the expression. For Feature Extraction the Principal Component Analysis will be
used. A survey of various techniques used in emotion recognition like PCA, LBP etc. is done in this paper and listing
their performance. The goal of this paper is to show the comparison with Other Recognition Techniques with
different approaches. And also describe the general step of the how to recognize emotion from various facial
expression
Keyword: -. Emotion Recognition, Facial Expression
I. INTRODUCTION
The human face plays an important role in communication. The face can express their feelings through emotions.
Face Expression approach [2] can be divided into three major steps so that the face in an image is known for further
processing, facial feature extraction which is the method used to represent the facial expressions and finally
classification which is the step that classifies the features extracted in the appropriate expressions. The facial
expression are for identifying the basic human emotion like anger, fear, happiness, sadness, and surprise.
Figure1 below showing the general step of emotion recognition. From the figure, there are three important phases of
overall system. First is face detection task in which first prominent features are extracted and then face is identified.
The second step is where the facial feature extraction and recognition of facial expressions to the overall features are
removed at the end of the last step in classification. Facial expressions of input image are then recognized.
Fig. 1 General step of emotion recognition
In this paper section II is provide the system overview of emotion recognition system. Section III describes the
techniques used for emotion recognition. Finally the paper concludes with the conclusion in section IV.
Vol-1 Issue-2 2015 IJARIIE-ISSN(O)-2395-4396
1177 www.ijariie.com 327
II. SYSTEM OVERVIEW
The process of emotion recognition involves the processing images and detecting the face then extracting the facial
feature. Facial Expression Recognition consists of three main steps. In first step face image is acquired and detect
the face region from the images and pre-processed the input image to obtain image that have a normalized size or
intensity. Next is expression features are extracted from the observed facial image or image sequence. Then
extracted features are given to the classifier and classifier provides the recognized expression as output as shown in
fig 1.
A. Face Detection and Pre-processing
The face detection is the process of extracting the face region from the background. It means to determine the
position of the face in the image. This step is require because images having a different scales. Input image having a
complex backgrounds and variety of lightning conditions can be also quite confusing in tracking. Face expression
recognition tends to fail if the test image has a different lighting condition than that of the training images. For that
facial point can be detected inaccurately for that pre-processing step is required.
B. Feature Extraction And Classification
Selecting a set of feature points which represent the important characteristics of the human face. After the face has
been located in the image, it can be analysed in terms of facial features. The features measure the certain parts of the
face such as eyebrows or mouth corners. Various methods exist which can extract feature for expression based on
motion of the feature such Active Appearance Model [6] which is statistical model of shape and gray scale
information. The Features describe the change in face texture when particular action is performed such as wrinkles,
bulges, forefront, regions surrounding the mouth and eyes. Image filters are used, applied to either the whole-face or
specific regions in a face image to extract a feature vector. Principal Component Analysis [3], Local Binary Pattern
(LBP)[4],Fisher’s Linear Discriminator[5] based approaches are the main categories of the approaches available.
After the set of features are extracted from the face region are used in classification stage. The set of features are
used to describe the facial expression. Classification requires supervised training, so the training set should consist
of labelled data. Once the classifier is trained, it can recognize input images by assigning them a particular class
label. The most commonly used facial expressions classification is done both in terms of Action Units, proposed in
Facial Action Coding System (FACS) [8] and in terms of six universal emotions: happy, sad, anger, surprise, disgust
and fear.
III. Techniques used for emotion recognition
A. Principal Component Analysis
Principal Components Analysis (PCA) ia a way of identifying patterns in data, and expressing the data in such a way
as to highlight their similarities and differences. The facial expression recognition using eigen faces in which PCA is
used to extract features from input image. First of all they create training dataset to compare result. Once inputted
face image is pre-processed and compare with training dataset which are already computed but based on the idea,
they divided the training set into six basic classes according to universal expression(Happy, Surprise, Disgust, sad,
Angry, Fear)[3].
B. Local Binary Pattern
Vol-1 Issue-2 2015 IJARIIE-ISSN(O)-2395-4396
1177 www.ijariie.com 328
LBP based feature extraction method is used owing to its excellent light invariance property and low computational
complexity [4]. The neighbourhood values are threshold by the centre value and the result is treated as a binary
number. If the canter pixels value is greater than the neighbour’s value write 1, otherwise 0. In this way, it encodes
the neighbourhood information very efficiently.
C. Active Appearance Model
Active Appearance Model (AAM) is a statistical approach for shape and texture modelling and feature extraction. It
has been extensively used in computer vision applications. AAM generates statistical appearance models by
combining a model of shape variation with a texture variation. So the AAM creates the shape, texture combination
model of training facial image sequence “Textures” are pixel intensities of the target image [6].
D. Facial Action Coding System (FACS)
Facial Action Coding System (FACS) was developed by Paul Ekman and Wallace Friesen in 1976 is a system for
measuring facial expression. FACS is based on the analysis of the relations between muscle contraction and changes
in the face appearance. The Face can be divided into Upper Face and Lower Face Action units[8].Action Units are
changes in the face caused by one muscle or a combination of muscles. There are 46 AUs that represent changes in
facial expression and 12 AUs connected with eye gaze direction and head orientation.
E. Haar Classifier
Haar classifier based method is chosen for face detection owing to its high detection accuracy and real time
performance [4]. Consists of black and white connected rectangles in which the value of the feature is the difference
of sum of pixel values in black and white regions. The computational speed of the feature calculation is increased
with the use of Integral image.
TABLE I
A SUMMARY OF EMOTION RECOGNITION SYSTEM TECHNIQUES
Reference Method Performance
Sukanya and
Pallavi
2014IEEE[3]
PCA This method provide better face
recognition with reasonably low
error rates
S L Happy;Anjith
George;Aurobin
da Routray[4]
LBP(Local Binary Pattern) Higher recognition
accuracy,Low computational
complexity
Kwang –Eun
Ko and Kwee-
Bo Sim[6]
Active Appearance Model The computational time and
complexity was also very low
S L
Happy;Anjith
George;Aurobin
da Routray[4]
Haar Classifier High detection accuracy
Ms.Aswathy
[9]
Fisher’s Linear Discriminant Recognition rate is low
Ms.Aswathy
[9]
Multilinear Image
Analysis
Recognition rate higher.but only
in grayscale image
Vol-1 Issue-2 2015 IJARIIE-ISSN(O)-2395-4396
1177 www.ijariie.com 329
IV. CONCLUSIONS
In this paper, the review of framework of facial expression recognition has been highlighted. and presents a
literature survey on the various techniques involved in facial expression recognition. These methods are measured
on the basis of recognition rate. PCA has the highest recognition rate and has highest performance.
REFERENCES
[1] Hakura, J. ; Domon, R. ; Fujita, H, Laser Emotion recognition method using facial expressions and situation,
Intelligent Software Methodologies, Tools and Techniques (SoMeT), 2013 IEEE 12th International Conference
[2] Vaibhavkumar J. Mistry, Mahesh M. Goyani., A literature survey on Facial Expression Recognition using
Global Features. International Journal of Engineering and Advanced Technology (IJEAT)ISSN: 2249 – 8958,
Volume-2, Issue-4, April 2013.
[3] S Sukanya Sagarika ;Pallavi Maben, Laser Face Recognition and Facial Expression Identification using PCA,
2014 IEEE
[4] S L Happy;Anjith George;Aurobinda Routray, “A Real Time Facial Expression Classification System Using
Local Binary Patterns.,” 2012 IEEE.
[5] Aruna Bhadu, Rajbala Tokas, Dr. Vijay Kumar, “Facial Expression Recognition Using DCT, Gabor and
Wavelet Feature Extraction Techniques,” International Journal of Engineering and Innovative Technology,
Volume 2, Issue 1, July 2012.
[6] Kwang-Eun Ko;Kwee-Bo Sim, “Development of a Facial Emotion recognition Method based on combining
AAM with DBN,” IEEE 2010.
[7] Andrew Ryan;Jeffery F. Cohn, Simon Lucey;Adam Rossi, “Automated Facial Expression Recognition
System,” 2009 IEEE
[8] C.P. Sumathi, T. Santhanam and M.Mahadevi, “A Automatic Facial Expression Analysis A survey,”
International Journal of Computer Science & Engineering Survey (IJCSES) Vol.3, No.6, December 2012
[9] Ms.Aswathy.R “A Literature review on Facial Expression Recognition Techniques,” IOSR Journal of
Computer Engineering (IOSR-JCE) 2013

Contenu connexe

Similaire à A Literature Review On Emotion Recognition System Using Various Facial Expression

Emotion Recognition using Image Processing
Emotion Recognition using Image ProcessingEmotion Recognition using Image Processing
Emotion Recognition using Image Processing
ijtsrd
 
A study of techniques for facial detection and expression classification
A study of techniques for facial detection and expression classificationA study of techniques for facial detection and expression classification
A study of techniques for facial detection and expression classification
IJCSES Journal
 
Efficient Facial Expression and Face Recognition using Ranking Method
Efficient Facial Expression and Face Recognition using Ranking MethodEfficient Facial Expression and Face Recognition using Ranking Method
Efficient Facial Expression and Face Recognition using Ranking Method
IJERA Editor
 
A Hybrid Approach to Recognize Facial Image using Feature Extraction Method
A Hybrid Approach to Recognize Facial Image using Feature Extraction MethodA Hybrid Approach to Recognize Facial Image using Feature Extraction Method
A Hybrid Approach to Recognize Facial Image using Feature Extraction Method
IRJET Journal
 
Real time facial expression analysis using pca
Real time facial expression analysis using pcaReal time facial expression analysis using pca
Real time facial expression analysis using pca
International Journal of Science and Research (IJSR)
 
184
184184
IRJET- A Survey on Facial Expression Recognition Robust to Partial Occlusion
IRJET- A Survey on Facial Expression Recognition Robust to Partial OcclusionIRJET- A Survey on Facial Expression Recognition Robust to Partial Occlusion
IRJET- A Survey on Facial Expression Recognition Robust to Partial Occlusion
IRJET Journal
 
Final Year Project - Enhancing Virtual Learning through Emotional Agents (Doc...
Final Year Project - Enhancing Virtual Learning through Emotional Agents (Doc...Final Year Project - Enhancing Virtual Learning through Emotional Agents (Doc...
Final Year Project - Enhancing Virtual Learning through Emotional Agents (Doc...
Sana Nasar
 
Facial landmarking localization for emotion recognition using bayesian shape ...
Facial landmarking localization for emotion recognition using bayesian shape ...Facial landmarking localization for emotion recognition using bayesian shape ...
Facial landmarking localization for emotion recognition using bayesian shape ...
csandit
 
FACIAL LANDMARKING LOCALIZATION FOR EMOTION RECOGNITION USING BAYESIAN SHAPE ...
FACIAL LANDMARKING LOCALIZATION FOR EMOTION RECOGNITION USING BAYESIAN SHAPE ...FACIAL LANDMARKING LOCALIZATION FOR EMOTION RECOGNITION USING BAYESIAN SHAPE ...
FACIAL LANDMARKING LOCALIZATION FOR EMOTION RECOGNITION USING BAYESIAN SHAPE ...
cscpconf
 
EMOTION RECOGNITION FROM FACIAL EXPRESSION BASED ON BEZIER CURVE
EMOTION RECOGNITION FROM FACIAL EXPRESSION BASED ON BEZIER CURVEEMOTION RECOGNITION FROM FACIAL EXPRESSION BASED ON BEZIER CURVE
EMOTION RECOGNITION FROM FACIAL EXPRESSION BASED ON BEZIER CURVE
ijait
 
Face recognition a survey
Face recognition a surveyFace recognition a survey
Face recognition a survey
ieijjournal
 
Paper id 24201475
Paper id 24201475Paper id 24201475
Paper id 24201475
IJRAT
 
Automatic AU intensity detection/estimation for Facial Expression Analysis: A...
Automatic AU intensity detection/estimation for Facial Expression Analysis: A...Automatic AU intensity detection/estimation for Facial Expression Analysis: A...
Automatic AU intensity detection/estimation for Facial Expression Analysis: A...
Association of Scientists, Developers and Faculties
 
An SOM-based Automatic Facial Expression Recognition System
An SOM-based Automatic Facial Expression Recognition SystemAn SOM-based Automatic Facial Expression Recognition System
An SOM-based Automatic Facial Expression Recognition System
ijscai
 
REVIEW OF FACE DETECTION SYSTEMS BASED ARTIFICIAL NEURAL NETWORKS ALGORITHMS
REVIEW OF FACE DETECTION SYSTEMS BASED ARTIFICIAL NEURAL NETWORKS ALGORITHMSREVIEW OF FACE DETECTION SYSTEMS BASED ARTIFICIAL NEURAL NETWORKS ALGORITHMS
REVIEW OF FACE DETECTION SYSTEMS BASED ARTIFICIAL NEURAL NETWORKS ALGORITHMS
ijma
 
Review of face detection systems based artificial neural networks algorithms
Review of face detection systems based artificial neural networks algorithmsReview of face detection systems based artificial neural networks algorithms
Review of face detection systems based artificial neural networks algorithms
ijma
 
A Study On Facial Expression Recognition Using Local Binary Pattern
A Study On Facial Expression Recognition Using Local Binary PatternA Study On Facial Expression Recognition Using Local Binary Pattern
A Study On Facial Expression Recognition Using Local Binary Pattern
Martha Brown
 
A Study on Face Recognition Technique based on Eigenface
A Study on Face Recognition Technique based on EigenfaceA Study on Face Recognition Technique based on Eigenface
A Study on Face Recognition Technique based on Eigenface
sadique_ghitm
 
Research and Development of DSP-Based Face Recognition System for Robotic Reh...
Research and Development of DSP-Based Face Recognition System for Robotic Reh...Research and Development of DSP-Based Face Recognition System for Robotic Reh...
Research and Development of DSP-Based Face Recognition System for Robotic Reh...
IJCSES Journal
 

Similaire à A Literature Review On Emotion Recognition System Using Various Facial Expression (20)

Emotion Recognition using Image Processing
Emotion Recognition using Image ProcessingEmotion Recognition using Image Processing
Emotion Recognition using Image Processing
 
A study of techniques for facial detection and expression classification
A study of techniques for facial detection and expression classificationA study of techniques for facial detection and expression classification
A study of techniques for facial detection and expression classification
 
Efficient Facial Expression and Face Recognition using Ranking Method
Efficient Facial Expression and Face Recognition using Ranking MethodEfficient Facial Expression and Face Recognition using Ranking Method
Efficient Facial Expression and Face Recognition using Ranking Method
 
A Hybrid Approach to Recognize Facial Image using Feature Extraction Method
A Hybrid Approach to Recognize Facial Image using Feature Extraction MethodA Hybrid Approach to Recognize Facial Image using Feature Extraction Method
A Hybrid Approach to Recognize Facial Image using Feature Extraction Method
 
Real time facial expression analysis using pca
Real time facial expression analysis using pcaReal time facial expression analysis using pca
Real time facial expression analysis using pca
 
184
184184
184
 
IRJET- A Survey on Facial Expression Recognition Robust to Partial Occlusion
IRJET- A Survey on Facial Expression Recognition Robust to Partial OcclusionIRJET- A Survey on Facial Expression Recognition Robust to Partial Occlusion
IRJET- A Survey on Facial Expression Recognition Robust to Partial Occlusion
 
Final Year Project - Enhancing Virtual Learning through Emotional Agents (Doc...
Final Year Project - Enhancing Virtual Learning through Emotional Agents (Doc...Final Year Project - Enhancing Virtual Learning through Emotional Agents (Doc...
Final Year Project - Enhancing Virtual Learning through Emotional Agents (Doc...
 
Facial landmarking localization for emotion recognition using bayesian shape ...
Facial landmarking localization for emotion recognition using bayesian shape ...Facial landmarking localization for emotion recognition using bayesian shape ...
Facial landmarking localization for emotion recognition using bayesian shape ...
 
FACIAL LANDMARKING LOCALIZATION FOR EMOTION RECOGNITION USING BAYESIAN SHAPE ...
FACIAL LANDMARKING LOCALIZATION FOR EMOTION RECOGNITION USING BAYESIAN SHAPE ...FACIAL LANDMARKING LOCALIZATION FOR EMOTION RECOGNITION USING BAYESIAN SHAPE ...
FACIAL LANDMARKING LOCALIZATION FOR EMOTION RECOGNITION USING BAYESIAN SHAPE ...
 
EMOTION RECOGNITION FROM FACIAL EXPRESSION BASED ON BEZIER CURVE
EMOTION RECOGNITION FROM FACIAL EXPRESSION BASED ON BEZIER CURVEEMOTION RECOGNITION FROM FACIAL EXPRESSION BASED ON BEZIER CURVE
EMOTION RECOGNITION FROM FACIAL EXPRESSION BASED ON BEZIER CURVE
 
Face recognition a survey
Face recognition a surveyFace recognition a survey
Face recognition a survey
 
Paper id 24201475
Paper id 24201475Paper id 24201475
Paper id 24201475
 
Automatic AU intensity detection/estimation for Facial Expression Analysis: A...
Automatic AU intensity detection/estimation for Facial Expression Analysis: A...Automatic AU intensity detection/estimation for Facial Expression Analysis: A...
Automatic AU intensity detection/estimation for Facial Expression Analysis: A...
 
An SOM-based Automatic Facial Expression Recognition System
An SOM-based Automatic Facial Expression Recognition SystemAn SOM-based Automatic Facial Expression Recognition System
An SOM-based Automatic Facial Expression Recognition System
 
REVIEW OF FACE DETECTION SYSTEMS BASED ARTIFICIAL NEURAL NETWORKS ALGORITHMS
REVIEW OF FACE DETECTION SYSTEMS BASED ARTIFICIAL NEURAL NETWORKS ALGORITHMSREVIEW OF FACE DETECTION SYSTEMS BASED ARTIFICIAL NEURAL NETWORKS ALGORITHMS
REVIEW OF FACE DETECTION SYSTEMS BASED ARTIFICIAL NEURAL NETWORKS ALGORITHMS
 
Review of face detection systems based artificial neural networks algorithms
Review of face detection systems based artificial neural networks algorithmsReview of face detection systems based artificial neural networks algorithms
Review of face detection systems based artificial neural networks algorithms
 
A Study On Facial Expression Recognition Using Local Binary Pattern
A Study On Facial Expression Recognition Using Local Binary PatternA Study On Facial Expression Recognition Using Local Binary Pattern
A Study On Facial Expression Recognition Using Local Binary Pattern
 
A Study on Face Recognition Technique based on Eigenface
A Study on Face Recognition Technique based on EigenfaceA Study on Face Recognition Technique based on Eigenface
A Study on Face Recognition Technique based on Eigenface
 
Research and Development of DSP-Based Face Recognition System for Robotic Reh...
Research and Development of DSP-Based Face Recognition System for Robotic Reh...Research and Development of DSP-Based Face Recognition System for Robotic Reh...
Research and Development of DSP-Based Face Recognition System for Robotic Reh...
 

Plus de Lisa Graves

English Learning Essay
English Learning EssayEnglish Learning Essay
English Learning Essay
Lisa Graves
 
Strict Liability Essay
Strict Liability EssayStrict Liability Essay
Strict Liability Essay
Lisa Graves
 
Apocalypto Essay
Apocalypto EssayApocalypto Essay
Apocalypto Essay
Lisa Graves
 
Shocking Uc College Essay Prompts Thatsnotus
Shocking Uc College Essay Prompts ThatsnotusShocking Uc College Essay Prompts Thatsnotus
Shocking Uc College Essay Prompts Thatsnotus
Lisa Graves
 
My Role Model Essay Introduction In 2021 Essa
My Role Model Essay Introduction In 2021 EssaMy Role Model Essay Introduction In 2021 Essa
My Role Model Essay Introduction In 2021 Essa
Lisa Graves
 
Business Proposal Templates Examples Bus
Business Proposal Templates Examples BusBusiness Proposal Templates Examples Bus
Business Proposal Templates Examples Bus
Lisa Graves
 
Letter Writing Paper Free Printable Paper
Letter Writing Paper Free Printable PaperLetter Writing Paper Free Printable Paper
Letter Writing Paper Free Printable Paper
Lisa Graves
 
2Nd-Grade-Narrative-Writing-Prompts-SMI.Png
2Nd-Grade-Narrative-Writing-Prompts-SMI.Png2Nd-Grade-Narrative-Writing-Prompts-SMI.Png
2Nd-Grade-Narrative-Writing-Prompts-SMI.Png
Lisa Graves
 
Essay On Biodiversity In English For School Kids Students
Essay On Biodiversity In English For School Kids StudentsEssay On Biodiversity In English For School Kids Students
Essay On Biodiversity In English For School Kids Students
Lisa Graves
 
005 Being Leader Essay Example Thatsnotus
005 Being Leader Essay Example Thatsnotus005 Being Leader Essay Example Thatsnotus
005 Being Leader Essay Example Thatsnotus
Lisa Graves
 
IELTS Essay Planning 4 Step Approach - IELTS Ch
IELTS Essay Planning 4 Step Approach - IELTS ChIELTS Essay Planning 4 Step Approach - IELTS Ch
IELTS Essay Planning 4 Step Approach - IELTS Ch
Lisa Graves
 
Process Essay Thesis. Process Analysis Essay Ex
Process Essay Thesis. Process Analysis Essay ExProcess Essay Thesis. Process Analysis Essay Ex
Process Essay Thesis. Process Analysis Essay Ex
Lisa Graves
 
Star Writing Paper By King Education Creations TpT
Star Writing Paper By King Education Creations TpTStar Writing Paper By King Education Creations TpT
Star Writing Paper By King Education Creations TpT
Lisa Graves
 
Paper Fortune Teller - Wikipedia
Paper Fortune Teller - WikipediaPaper Fortune Teller - Wikipedia
Paper Fortune Teller - Wikipedia
Lisa Graves
 
Self Introduction Speech, Introduction Examples, Intr
Self Introduction Speech, Introduction Examples, IntrSelf Introduction Speech, Introduction Examples, Intr
Self Introduction Speech, Introduction Examples, Intr
Lisa Graves
 
Descriptive Essay Argumentative Writing Games
Descriptive Essay Argumentative Writing GamesDescriptive Essay Argumentative Writing Games
Descriptive Essay Argumentative Writing Games
Lisa Graves
 
What Should I Do A Persuasive Speech On. 8 P
What Should I Do A Persuasive Speech On. 8 PWhat Should I Do A Persuasive Speech On. 8 P
What Should I Do A Persuasive Speech On. 8 P
Lisa Graves
 
Autumn Leaf Shape Poem Template, Leaf Template -
Autumn Leaf Shape Poem Template, Leaf Template -Autumn Leaf Shape Poem Template, Leaf Template -
Autumn Leaf Shape Poem Template, Leaf Template -
Lisa Graves
 
How Do You Define Art Essay You Can Sign In To
How Do You Define Art Essay You Can Sign In ToHow Do You Define Art Essay You Can Sign In To
How Do You Define Art Essay You Can Sign In To
Lisa Graves
 
How To Write A Linking Sentenc
How To Write A Linking SentencHow To Write A Linking Sentenc
How To Write A Linking Sentenc
Lisa Graves
 

Plus de Lisa Graves (20)

English Learning Essay
English Learning EssayEnglish Learning Essay
English Learning Essay
 
Strict Liability Essay
Strict Liability EssayStrict Liability Essay
Strict Liability Essay
 
Apocalypto Essay
Apocalypto EssayApocalypto Essay
Apocalypto Essay
 
Shocking Uc College Essay Prompts Thatsnotus
Shocking Uc College Essay Prompts ThatsnotusShocking Uc College Essay Prompts Thatsnotus
Shocking Uc College Essay Prompts Thatsnotus
 
My Role Model Essay Introduction In 2021 Essa
My Role Model Essay Introduction In 2021 EssaMy Role Model Essay Introduction In 2021 Essa
My Role Model Essay Introduction In 2021 Essa
 
Business Proposal Templates Examples Bus
Business Proposal Templates Examples BusBusiness Proposal Templates Examples Bus
Business Proposal Templates Examples Bus
 
Letter Writing Paper Free Printable Paper
Letter Writing Paper Free Printable PaperLetter Writing Paper Free Printable Paper
Letter Writing Paper Free Printable Paper
 
2Nd-Grade-Narrative-Writing-Prompts-SMI.Png
2Nd-Grade-Narrative-Writing-Prompts-SMI.Png2Nd-Grade-Narrative-Writing-Prompts-SMI.Png
2Nd-Grade-Narrative-Writing-Prompts-SMI.Png
 
Essay On Biodiversity In English For School Kids Students
Essay On Biodiversity In English For School Kids StudentsEssay On Biodiversity In English For School Kids Students
Essay On Biodiversity In English For School Kids Students
 
005 Being Leader Essay Example Thatsnotus
005 Being Leader Essay Example Thatsnotus005 Being Leader Essay Example Thatsnotus
005 Being Leader Essay Example Thatsnotus
 
IELTS Essay Planning 4 Step Approach - IELTS Ch
IELTS Essay Planning 4 Step Approach - IELTS ChIELTS Essay Planning 4 Step Approach - IELTS Ch
IELTS Essay Planning 4 Step Approach - IELTS Ch
 
Process Essay Thesis. Process Analysis Essay Ex
Process Essay Thesis. Process Analysis Essay ExProcess Essay Thesis. Process Analysis Essay Ex
Process Essay Thesis. Process Analysis Essay Ex
 
Star Writing Paper By King Education Creations TpT
Star Writing Paper By King Education Creations TpTStar Writing Paper By King Education Creations TpT
Star Writing Paper By King Education Creations TpT
 
Paper Fortune Teller - Wikipedia
Paper Fortune Teller - WikipediaPaper Fortune Teller - Wikipedia
Paper Fortune Teller - Wikipedia
 
Self Introduction Speech, Introduction Examples, Intr
Self Introduction Speech, Introduction Examples, IntrSelf Introduction Speech, Introduction Examples, Intr
Self Introduction Speech, Introduction Examples, Intr
 
Descriptive Essay Argumentative Writing Games
Descriptive Essay Argumentative Writing GamesDescriptive Essay Argumentative Writing Games
Descriptive Essay Argumentative Writing Games
 
What Should I Do A Persuasive Speech On. 8 P
What Should I Do A Persuasive Speech On. 8 PWhat Should I Do A Persuasive Speech On. 8 P
What Should I Do A Persuasive Speech On. 8 P
 
Autumn Leaf Shape Poem Template, Leaf Template -
Autumn Leaf Shape Poem Template, Leaf Template -Autumn Leaf Shape Poem Template, Leaf Template -
Autumn Leaf Shape Poem Template, Leaf Template -
 
How Do You Define Art Essay You Can Sign In To
How Do You Define Art Essay You Can Sign In ToHow Do You Define Art Essay You Can Sign In To
How Do You Define Art Essay You Can Sign In To
 
How To Write A Linking Sentenc
How To Write A Linking SentencHow To Write A Linking Sentenc
How To Write A Linking Sentenc
 

Dernier

বাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdf
বাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdfবাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdf
বাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdf
eBook.com.bd (প্রয়োজনীয় বাংলা বই)
 
South African Journal of Science: Writing with integrity workshop (2024)
South African Journal of Science: Writing with integrity workshop (2024)South African Journal of Science: Writing with integrity workshop (2024)
South African Journal of Science: Writing with integrity workshop (2024)
Academy of Science of South Africa
 
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem studentsRHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
Himanshu Rai
 
How to deliver Powerpoint Presentations.pptx
How to deliver Powerpoint  Presentations.pptxHow to deliver Powerpoint  Presentations.pptx
How to deliver Powerpoint Presentations.pptx
HajraNaeem15
 
The History of Stoke Newington Street Names
The History of Stoke Newington Street NamesThe History of Stoke Newington Street Names
The History of Stoke Newington Street Names
History of Stoke Newington
 
Walmart Business+ and Spark Good for Nonprofits.pdf
Walmart Business+ and Spark Good for Nonprofits.pdfWalmart Business+ and Spark Good for Nonprofits.pdf
Walmart Business+ and Spark Good for Nonprofits.pdf
TechSoup
 
PCOS corelations and management through Ayurveda.
PCOS corelations and management through Ayurveda.PCOS corelations and management through Ayurveda.
PCOS corelations and management through Ayurveda.
Dr. Shivangi Singh Parihar
 
How to Fix the Import Error in the Odoo 17
How to Fix the Import Error in the Odoo 17How to Fix the Import Error in the Odoo 17
How to Fix the Import Error in the Odoo 17
Celine George
 
Pengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptxPengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptx
Fajar Baskoro
 
Your Skill Boost Masterclass: Strategies for Effective Upskilling
Your Skill Boost Masterclass: Strategies for Effective UpskillingYour Skill Boost Masterclass: Strategies for Effective Upskilling
Your Skill Boost Masterclass: Strategies for Effective Upskilling
Excellence Foundation for South Sudan
 
writing about opinions about Australia the movie
writing about opinions about Australia the moviewriting about opinions about Australia the movie
writing about opinions about Australia the movie
Nicholas Montgomery
 
The Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collectionThe Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collection
Israel Genealogy Research Association
 
คำศัพท์ คำพื้นฐานการอ่าน ภาษาอังกฤษ ระดับชั้น ม.1
คำศัพท์ คำพื้นฐานการอ่าน ภาษาอังกฤษ ระดับชั้น ม.1คำศัพท์ คำพื้นฐานการอ่าน ภาษาอังกฤษ ระดับชั้น ม.1
คำศัพท์ คำพื้นฐานการอ่าน ภาษาอังกฤษ ระดับชั้น ม.1
สมใจ จันสุกสี
 
How to Create a More Engaging and Human Online Learning Experience
How to Create a More Engaging and Human Online Learning Experience How to Create a More Engaging and Human Online Learning Experience
How to Create a More Engaging and Human Online Learning Experience
Wahiba Chair Training & Consulting
 
Film vocab for eal 3 students: Australia the movie
Film vocab for eal 3 students: Australia the movieFilm vocab for eal 3 students: Australia the movie
Film vocab for eal 3 students: Australia the movie
Nicholas Montgomery
 
Reimagining Your Library Space: How to Increase the Vibes in Your Library No ...
Reimagining Your Library Space: How to Increase the Vibes in Your Library No ...Reimagining Your Library Space: How to Increase the Vibes in Your Library No ...
Reimagining Your Library Space: How to Increase the Vibes in Your Library No ...
Diana Rendina
 
Hindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdfHindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdf
Dr. Mulla Adam Ali
 
NEWSPAPERS - QUESTION 1 - REVISION POWERPOINT.pptx
NEWSPAPERS - QUESTION 1 - REVISION POWERPOINT.pptxNEWSPAPERS - QUESTION 1 - REVISION POWERPOINT.pptx
NEWSPAPERS - QUESTION 1 - REVISION POWERPOINT.pptx
iammrhaywood
 
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
National Information Standards Organization (NISO)
 
How to Make a Field Mandatory in Odoo 17
How to Make a Field Mandatory in Odoo 17How to Make a Field Mandatory in Odoo 17
How to Make a Field Mandatory in Odoo 17
Celine George
 

Dernier (20)

বাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdf
বাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdfবাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdf
বাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdf
 
South African Journal of Science: Writing with integrity workshop (2024)
South African Journal of Science: Writing with integrity workshop (2024)South African Journal of Science: Writing with integrity workshop (2024)
South African Journal of Science: Writing with integrity workshop (2024)
 
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem studentsRHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
RHEOLOGY Physical pharmaceutics-II notes for B.pharm 4th sem students
 
How to deliver Powerpoint Presentations.pptx
How to deliver Powerpoint  Presentations.pptxHow to deliver Powerpoint  Presentations.pptx
How to deliver Powerpoint Presentations.pptx
 
The History of Stoke Newington Street Names
The History of Stoke Newington Street NamesThe History of Stoke Newington Street Names
The History of Stoke Newington Street Names
 
Walmart Business+ and Spark Good for Nonprofits.pdf
Walmart Business+ and Spark Good for Nonprofits.pdfWalmart Business+ and Spark Good for Nonprofits.pdf
Walmart Business+ and Spark Good for Nonprofits.pdf
 
PCOS corelations and management through Ayurveda.
PCOS corelations and management through Ayurveda.PCOS corelations and management through Ayurveda.
PCOS corelations and management through Ayurveda.
 
How to Fix the Import Error in the Odoo 17
How to Fix the Import Error in the Odoo 17How to Fix the Import Error in the Odoo 17
How to Fix the Import Error in the Odoo 17
 
Pengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptxPengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptx
 
Your Skill Boost Masterclass: Strategies for Effective Upskilling
Your Skill Boost Masterclass: Strategies for Effective UpskillingYour Skill Boost Masterclass: Strategies for Effective Upskilling
Your Skill Boost Masterclass: Strategies for Effective Upskilling
 
writing about opinions about Australia the movie
writing about opinions about Australia the moviewriting about opinions about Australia the movie
writing about opinions about Australia the movie
 
The Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collectionThe Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collection
 
คำศัพท์ คำพื้นฐานการอ่าน ภาษาอังกฤษ ระดับชั้น ม.1
คำศัพท์ คำพื้นฐานการอ่าน ภาษาอังกฤษ ระดับชั้น ม.1คำศัพท์ คำพื้นฐานการอ่าน ภาษาอังกฤษ ระดับชั้น ม.1
คำศัพท์ คำพื้นฐานการอ่าน ภาษาอังกฤษ ระดับชั้น ม.1
 
How to Create a More Engaging and Human Online Learning Experience
How to Create a More Engaging and Human Online Learning Experience How to Create a More Engaging and Human Online Learning Experience
How to Create a More Engaging and Human Online Learning Experience
 
Film vocab for eal 3 students: Australia the movie
Film vocab for eal 3 students: Australia the movieFilm vocab for eal 3 students: Australia the movie
Film vocab for eal 3 students: Australia the movie
 
Reimagining Your Library Space: How to Increase the Vibes in Your Library No ...
Reimagining Your Library Space: How to Increase the Vibes in Your Library No ...Reimagining Your Library Space: How to Increase the Vibes in Your Library No ...
Reimagining Your Library Space: How to Increase the Vibes in Your Library No ...
 
Hindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdfHindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdf
 
NEWSPAPERS - QUESTION 1 - REVISION POWERPOINT.pptx
NEWSPAPERS - QUESTION 1 - REVISION POWERPOINT.pptxNEWSPAPERS - QUESTION 1 - REVISION POWERPOINT.pptx
NEWSPAPERS - QUESTION 1 - REVISION POWERPOINT.pptx
 
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
 
How to Make a Field Mandatory in Odoo 17
How to Make a Field Mandatory in Odoo 17How to Make a Field Mandatory in Odoo 17
How to Make a Field Mandatory in Odoo 17
 

A Literature Review On Emotion Recognition System Using Various Facial Expression

  • 1. Vol-1 Issue-2 2015 IJARIIE-ISSN(O)-2395-4396 1177 www.ijariie.com 326 A Literature review on Emotion Recognition System Using Various Facial Expression Dipika Raval1 , Mukesh Sakle2 1 Student, Information Technology, Parul Institute of Engineering & Technology, Gujarat, India 2 Assistant. Professor, Information Technology, Parul Institute of Engineering & Technology, Gujarat, India ABSTRACT Recognition and extracting various emotions and then validating those emotions from the facial expressions has become important for improving the overall human computer interaction. So this paper also describe about Emotion Recognition Techniques. Emotion Recognition has become a progressive research area and it plays a major role in Human-Computer-Interaction. For any Facial Expression Recognition, it is necessary to extract the features of face that can be possibly used to detect the expression. For Feature Extraction the Principal Component Analysis will be used. A survey of various techniques used in emotion recognition like PCA, LBP etc. is done in this paper and listing their performance. The goal of this paper is to show the comparison with Other Recognition Techniques with different approaches. And also describe the general step of the how to recognize emotion from various facial expression Keyword: -. Emotion Recognition, Facial Expression I. INTRODUCTION The human face plays an important role in communication. The face can express their feelings through emotions. Face Expression approach [2] can be divided into three major steps so that the face in an image is known for further processing, facial feature extraction which is the method used to represent the facial expressions and finally classification which is the step that classifies the features extracted in the appropriate expressions. The facial expression are for identifying the basic human emotion like anger, fear, happiness, sadness, and surprise. Figure1 below showing the general step of emotion recognition. From the figure, there are three important phases of overall system. First is face detection task in which first prominent features are extracted and then face is identified. The second step is where the facial feature extraction and recognition of facial expressions to the overall features are removed at the end of the last step in classification. Facial expressions of input image are then recognized. Fig. 1 General step of emotion recognition In this paper section II is provide the system overview of emotion recognition system. Section III describes the techniques used for emotion recognition. Finally the paper concludes with the conclusion in section IV.
  • 2. Vol-1 Issue-2 2015 IJARIIE-ISSN(O)-2395-4396 1177 www.ijariie.com 327 II. SYSTEM OVERVIEW The process of emotion recognition involves the processing images and detecting the face then extracting the facial feature. Facial Expression Recognition consists of three main steps. In first step face image is acquired and detect the face region from the images and pre-processed the input image to obtain image that have a normalized size or intensity. Next is expression features are extracted from the observed facial image or image sequence. Then extracted features are given to the classifier and classifier provides the recognized expression as output as shown in fig 1. A. Face Detection and Pre-processing The face detection is the process of extracting the face region from the background. It means to determine the position of the face in the image. This step is require because images having a different scales. Input image having a complex backgrounds and variety of lightning conditions can be also quite confusing in tracking. Face expression recognition tends to fail if the test image has a different lighting condition than that of the training images. For that facial point can be detected inaccurately for that pre-processing step is required. B. Feature Extraction And Classification Selecting a set of feature points which represent the important characteristics of the human face. After the face has been located in the image, it can be analysed in terms of facial features. The features measure the certain parts of the face such as eyebrows or mouth corners. Various methods exist which can extract feature for expression based on motion of the feature such Active Appearance Model [6] which is statistical model of shape and gray scale information. The Features describe the change in face texture when particular action is performed such as wrinkles, bulges, forefront, regions surrounding the mouth and eyes. Image filters are used, applied to either the whole-face or specific regions in a face image to extract a feature vector. Principal Component Analysis [3], Local Binary Pattern (LBP)[4],Fisher’s Linear Discriminator[5] based approaches are the main categories of the approaches available. After the set of features are extracted from the face region are used in classification stage. The set of features are used to describe the facial expression. Classification requires supervised training, so the training set should consist of labelled data. Once the classifier is trained, it can recognize input images by assigning them a particular class label. The most commonly used facial expressions classification is done both in terms of Action Units, proposed in Facial Action Coding System (FACS) [8] and in terms of six universal emotions: happy, sad, anger, surprise, disgust and fear. III. Techniques used for emotion recognition A. Principal Component Analysis Principal Components Analysis (PCA) ia a way of identifying patterns in data, and expressing the data in such a way as to highlight their similarities and differences. The facial expression recognition using eigen faces in which PCA is used to extract features from input image. First of all they create training dataset to compare result. Once inputted face image is pre-processed and compare with training dataset which are already computed but based on the idea, they divided the training set into six basic classes according to universal expression(Happy, Surprise, Disgust, sad, Angry, Fear)[3]. B. Local Binary Pattern
  • 3. Vol-1 Issue-2 2015 IJARIIE-ISSN(O)-2395-4396 1177 www.ijariie.com 328 LBP based feature extraction method is used owing to its excellent light invariance property and low computational complexity [4]. The neighbourhood values are threshold by the centre value and the result is treated as a binary number. If the canter pixels value is greater than the neighbour’s value write 1, otherwise 0. In this way, it encodes the neighbourhood information very efficiently. C. Active Appearance Model Active Appearance Model (AAM) is a statistical approach for shape and texture modelling and feature extraction. It has been extensively used in computer vision applications. AAM generates statistical appearance models by combining a model of shape variation with a texture variation. So the AAM creates the shape, texture combination model of training facial image sequence “Textures” are pixel intensities of the target image [6]. D. Facial Action Coding System (FACS) Facial Action Coding System (FACS) was developed by Paul Ekman and Wallace Friesen in 1976 is a system for measuring facial expression. FACS is based on the analysis of the relations between muscle contraction and changes in the face appearance. The Face can be divided into Upper Face and Lower Face Action units[8].Action Units are changes in the face caused by one muscle or a combination of muscles. There are 46 AUs that represent changes in facial expression and 12 AUs connected with eye gaze direction and head orientation. E. Haar Classifier Haar classifier based method is chosen for face detection owing to its high detection accuracy and real time performance [4]. Consists of black and white connected rectangles in which the value of the feature is the difference of sum of pixel values in black and white regions. The computational speed of the feature calculation is increased with the use of Integral image. TABLE I A SUMMARY OF EMOTION RECOGNITION SYSTEM TECHNIQUES Reference Method Performance Sukanya and Pallavi 2014IEEE[3] PCA This method provide better face recognition with reasonably low error rates S L Happy;Anjith George;Aurobin da Routray[4] LBP(Local Binary Pattern) Higher recognition accuracy,Low computational complexity Kwang –Eun Ko and Kwee- Bo Sim[6] Active Appearance Model The computational time and complexity was also very low S L Happy;Anjith George;Aurobin da Routray[4] Haar Classifier High detection accuracy Ms.Aswathy [9] Fisher’s Linear Discriminant Recognition rate is low Ms.Aswathy [9] Multilinear Image Analysis Recognition rate higher.but only in grayscale image
  • 4. Vol-1 Issue-2 2015 IJARIIE-ISSN(O)-2395-4396 1177 www.ijariie.com 329 IV. CONCLUSIONS In this paper, the review of framework of facial expression recognition has been highlighted. and presents a literature survey on the various techniques involved in facial expression recognition. These methods are measured on the basis of recognition rate. PCA has the highest recognition rate and has highest performance. REFERENCES [1] Hakura, J. ; Domon, R. ; Fujita, H, Laser Emotion recognition method using facial expressions and situation, Intelligent Software Methodologies, Tools and Techniques (SoMeT), 2013 IEEE 12th International Conference [2] Vaibhavkumar J. Mistry, Mahesh M. Goyani., A literature survey on Facial Expression Recognition using Global Features. International Journal of Engineering and Advanced Technology (IJEAT)ISSN: 2249 – 8958, Volume-2, Issue-4, April 2013. [3] S Sukanya Sagarika ;Pallavi Maben, Laser Face Recognition and Facial Expression Identification using PCA, 2014 IEEE [4] S L Happy;Anjith George;Aurobinda Routray, “A Real Time Facial Expression Classification System Using Local Binary Patterns.,” 2012 IEEE. [5] Aruna Bhadu, Rajbala Tokas, Dr. Vijay Kumar, “Facial Expression Recognition Using DCT, Gabor and Wavelet Feature Extraction Techniques,” International Journal of Engineering and Innovative Technology, Volume 2, Issue 1, July 2012. [6] Kwang-Eun Ko;Kwee-Bo Sim, “Development of a Facial Emotion recognition Method based on combining AAM with DBN,” IEEE 2010. [7] Andrew Ryan;Jeffery F. Cohn, Simon Lucey;Adam Rossi, “Automated Facial Expression Recognition System,” 2009 IEEE [8] C.P. Sumathi, T. Santhanam and M.Mahadevi, “A Automatic Facial Expression Analysis A survey,” International Journal of Computer Science & Engineering Survey (IJCSES) Vol.3, No.6, December 2012 [9] Ms.Aswathy.R “A Literature review on Facial Expression Recognition Techniques,” IOSR Journal of Computer Engineering (IOSR-JCE) 2013