SlideShare une entreprise Scribd logo
1  sur  19
Neural Network
Contents
.Introduction to Neural Network
.Neurons
.Activation Function
.Types of Neural Network
.Learning In Neural Networks
.Application of Neural Network
.Advantages of Neural Network
.Disadvantages Of Neural
Network
Neural Networks
• A method ofcomputing, based on the
interactionof multipleconnected
processing elements.
• A powerful technique to solve many real
world problems.
• The ability to learn from experience in
order to improve their performance.
• Ability to deal with incomplete
information
•
•
•
•
Biological approach to AI
Developed in 1943
Comprised of one or more
layers of neurons
Several types, we’ll focus on
feed-forward and feedback
networks
Basics Of Neural Network
Neurons
Biological
Artificial
Neural Network Neurons
•
•
•
•
Receives n-inputs
Multiplies each
input by its
weight
Applies
activation
function to the
sum of results
Outputs result
Activation Functions
•
•
•
Controlswhen
unit is “active”
or “inactive”
Threshold
function outputs
1 when input is
positive and 0
otherwise
Sigmoid function
= 1 / (1 + e-x)
Neural Network types can be classified based on following
attributes:
• Connection Type
- Static (feedforward)
- Dynamic (feedback)
• Topology
- Single layer
- Multilayer
- Recurrent
• Learning Methods
- Supervised
- Unsupervised
- Reinforcement
Types of Neural Networks
Classification Based On Connection Types
(unit delay operator z-1 implies
dynamic system)
•Static(Feedforward)
• Dynamic(Feedback)
Classification Based On Topology
• Single layer •
Multilayer
• Recurrent
Classification Based On Learning Method
• Supervised
• Unsupervised
• Reinforcement
Supervised learning
• Each training pattern: input + desired
output
• At each presentation: adapt weights
• Aftermany epochs convergence to a
local minimum
Unsupervised Learning
•
•
•
•
•
No help from the outside
No training data,no information
availableon the desired output
Learning by doing
Used to pick out structure in the
input:
• Clustering
• Reduction of dimensionality 
compression
Example: Kohonen’s Learning Law
Reinforcement learning
•
•
•
•
Teacher: training data
The teacher scores the performance of the
training examples
Use performance score to shuffle weights
‘randomly’
Relatively slow learning due to
‘randomness’
Neural Network Applications
• Pattern recognition
• Investment analysis
• Control systems &
monitoring
• Mobile computing
• Marketing and financial
applications
• Forecasting – sales, market
research, meteorology
Advantages:
• A neural network can perform tasks that a
linear program can not.
• When anelementoftheneural network
fails, it can continue withoutany
problemby their parallel nature.
• A neural network learns and does not need
tobe reprogrammed.
• It can be implemented in any application.
• It can be implemented without any problem
Disadvantages:
• Theneural network needs training
to operate.
• The architectureof a neural
network isdifferentfrom the
architecture of microprocessors
therefore needs to beemulated.
• Requires highprocessing time for
large neural networks.
Conclusions
•
•
•
Neural networks provide ability
to provide more human-like AI
Takes rough approximation and
hard-coded reactions out of AI
design (i.e. Rules and FSMs)
Still require a lot of fine-
tuning during development
References
•
•
•
•
• Neural Networks, Fuzzy Logic, and Genetic
Algorithm ( synthesis and Application)
S.Rajasekaran, G.A. Vijayalakshmi Pai, PHI
Neuro Fuzzy and Soft Computing, J. S. R.
JANG,C.T. Sun, E. Mitzutani, PHI
Neural Netware, a tutorial on neural networks
Sweetser, Penny. “Strategic Decision-Making with
Neural Networks and Influence Maps”, AI Game
Programming Wisdom 2, Section 7.7 (439 – 46)
Russell, Stuart and Norvig, Peter. Artificial
Intelligence: A Modern Approach, Section 20.5
(736 – 48)
THANK YOU
QUESTIONS ?

Contenu connexe

Similaire à nn_important study materoial okfjevh rji

Artificial Neural Networks for NIU session 2016 17
Artificial Neural Networks for NIU session 2016 17 Artificial Neural Networks for NIU session 2016 17
Artificial Neural Networks for NIU session 2016 17 Prof. Neeta Awasthy
 
neuralnetwork.pptx
neuralnetwork.pptxneuralnetwork.pptx
neuralnetwork.pptxSherinRappai
 
Artificial Neural Network Learning Algorithm.ppt
Artificial Neural Network Learning Algorithm.pptArtificial Neural Network Learning Algorithm.ppt
Artificial Neural Network Learning Algorithm.pptNJUSTAiMo
 
Table of Contents
Table of ContentsTable of Contents
Table of Contentsbutest
 
Neural Networks.pdf
Neural Networks.pdfNeural Networks.pdf
Neural Networks.pdfSouravkarak2
 
Hard & soft computing
Hard & soft computingHard & soft computing
Hard & soft computingSCAROLINEECE
 
Artificial neural network
Artificial neural networkArtificial neural network
Artificial neural networknainabhatt2
 
Artificial Neural Network
Artificial Neural NetworkArtificial Neural Network
Artificial Neural NetworkNainaBhatt1
 
33.-Multi-Layer-Perceptron.pdf
33.-Multi-Layer-Perceptron.pdf33.-Multi-Layer-Perceptron.pdf
33.-Multi-Layer-Perceptron.pdfgnans Kgnanshek
 
Artificial Neural Network ANN
Artificial Neural Network ANNArtificial Neural Network ANN
Artificial Neural Network ANNAbdullah al Mamun
 
Artificial neural network model & hidden layers in multilayer artificial neur...
Artificial neural network model & hidden layers in multilayer artificial neur...Artificial neural network model & hidden layers in multilayer artificial neur...
Artificial neural network model & hidden layers in multilayer artificial neur...Muhammad Ishaq
 
Entity embeddings for categorical data
Entity embeddings for categorical dataEntity embeddings for categorical data
Entity embeddings for categorical dataPaul Skeie
 
Neural network techniques
Neural network techniquesNeural network techniques
Neural network techniquesVipul Bhargava
 
Forecasting of Sales using Neural network techniques
Forecasting of Sales using Neural network techniquesForecasting of Sales using Neural network techniques
Forecasting of Sales using Neural network techniquesHitesh Dua
 
Facial Emotion Detection on Children's Emotional Face
Facial Emotion Detection on Children's Emotional FaceFacial Emotion Detection on Children's Emotional Face
Facial Emotion Detection on Children's Emotional FaceTakrim Ul Islam Laskar
 

Similaire à nn_important study materoial okfjevh rji (20)

Artificial Neural Network.pptx
Artificial Neural Network.pptxArtificial Neural Network.pptx
Artificial Neural Network.pptx
 
Artificial Neural Networks for NIU session 2016 17
Artificial Neural Networks for NIU session 2016 17 Artificial Neural Networks for NIU session 2016 17
Artificial Neural Networks for NIU session 2016 17
 
Neural network
Neural networkNeural network
Neural network
 
neuralnetwork.pptx
neuralnetwork.pptxneuralnetwork.pptx
neuralnetwork.pptx
 
neuralnetwork.pptx
neuralnetwork.pptxneuralnetwork.pptx
neuralnetwork.pptx
 
Artificial Neural Network Learning Algorithm.ppt
Artificial Neural Network Learning Algorithm.pptArtificial Neural Network Learning Algorithm.ppt
Artificial Neural Network Learning Algorithm.ppt
 
1 5
1 51 5
1 5
 
Table of Contents
Table of ContentsTable of Contents
Table of Contents
 
Neural Networks.pdf
Neural Networks.pdfNeural Networks.pdf
Neural Networks.pdf
 
Hard & soft computing
Hard & soft computingHard & soft computing
Hard & soft computing
 
Artificial neural network
Artificial neural networkArtificial neural network
Artificial neural network
 
Artificial Neural Network
Artificial Neural NetworkArtificial Neural Network
Artificial Neural Network
 
33.-Multi-Layer-Perceptron.pdf
33.-Multi-Layer-Perceptron.pdf33.-Multi-Layer-Perceptron.pdf
33.-Multi-Layer-Perceptron.pdf
 
Artificial Neural Network ANN
Artificial Neural Network ANNArtificial Neural Network ANN
Artificial Neural Network ANN
 
Artificial neural network model & hidden layers in multilayer artificial neur...
Artificial neural network model & hidden layers in multilayer artificial neur...Artificial neural network model & hidden layers in multilayer artificial neur...
Artificial neural network model & hidden layers in multilayer artificial neur...
 
Entity embeddings for categorical data
Entity embeddings for categorical dataEntity embeddings for categorical data
Entity embeddings for categorical data
 
Neural network techniques
Neural network techniquesNeural network techniques
Neural network techniques
 
Deep learning
Deep learningDeep learning
Deep learning
 
Forecasting of Sales using Neural network techniques
Forecasting of Sales using Neural network techniquesForecasting of Sales using Neural network techniques
Forecasting of Sales using Neural network techniques
 
Facial Emotion Detection on Children's Emotional Face
Facial Emotion Detection on Children's Emotional FaceFacial Emotion Detection on Children's Emotional Face
Facial Emotion Detection on Children's Emotional Face
 

Dernier

NO1 Pandit Black Magic Removal in Uk kala jadu Specialist kala jadu for Love ...
NO1 Pandit Black Magic Removal in Uk kala jadu Specialist kala jadu for Love ...NO1 Pandit Black Magic Removal in Uk kala jadu Specialist kala jadu for Love ...
NO1 Pandit Black Magic Removal in Uk kala jadu Specialist kala jadu for Love ...Amil baba
 
An improvement in the safety of big data using blockchain technology
An improvement in the safety of big data using blockchain technologyAn improvement in the safety of big data using blockchain technology
An improvement in the safety of big data using blockchain technologyBOHRInternationalJou1
 
Electrostatic field in a coaxial transmission line
Electrostatic field in a coaxial transmission lineElectrostatic field in a coaxial transmission line
Electrostatic field in a coaxial transmission lineJulioCesarSalazarHer1
 
Top 13 Famous Civil Engineering Scientist
Top 13 Famous Civil Engineering ScientistTop 13 Famous Civil Engineering Scientist
Top 13 Famous Civil Engineering Scientistgettygaming1
 
School management system project report.pdf
School management system project report.pdfSchool management system project report.pdf
School management system project report.pdfKamal Acharya
 
Complex plane, Modulus, Argument, Graphical representation of a complex numbe...
Complex plane, Modulus, Argument, Graphical representation of a complex numbe...Complex plane, Modulus, Argument, Graphical representation of a complex numbe...
Complex plane, Modulus, Argument, Graphical representation of a complex numbe...MohammadAliNayeem
 
Lect_Z_Transform_Main_digital_image_processing.pptx
Lect_Z_Transform_Main_digital_image_processing.pptxLect_Z_Transform_Main_digital_image_processing.pptx
Lect_Z_Transform_Main_digital_image_processing.pptxMonirHossain707319
 
Roushan Kumar Java oracle certificate
Roushan Kumar Java oracle certificate Roushan Kumar Java oracle certificate
Roushan Kumar Java oracle certificate RaushanKumar452467
 
DR PROF ING GURUDUTT SAHNI WIKIPEDIA.pdf
DR PROF ING GURUDUTT SAHNI WIKIPEDIA.pdfDR PROF ING GURUDUTT SAHNI WIKIPEDIA.pdf
DR PROF ING GURUDUTT SAHNI WIKIPEDIA.pdfDrGurudutt
 
RESORT MANAGEMENT AND RESERVATION SYSTEM PROJECT REPORT.pdf
RESORT MANAGEMENT AND RESERVATION SYSTEM PROJECT REPORT.pdfRESORT MANAGEMENT AND RESERVATION SYSTEM PROJECT REPORT.pdf
RESORT MANAGEMENT AND RESERVATION SYSTEM PROJECT REPORT.pdfKamal Acharya
 
Software Engineering - Modelling Concepts + Class Modelling + Building the An...
Software Engineering - Modelling Concepts + Class Modelling + Building the An...Software Engineering - Modelling Concepts + Class Modelling + Building the An...
Software Engineering - Modelling Concepts + Class Modelling + Building the An...Prakhyath Rai
 
Online resume builder management system project report.pdf
Online resume builder management system project report.pdfOnline resume builder management system project report.pdf
Online resume builder management system project report.pdfKamal Acharya
 
İTÜ CAD and Reverse Engineering Workshop
İTÜ CAD and Reverse Engineering WorkshopİTÜ CAD and Reverse Engineering Workshop
İTÜ CAD and Reverse Engineering WorkshopEmre Günaydın
 
Lecture_8-Digital implementation of analog controller design.pdf
Lecture_8-Digital implementation of analog controller design.pdfLecture_8-Digital implementation of analog controller design.pdf
Lecture_8-Digital implementation of analog controller design.pdfmohamedsamy9878
 
一比一原版(UNK毕业证)内布拉斯加州立大学科尼分校毕业证成绩单
一比一原版(UNK毕业证)内布拉斯加州立大学科尼分校毕业证成绩单一比一原版(UNK毕业证)内布拉斯加州立大学科尼分校毕业证成绩单
一比一原版(UNK毕业证)内布拉斯加州立大学科尼分校毕业证成绩单tuuww
 
Laundry management system project report.pdf
Laundry management system project report.pdfLaundry management system project report.pdf
Laundry management system project report.pdfKamal Acharya
 
BRAKING SYSTEM IN INDIAN RAILWAY AutoCAD DRAWING
BRAKING SYSTEM IN INDIAN RAILWAY AutoCAD DRAWINGBRAKING SYSTEM IN INDIAN RAILWAY AutoCAD DRAWING
BRAKING SYSTEM IN INDIAN RAILWAY AutoCAD DRAWINGKOUSTAV SARKAR
 
Supermarket billing system project report..pdf
Supermarket billing system project report..pdfSupermarket billing system project report..pdf
Supermarket billing system project report..pdfKamal Acharya
 
Planetary Gears of automatic transmission of vehicle
Planetary Gears of automatic transmission of vehiclePlanetary Gears of automatic transmission of vehicle
Planetary Gears of automatic transmission of vehicleahmedmostafa941217
 
The battle for RAG, explore the pros and cons of using KnowledgeGraphs and Ve...
The battle for RAG, explore the pros and cons of using KnowledgeGraphs and Ve...The battle for RAG, explore the pros and cons of using KnowledgeGraphs and Ve...
The battle for RAG, explore the pros and cons of using KnowledgeGraphs and Ve...Roi Lipman
 

Dernier (20)

NO1 Pandit Black Magic Removal in Uk kala jadu Specialist kala jadu for Love ...
NO1 Pandit Black Magic Removal in Uk kala jadu Specialist kala jadu for Love ...NO1 Pandit Black Magic Removal in Uk kala jadu Specialist kala jadu for Love ...
NO1 Pandit Black Magic Removal in Uk kala jadu Specialist kala jadu for Love ...
 
An improvement in the safety of big data using blockchain technology
An improvement in the safety of big data using blockchain technologyAn improvement in the safety of big data using blockchain technology
An improvement in the safety of big data using blockchain technology
 
Electrostatic field in a coaxial transmission line
Electrostatic field in a coaxial transmission lineElectrostatic field in a coaxial transmission line
Electrostatic field in a coaxial transmission line
 
Top 13 Famous Civil Engineering Scientist
Top 13 Famous Civil Engineering ScientistTop 13 Famous Civil Engineering Scientist
Top 13 Famous Civil Engineering Scientist
 
School management system project report.pdf
School management system project report.pdfSchool management system project report.pdf
School management system project report.pdf
 
Complex plane, Modulus, Argument, Graphical representation of a complex numbe...
Complex plane, Modulus, Argument, Graphical representation of a complex numbe...Complex plane, Modulus, Argument, Graphical representation of a complex numbe...
Complex plane, Modulus, Argument, Graphical representation of a complex numbe...
 
Lect_Z_Transform_Main_digital_image_processing.pptx
Lect_Z_Transform_Main_digital_image_processing.pptxLect_Z_Transform_Main_digital_image_processing.pptx
Lect_Z_Transform_Main_digital_image_processing.pptx
 
Roushan Kumar Java oracle certificate
Roushan Kumar Java oracle certificate Roushan Kumar Java oracle certificate
Roushan Kumar Java oracle certificate
 
DR PROF ING GURUDUTT SAHNI WIKIPEDIA.pdf
DR PROF ING GURUDUTT SAHNI WIKIPEDIA.pdfDR PROF ING GURUDUTT SAHNI WIKIPEDIA.pdf
DR PROF ING GURUDUTT SAHNI WIKIPEDIA.pdf
 
RESORT MANAGEMENT AND RESERVATION SYSTEM PROJECT REPORT.pdf
RESORT MANAGEMENT AND RESERVATION SYSTEM PROJECT REPORT.pdfRESORT MANAGEMENT AND RESERVATION SYSTEM PROJECT REPORT.pdf
RESORT MANAGEMENT AND RESERVATION SYSTEM PROJECT REPORT.pdf
 
Software Engineering - Modelling Concepts + Class Modelling + Building the An...
Software Engineering - Modelling Concepts + Class Modelling + Building the An...Software Engineering - Modelling Concepts + Class Modelling + Building the An...
Software Engineering - Modelling Concepts + Class Modelling + Building the An...
 
Online resume builder management system project report.pdf
Online resume builder management system project report.pdfOnline resume builder management system project report.pdf
Online resume builder management system project report.pdf
 
İTÜ CAD and Reverse Engineering Workshop
İTÜ CAD and Reverse Engineering WorkshopİTÜ CAD and Reverse Engineering Workshop
İTÜ CAD and Reverse Engineering Workshop
 
Lecture_8-Digital implementation of analog controller design.pdf
Lecture_8-Digital implementation of analog controller design.pdfLecture_8-Digital implementation of analog controller design.pdf
Lecture_8-Digital implementation of analog controller design.pdf
 
一比一原版(UNK毕业证)内布拉斯加州立大学科尼分校毕业证成绩单
一比一原版(UNK毕业证)内布拉斯加州立大学科尼分校毕业证成绩单一比一原版(UNK毕业证)内布拉斯加州立大学科尼分校毕业证成绩单
一比一原版(UNK毕业证)内布拉斯加州立大学科尼分校毕业证成绩单
 
Laundry management system project report.pdf
Laundry management system project report.pdfLaundry management system project report.pdf
Laundry management system project report.pdf
 
BRAKING SYSTEM IN INDIAN RAILWAY AutoCAD DRAWING
BRAKING SYSTEM IN INDIAN RAILWAY AutoCAD DRAWINGBRAKING SYSTEM IN INDIAN RAILWAY AutoCAD DRAWING
BRAKING SYSTEM IN INDIAN RAILWAY AutoCAD DRAWING
 
Supermarket billing system project report..pdf
Supermarket billing system project report..pdfSupermarket billing system project report..pdf
Supermarket billing system project report..pdf
 
Planetary Gears of automatic transmission of vehicle
Planetary Gears of automatic transmission of vehiclePlanetary Gears of automatic transmission of vehicle
Planetary Gears of automatic transmission of vehicle
 
The battle for RAG, explore the pros and cons of using KnowledgeGraphs and Ve...
The battle for RAG, explore the pros and cons of using KnowledgeGraphs and Ve...The battle for RAG, explore the pros and cons of using KnowledgeGraphs and Ve...
The battle for RAG, explore the pros and cons of using KnowledgeGraphs and Ve...
 

nn_important study materoial okfjevh rji

  • 2. Contents .Introduction to Neural Network .Neurons .Activation Function .Types of Neural Network .Learning In Neural Networks .Application of Neural Network .Advantages of Neural Network .Disadvantages Of Neural Network
  • 3. Neural Networks • A method ofcomputing, based on the interactionof multipleconnected processing elements. • A powerful technique to solve many real world problems. • The ability to learn from experience in order to improve their performance. • Ability to deal with incomplete information
  • 4. • • • • Biological approach to AI Developed in 1943 Comprised of one or more layers of neurons Several types, we’ll focus on feed-forward and feedback networks Basics Of Neural Network
  • 6. Neural Network Neurons • • • • Receives n-inputs Multiplies each input by its weight Applies activation function to the sum of results Outputs result
  • 7. Activation Functions • • • Controlswhen unit is “active” or “inactive” Threshold function outputs 1 when input is positive and 0 otherwise Sigmoid function = 1 / (1 + e-x)
  • 8. Neural Network types can be classified based on following attributes: • Connection Type - Static (feedforward) - Dynamic (feedback) • Topology - Single layer - Multilayer - Recurrent • Learning Methods - Supervised - Unsupervised - Reinforcement Types of Neural Networks
  • 9. Classification Based On Connection Types (unit delay operator z-1 implies dynamic system) •Static(Feedforward) • Dynamic(Feedback) Classification Based On Topology • Single layer • Multilayer • Recurrent
  • 10. Classification Based On Learning Method • Supervised • Unsupervised • Reinforcement Supervised learning • Each training pattern: input + desired output • At each presentation: adapt weights • Aftermany epochs convergence to a local minimum
  • 11. Unsupervised Learning • • • • • No help from the outside No training data,no information availableon the desired output Learning by doing Used to pick out structure in the input: • Clustering • Reduction of dimensionality  compression Example: Kohonen’s Learning Law
  • 12. Reinforcement learning • • • • Teacher: training data The teacher scores the performance of the training examples Use performance score to shuffle weights ‘randomly’ Relatively slow learning due to ‘randomness’
  • 13. Neural Network Applications • Pattern recognition • Investment analysis • Control systems & monitoring • Mobile computing • Marketing and financial applications • Forecasting – sales, market research, meteorology
  • 14. Advantages: • A neural network can perform tasks that a linear program can not. • When anelementoftheneural network fails, it can continue withoutany problemby their parallel nature. • A neural network learns and does not need tobe reprogrammed. • It can be implemented in any application. • It can be implemented without any problem
  • 15. Disadvantages: • Theneural network needs training to operate. • The architectureof a neural network isdifferentfrom the architecture of microprocessors therefore needs to beemulated. • Requires highprocessing time for large neural networks.
  • 16. Conclusions • • • Neural networks provide ability to provide more human-like AI Takes rough approximation and hard-coded reactions out of AI design (i.e. Rules and FSMs) Still require a lot of fine- tuning during development
  • 17. References • • • • • Neural Networks, Fuzzy Logic, and Genetic Algorithm ( synthesis and Application) S.Rajasekaran, G.A. Vijayalakshmi Pai, PHI Neuro Fuzzy and Soft Computing, J. S. R. JANG,C.T. Sun, E. Mitzutani, PHI Neural Netware, a tutorial on neural networks Sweetser, Penny. “Strategic Decision-Making with Neural Networks and Influence Maps”, AI Game Programming Wisdom 2, Section 7.7 (439 – 46) Russell, Stuart and Norvig, Peter. Artificial Intelligence: A Modern Approach, Section 20.5 (736 – 48)