SlideShare une entreprise Scribd logo
1  sur  3
Télécharger pour lire hors ligne
Shraddha A. Kamble Int. Journal of Engineering Research and Applications www.ijera.com
ISSN : 2248-9622, Vol. 4, Issue 12( Part 5), December 2014, pp.01-03
www.ijera.com 1 | P a g e
An Approach for Object and Scene Detection for Blind Peoples
Using Vocal Vision.
Shraddha A. Kamble
ABSTRACT
This system help the blind peoples for the navigation without the help of third person so blind person can perform its work
independently. This system implemented on android device in which object detection and scene detection implemented, so
after detection there will be text to speech conversion so user or blind person can get message from that android device with
the help of headphone connected to that device. Our project will help blind people to understand the images which will be
converted to sound with the help of webcam. We shall capture images in front of blind peoples .The captured image will be
processed through our algorithms which will enhances the image data. The hardware component will have its own database.
The processed image is compare with the database in the hardware component .The result after processing and comparing
will be converted into speech signals. The headphones guide the blind peoples.
I. Introduction:
Vocal Vision is an application made for visually
impaired people. From long years ago till the date it
is seen that blind people face many problems in doing
their activities. They are dependent on others for
doing everything. This motivated us to design the
system called “VOCAL VISION”. This is a small
approach to make the blind people independent. This
project is a vision substitute system designed to assist
blind people for autonomous navigation. Its working
concept is based on „image to sound‟ conversion. The
webcam captures the image in front of blind user then
object detection algorithm process this image and
enhances the image data that image compare with
image in database .If comparison successful then
message through android device deliver to user or
blind person with the help of headphone about object
name and for scene name of the sce A webcam is
used to capture the image of the object in the
surrounding. This captured image is processed
through algorithms. Algorithms includes blurring,
gray scaling, edge detection, threasholding, boundary
detection, cropping, RGB to HSV, histogram,
normalization. After this the object or scenes are
compare with the database images so if comparison is
successful then it inform blind person about that
object or scenes.
Previous System:
technologies and devices includes:
1. Electronic Travel Aids (ETA).
2. Augmented Reality (AR) technology.
3. Navigation Assistance for Visually Impaired
(NAVI)
II. ETA:
This technology propose a new system for blind
navigation using RFID tags to set up a location
tagging infrastructure within buildings such that the
blind can use an RFID equipped ETA (such as a cell
phone) to determine their location as well as software
that can utilize this localization data to generate vocal
directions to reach a destination. Electronic Travel
Aids (ETAs) are electronic devices designed to
improve autonomous navigation of blind people.
ETAs design varies from the sizes, the type of sensor
used in the system, the method of conveying
information and also the method of usage. Image of
the scene in front of blind user is captured using
video camera and it is transformed into sound pattern.
The intensity of the pixel of the image is transformed
into loudness .
III. AR Technology:
Augmented Reality (AR) technologies have the
potential to support some of the activities for the
blind people. This paper presents a design for how a
walking cane can be augmented with a camera to
detect Semacodes and a Braille device to deliver
information. Based on the design they have
developed a prototype and described its
characteristics, limitations, and lessons learned.
Augmented Reality (AR) technologies make the daily
life easier for people with disabilities. Smaller and
smaller computers enable these people to wear
powerful information devices that can help
navigating and recognizing objects. Otherwise
impossible tasks could be doable by introducing AR
concepts and special designed tools. This outlines
three strategies in the field of augmented reality: 1)
Augmenting the user, 2) Augmenting physical
objects and 3) Augmenting the environment.
IV. NAVI:
This technology proposes a new object
identification and color recognition module for blind
people. Image processing techniques are proposed to
RESEARCH ARTICLE OPEN ACCESS
Shraddha A. Kamble Int. Journal of Engineering Research and Applications www.ijera.com
ISSN : 2248-9622, Vol. 4, Issue 12( Part 5), December 2014, pp.01-03
www.ijera.com 2 | P a g e
identify objects in the captured image and then the
processed image is transformed into stereo sound
patterns. Color information from the interested object
is evaluated to determine the color of the
object.NAVI system consists of tiny vision sensor
attached on a sunglass, a stereo earphones and a
Single Board Processing System (SBPS)
interconnected. SPBS selected for this system is
PCM-9550F with Embedded Intel low power
PentiumMMX 266 MHz processor, 128 MB
SDRAM, 2.5” light weight hard disk, two Universal
serial bus and RTL 8139 sound device chipset
assembled in Micro box PC-300 chassis. The weight
of SBPS is 0.7 Kg. Constant 5V and 12 V supply for
SBPS is provided from the batteries. Vision sensor
selected for this application is a digital video camera,
Zion PN615CMOS. Figure shows the processing
equipment of NAVI system.
Drawbacks of system:
1) ETA system uses the ultrasonic sensors which is
expensive which contains few electronic components.
2) In AR technology walking cane can be augmented
with a camera to detect Semacodes and a Braille
device to deliver information.
3) NAVI system only useful for object detection but
we also included the scene detection technique in this
project.
Proposed System:
Definition:
Vocal Vision is an application made for visually
impaired people. From long years ago till the date it
is seen that blind people face many problems in doing
their activities. They are dependent on others for
doing everything. This motivated us to design the
system called “VOCAL VISION”. This is a small
approach to make the blind people independent. This
project is a vision substitute system designed to assist
blind people for autonomous navigation. Its working
concept is based on „image to sound‟ conversion. The
webcam captures the image in front of blind user then
object detection algorithm process this image and
enhances the image data that image compare with
image in database .If comparison successful then
message through android device deliver to user or
blind person with the help of headphone about object
name and for scene name of the scene.
Overall Description
Different blocks includes in this systems are
blurring, gray scaling, edge detection, threasholding,
boundary detection, cropping, RGB to HSV,
histogram, normalization. After this the object or
scenes are compare with the database images so if
comparison is successful then it inform blind person
about that object or scenes.
Shraddha A. Kamble Int. Journal of Engineering Research and Applications www.ijera.com
ISSN : 2248-9622, Vol. 4, Issue 12( Part 5), December 2014, pp.01-03
www.ijera.com 3 | P a g e
Blurring:
Using this image looks more sharp or more
detailed and it is use for the noise reduction from the
grabbed image. Blurring can be achieved using filters
such as:
1) Mean filter
2) Weighted average
3) Gaussian filter
Gray Scale:
In a (8-bit) grayscale image each picture element
has an assigned intensity that ranges from 0 to 255.A
grey scale image is different from black and white
image since a grayscale image also includes shades
of grey apart from pure black and pure white color.
Edge Detection:
Edge of the object detected from this technique.
Sobel operator or Sobel filter use within edge
detection algorithm.
Threasholding:
From a grayscale image, threshoulding can be
used to create binary images i.e. image with only
black or white colors. It is usually used for feature
extraction where required features of image are
converted to white and everything else to black. (or
vice-versa)
Boundry Detection:
Boundry which separate object from the
surrounding detected.
Cropping:
Only the required object cropped and other
eliminated from image.
RGB to HSV:
HSV separate color information from image
intensity .It is use for histogram equalization of color
image because it only require the intensity
information of image.
Histogram:
Graphical representation of number of pixels for
each color. On x-axis range of color(0-255) and on y-
axis number of pixel for each color.
Normalization:
It is the process that changes the range of pixel
intensity values or spreading out most frequently
intensity values. Stretches an image‟s pixel values to
cover the entire pixel value range(0-255)
Conclusion:
Blind person can perform different activities
without the help of third person using this system.
Using this system blind person can do its work
independently
References:
[1] Object Identification and Colour Recognition
for Human Blind by R. Nagarajan, G.
Sainarayanan, Sazali Yaacob and Rosalyn R
Porle
[2] Blind Navigation and Object Recognition by
(Augmented Reality)R. Gude, M. Østerby, S.
Soltveit University of Aarhus, Denmark
[3] Building a Color Recognizer System on the
Smart Mobile Device for the Visually Impaired
People by Hsiao Ping Lee
[4] Joseph Schlecht, Björn Ommer “Contour-based
Object Detection” Interdisciplinary Center for
Scientific Computing University of Heidelberg ,
Germany, 2011

Contenu connexe

Tendances

Sift based arabic sign language recognition aecia 2014 –november17-19, addis ...
Sift based arabic sign language recognition aecia 2014 –november17-19, addis ...Sift based arabic sign language recognition aecia 2014 –november17-19, addis ...
Sift based arabic sign language recognition aecia 2014 –november17-19, addis ...
Tarek Gaber
 

Tendances (20)

Password Based Hand Gesture Controlled Robot
Password Based Hand Gesture Controlled Robot Password Based Hand Gesture Controlled Robot
Password Based Hand Gesture Controlled Robot
 
Sift based arabic sign language recognition aecia 2014 –november17-19, addis ...
Sift based arabic sign language recognition aecia 2014 –november17-19, addis ...Sift based arabic sign language recognition aecia 2014 –november17-19, addis ...
Sift based arabic sign language recognition aecia 2014 –november17-19, addis ...
 
Introduction to computer vision and
Introduction to computer vision andIntroduction to computer vision and
Introduction to computer vision and
 
IRJET= Air Writing: Gesture Recognition using Ultrasound Sensors and Grid-Eye...
IRJET= Air Writing: Gesture Recognition using Ultrasound Sensors and Grid-Eye...IRJET= Air Writing: Gesture Recognition using Ultrasound Sensors and Grid-Eye...
IRJET= Air Writing: Gesture Recognition using Ultrasound Sensors and Grid-Eye...
 
HUMAN MOTION DETECTION AND TRACKING FOR VIDEO SURVEILLANCE
HUMAN MOTION DETECTION AND TRACKING FOR VIDEO SURVEILLANCEHUMAN MOTION DETECTION AND TRACKING FOR VIDEO SURVEILLANCE
HUMAN MOTION DETECTION AND TRACKING FOR VIDEO SURVEILLANCE
 
IRJET- A Vision based Hand Gesture Recognition System using Convolutional...
IRJET-  	  A Vision based Hand Gesture Recognition System using Convolutional...IRJET-  	  A Vision based Hand Gesture Recognition System using Convolutional...
IRJET- A Vision based Hand Gesture Recognition System using Convolutional...
 
Development of Sign Signal Translation System Based on Altera’s FPGA DE2 Board
Development of Sign Signal Translation System Based on Altera’s FPGA DE2 BoardDevelopment of Sign Signal Translation System Based on Altera’s FPGA DE2 Board
Development of Sign Signal Translation System Based on Altera’s FPGA DE2 Board
 
Visual pattern recognition in robotics
Visual pattern recognition in roboticsVisual pattern recognition in robotics
Visual pattern recognition in robotics
 
G0342039042
G0342039042G0342039042
G0342039042
 
IRJET- Object Detection and Recognition for Blind Assistance
IRJET- Object Detection and Recognition for Blind AssistanceIRJET- Object Detection and Recognition for Blind Assistance
IRJET- Object Detection and Recognition for Blind Assistance
 
Real Time Vision Hand Gesture Recognition Based Media Control via LAN & Wirel...
Real Time Vision Hand Gesture Recognition Based Media Control via LAN & Wirel...Real Time Vision Hand Gesture Recognition Based Media Control via LAN & Wirel...
Real Time Vision Hand Gesture Recognition Based Media Control via LAN & Wirel...
 
Vision System and its application,Problems
Vision System and its application,ProblemsVision System and its application,Problems
Vision System and its application,Problems
 
Computer vision
Computer visionComputer vision
Computer vision
 
E0543135
E0543135E0543135
E0543135
 
Tagsense ppt
Tagsense pptTagsense ppt
Tagsense ppt
 
IRJET - Blind Guidance using Smart Cap
IRJET - Blind Guidance using Smart CapIRJET - Blind Guidance using Smart Cap
IRJET - Blind Guidance using Smart Cap
 
Biometric simulator for visually impaired (1)
Biometric simulator for visually impaired (1)Biometric simulator for visually impaired (1)
Biometric simulator for visually impaired (1)
 
concealed weapon detection using digital image processing
concealed weapon detection using digital image processingconcealed weapon detection using digital image processing
concealed weapon detection using digital image processing
 
Review of Pose Recognition Systems
Review of Pose Recognition SystemsReview of Pose Recognition Systems
Review of Pose Recognition Systems
 
Computer Vision
Computer VisionComputer Vision
Computer Vision
 

Similaire à An Approach for Object and Scene Detection for Blind Peoples Using Vocal Vision.

Interactive full body motion capture using infrared sensor network
Interactive full body motion capture using infrared sensor networkInteractive full body motion capture using infrared sensor network
Interactive full body motion capture using infrared sensor network
ijcga
 
Interactive Full-Body Motion Capture Using Infrared Sensor Network
Interactive Full-Body Motion Capture Using Infrared Sensor Network  Interactive Full-Body Motion Capture Using Infrared Sensor Network
Interactive Full-Body Motion Capture Using Infrared Sensor Network
ijcga
 
10.1109@ICCMC48092.2020.ICCMC-000167.pdf
10.1109@ICCMC48092.2020.ICCMC-000167.pdf10.1109@ICCMC48092.2020.ICCMC-000167.pdf
10.1109@ICCMC48092.2020.ICCMC-000167.pdf
mokamojah
 
Project ppt 2.pptx
Project ppt 2.pptxProject ppt 2.pptx
Project ppt 2.pptx
AKASHCSE1137
 

Similaire à An Approach for Object and Scene Detection for Blind Peoples Using Vocal Vision. (20)

Traffic Light Detection and Recognition for Self Driving Cars using Deep Lear...
Traffic Light Detection and Recognition for Self Driving Cars using Deep Lear...Traffic Light Detection and Recognition for Self Driving Cars using Deep Lear...
Traffic Light Detection and Recognition for Self Driving Cars using Deep Lear...
 
IRJET - Smart Blind Stick using Image Processing
IRJET - Smart Blind Stick using Image ProcessingIRJET - Smart Blind Stick using Image Processing
IRJET - Smart Blind Stick using Image Processing
 
Image_recognition.pptx
Image_recognition.pptxImage_recognition.pptx
Image_recognition.pptx
 
Development of wearable object detection system & blind stick for visuall...
Development of wearable object detection system & blind stick for visuall...Development of wearable object detection system & blind stick for visuall...
Development of wearable object detection system & blind stick for visuall...
 
Intelligent indoor mobile robot navigation using stereo vision
Intelligent indoor mobile robot navigation using stereo visionIntelligent indoor mobile robot navigation using stereo vision
Intelligent indoor mobile robot navigation using stereo vision
 
Ch1.pptx
Ch1.pptxCh1.pptx
Ch1.pptx
 
IRJET- Smart Helmet for Visually Impaired
IRJET- Smart Helmet for Visually ImpairedIRJET- Smart Helmet for Visually Impaired
IRJET- Smart Helmet for Visually Impaired
 
Interactive full body motion capture using infrared sensor network
Interactive full body motion capture using infrared sensor networkInteractive full body motion capture using infrared sensor network
Interactive full body motion capture using infrared sensor network
 
K1802027780
K1802027780K1802027780
K1802027780
 
SIGN LANGUAGE INTERFACE SYSTEM FOR HEARING IMPAIRED PEOPLE
SIGN LANGUAGE INTERFACE SYSTEM FOR HEARING IMPAIRED PEOPLESIGN LANGUAGE INTERFACE SYSTEM FOR HEARING IMPAIRED PEOPLE
SIGN LANGUAGE INTERFACE SYSTEM FOR HEARING IMPAIRED PEOPLE
 
Sanjaya: A Blind Assistance System
Sanjaya: A Blind Assistance SystemSanjaya: A Blind Assistance System
Sanjaya: A Blind Assistance System
 
Automated License Plate Recognition for Toll Booth Application
Automated License Plate Recognition for Toll Booth ApplicationAutomated License Plate Recognition for Toll Booth Application
Automated License Plate Recognition for Toll Booth Application
 
Interactive Full-Body Motion Capture Using Infrared Sensor Network
Interactive Full-Body Motion Capture Using Infrared Sensor Network  Interactive Full-Body Motion Capture Using Infrared Sensor Network
Interactive Full-Body Motion Capture Using Infrared Sensor Network
 
10.1109@ICCMC48092.2020.ICCMC-000167.pdf
10.1109@ICCMC48092.2020.ICCMC-000167.pdf10.1109@ICCMC48092.2020.ICCMC-000167.pdf
10.1109@ICCMC48092.2020.ICCMC-000167.pdf
 
Hardware realization of Stereo camera and associated embedded system
Hardware realization of Stereo camera and associated embedded systemHardware realization of Stereo camera and associated embedded system
Hardware realization of Stereo camera and associated embedded system
 
Sign Language Recognition using Machine Learning
Sign Language Recognition using Machine LearningSign Language Recognition using Machine Learning
Sign Language Recognition using Machine Learning
 
Human Motion Detection in Video Surveillance using Computer Vision Technique
Human Motion Detection in Video Surveillance using Computer Vision TechniqueHuman Motion Detection in Video Surveillance using Computer Vision Technique
Human Motion Detection in Video Surveillance using Computer Vision Technique
 
Simultaneous Mapping and Navigation For Rendezvous in Space Applications
Simultaneous Mapping and Navigation For Rendezvous in Space ApplicationsSimultaneous Mapping and Navigation For Rendezvous in Space Applications
Simultaneous Mapping and Navigation For Rendezvous in Space Applications
 
Dip sdit 7
Dip sdit 7Dip sdit 7
Dip sdit 7
 
Project ppt 2.pptx
Project ppt 2.pptxProject ppt 2.pptx
Project ppt 2.pptx
 

Dernier

XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
ssuser89054b
 
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 BookingVIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
dharasingh5698
 
AKTU Computer Networks notes --- Unit 3.pdf
AKTU Computer Networks notes ---  Unit 3.pdfAKTU Computer Networks notes ---  Unit 3.pdf
AKTU Computer Networks notes --- Unit 3.pdf
ankushspencer015
 
Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...
Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...
Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...
Christo Ananth
 

Dernier (20)

(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7
(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7
(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7
 
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
 
Thermal Engineering Unit - I & II . ppt
Thermal Engineering  Unit - I & II . pptThermal Engineering  Unit - I & II . ppt
Thermal Engineering Unit - I & II . ppt
 
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 BookingVIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
 
(INDIRA) Call Girl Meerut Call Now 8617697112 Meerut Escorts 24x7
(INDIRA) Call Girl Meerut Call Now 8617697112 Meerut Escorts 24x7(INDIRA) Call Girl Meerut Call Now 8617697112 Meerut Escorts 24x7
(INDIRA) Call Girl Meerut Call Now 8617697112 Meerut Escorts 24x7
 
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
 
Booking open Available Pune Call Girls Koregaon Park 6297143586 Call Hot Ind...
Booking open Available Pune Call Girls Koregaon Park  6297143586 Call Hot Ind...Booking open Available Pune Call Girls Koregaon Park  6297143586 Call Hot Ind...
Booking open Available Pune Call Girls Koregaon Park 6297143586 Call Hot Ind...
 
(INDIRA) Call Girl Aurangabad Call Now 8617697112 Aurangabad Escorts 24x7
(INDIRA) Call Girl Aurangabad Call Now 8617697112 Aurangabad Escorts 24x7(INDIRA) Call Girl Aurangabad Call Now 8617697112 Aurangabad Escorts 24x7
(INDIRA) Call Girl Aurangabad Call Now 8617697112 Aurangabad Escorts 24x7
 
Unleashing the Power of the SORA AI lastest leap
Unleashing the Power of the SORA AI lastest leapUnleashing the Power of the SORA AI lastest leap
Unleashing the Power of the SORA AI lastest leap
 
Thermal Engineering-R & A / C - unit - V
Thermal Engineering-R & A / C - unit - VThermal Engineering-R & A / C - unit - V
Thermal Engineering-R & A / C - unit - V
 
Water Industry Process Automation & Control Monthly - April 2024
Water Industry Process Automation & Control Monthly - April 2024Water Industry Process Automation & Control Monthly - April 2024
Water Industry Process Automation & Control Monthly - April 2024
 
AKTU Computer Networks notes --- Unit 3.pdf
AKTU Computer Networks notes ---  Unit 3.pdfAKTU Computer Networks notes ---  Unit 3.pdf
AKTU Computer Networks notes --- Unit 3.pdf
 
Double rodded leveling 1 pdf activity 01
Double rodded leveling 1 pdf activity 01Double rodded leveling 1 pdf activity 01
Double rodded leveling 1 pdf activity 01
 
The Most Attractive Pune Call Girls Budhwar Peth 8250192130 Will You Miss Thi...
The Most Attractive Pune Call Girls Budhwar Peth 8250192130 Will You Miss Thi...The Most Attractive Pune Call Girls Budhwar Peth 8250192130 Will You Miss Thi...
The Most Attractive Pune Call Girls Budhwar Peth 8250192130 Will You Miss Thi...
 
Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...
Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...
Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...
 
Unit 1 - Soil Classification and Compaction.pdf
Unit 1 - Soil Classification and Compaction.pdfUnit 1 - Soil Classification and Compaction.pdf
Unit 1 - Soil Classification and Compaction.pdf
 
Online banking management system project.pdf
Online banking management system project.pdfOnline banking management system project.pdf
Online banking management system project.pdf
 
NFPA 5000 2024 standard .
NFPA 5000 2024 standard                                  .NFPA 5000 2024 standard                                  .
NFPA 5000 2024 standard .
 
VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to ...
VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to ...VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to ...
VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to ...
 
Java Programming :Event Handling(Types of Events)
Java Programming :Event Handling(Types of Events)Java Programming :Event Handling(Types of Events)
Java Programming :Event Handling(Types of Events)
 

An Approach for Object and Scene Detection for Blind Peoples Using Vocal Vision.

  • 1. Shraddha A. Kamble Int. Journal of Engineering Research and Applications www.ijera.com ISSN : 2248-9622, Vol. 4, Issue 12( Part 5), December 2014, pp.01-03 www.ijera.com 1 | P a g e An Approach for Object and Scene Detection for Blind Peoples Using Vocal Vision. Shraddha A. Kamble ABSTRACT This system help the blind peoples for the navigation without the help of third person so blind person can perform its work independently. This system implemented on android device in which object detection and scene detection implemented, so after detection there will be text to speech conversion so user or blind person can get message from that android device with the help of headphone connected to that device. Our project will help blind people to understand the images which will be converted to sound with the help of webcam. We shall capture images in front of blind peoples .The captured image will be processed through our algorithms which will enhances the image data. The hardware component will have its own database. The processed image is compare with the database in the hardware component .The result after processing and comparing will be converted into speech signals. The headphones guide the blind peoples. I. Introduction: Vocal Vision is an application made for visually impaired people. From long years ago till the date it is seen that blind people face many problems in doing their activities. They are dependent on others for doing everything. This motivated us to design the system called “VOCAL VISION”. This is a small approach to make the blind people independent. This project is a vision substitute system designed to assist blind people for autonomous navigation. Its working concept is based on „image to sound‟ conversion. The webcam captures the image in front of blind user then object detection algorithm process this image and enhances the image data that image compare with image in database .If comparison successful then message through android device deliver to user or blind person with the help of headphone about object name and for scene name of the sce A webcam is used to capture the image of the object in the surrounding. This captured image is processed through algorithms. Algorithms includes blurring, gray scaling, edge detection, threasholding, boundary detection, cropping, RGB to HSV, histogram, normalization. After this the object or scenes are compare with the database images so if comparison is successful then it inform blind person about that object or scenes. Previous System: technologies and devices includes: 1. Electronic Travel Aids (ETA). 2. Augmented Reality (AR) technology. 3. Navigation Assistance for Visually Impaired (NAVI) II. ETA: This technology propose a new system for blind navigation using RFID tags to set up a location tagging infrastructure within buildings such that the blind can use an RFID equipped ETA (such as a cell phone) to determine their location as well as software that can utilize this localization data to generate vocal directions to reach a destination. Electronic Travel Aids (ETAs) are electronic devices designed to improve autonomous navigation of blind people. ETAs design varies from the sizes, the type of sensor used in the system, the method of conveying information and also the method of usage. Image of the scene in front of blind user is captured using video camera and it is transformed into sound pattern. The intensity of the pixel of the image is transformed into loudness . III. AR Technology: Augmented Reality (AR) technologies have the potential to support some of the activities for the blind people. This paper presents a design for how a walking cane can be augmented with a camera to detect Semacodes and a Braille device to deliver information. Based on the design they have developed a prototype and described its characteristics, limitations, and lessons learned. Augmented Reality (AR) technologies make the daily life easier for people with disabilities. Smaller and smaller computers enable these people to wear powerful information devices that can help navigating and recognizing objects. Otherwise impossible tasks could be doable by introducing AR concepts and special designed tools. This outlines three strategies in the field of augmented reality: 1) Augmenting the user, 2) Augmenting physical objects and 3) Augmenting the environment. IV. NAVI: This technology proposes a new object identification and color recognition module for blind people. Image processing techniques are proposed to RESEARCH ARTICLE OPEN ACCESS
  • 2. Shraddha A. Kamble Int. Journal of Engineering Research and Applications www.ijera.com ISSN : 2248-9622, Vol. 4, Issue 12( Part 5), December 2014, pp.01-03 www.ijera.com 2 | P a g e identify objects in the captured image and then the processed image is transformed into stereo sound patterns. Color information from the interested object is evaluated to determine the color of the object.NAVI system consists of tiny vision sensor attached on a sunglass, a stereo earphones and a Single Board Processing System (SBPS) interconnected. SPBS selected for this system is PCM-9550F with Embedded Intel low power PentiumMMX 266 MHz processor, 128 MB SDRAM, 2.5” light weight hard disk, two Universal serial bus and RTL 8139 sound device chipset assembled in Micro box PC-300 chassis. The weight of SBPS is 0.7 Kg. Constant 5V and 12 V supply for SBPS is provided from the batteries. Vision sensor selected for this application is a digital video camera, Zion PN615CMOS. Figure shows the processing equipment of NAVI system. Drawbacks of system: 1) ETA system uses the ultrasonic sensors which is expensive which contains few electronic components. 2) In AR technology walking cane can be augmented with a camera to detect Semacodes and a Braille device to deliver information. 3) NAVI system only useful for object detection but we also included the scene detection technique in this project. Proposed System: Definition: Vocal Vision is an application made for visually impaired people. From long years ago till the date it is seen that blind people face many problems in doing their activities. They are dependent on others for doing everything. This motivated us to design the system called “VOCAL VISION”. This is a small approach to make the blind people independent. This project is a vision substitute system designed to assist blind people for autonomous navigation. Its working concept is based on „image to sound‟ conversion. The webcam captures the image in front of blind user then object detection algorithm process this image and enhances the image data that image compare with image in database .If comparison successful then message through android device deliver to user or blind person with the help of headphone about object name and for scene name of the scene. Overall Description Different blocks includes in this systems are blurring, gray scaling, edge detection, threasholding, boundary detection, cropping, RGB to HSV, histogram, normalization. After this the object or scenes are compare with the database images so if comparison is successful then it inform blind person about that object or scenes.
  • 3. Shraddha A. Kamble Int. Journal of Engineering Research and Applications www.ijera.com ISSN : 2248-9622, Vol. 4, Issue 12( Part 5), December 2014, pp.01-03 www.ijera.com 3 | P a g e Blurring: Using this image looks more sharp or more detailed and it is use for the noise reduction from the grabbed image. Blurring can be achieved using filters such as: 1) Mean filter 2) Weighted average 3) Gaussian filter Gray Scale: In a (8-bit) grayscale image each picture element has an assigned intensity that ranges from 0 to 255.A grey scale image is different from black and white image since a grayscale image also includes shades of grey apart from pure black and pure white color. Edge Detection: Edge of the object detected from this technique. Sobel operator or Sobel filter use within edge detection algorithm. Threasholding: From a grayscale image, threshoulding can be used to create binary images i.e. image with only black or white colors. It is usually used for feature extraction where required features of image are converted to white and everything else to black. (or vice-versa) Boundry Detection: Boundry which separate object from the surrounding detected. Cropping: Only the required object cropped and other eliminated from image. RGB to HSV: HSV separate color information from image intensity .It is use for histogram equalization of color image because it only require the intensity information of image. Histogram: Graphical representation of number of pixels for each color. On x-axis range of color(0-255) and on y- axis number of pixel for each color. Normalization: It is the process that changes the range of pixel intensity values or spreading out most frequently intensity values. Stretches an image‟s pixel values to cover the entire pixel value range(0-255) Conclusion: Blind person can perform different activities without the help of third person using this system. Using this system blind person can do its work independently References: [1] Object Identification and Colour Recognition for Human Blind by R. Nagarajan, G. Sainarayanan, Sazali Yaacob and Rosalyn R Porle [2] Blind Navigation and Object Recognition by (Augmented Reality)R. Gude, M. Østerby, S. Soltveit University of Aarhus, Denmark [3] Building a Color Recognizer System on the Smart Mobile Device for the Visually Impaired People by Hsiao Ping Lee [4] Joseph Schlecht, Björn Ommer “Contour-based Object Detection” Interdisciplinary Center for Scientific Computing University of Heidelberg , Germany, 2011