This document outlines a proposed study to develop a tactile navigation system to assist visually and hearing impaired individuals. The system would use image processing, infrared sensors and ultrasonic sensors integrated with a smartphone to detect obstacles and navigate indoor and outdoor environments. It would calculate sensor thresholds, distance of obstacles and eliminate noise to guide users and provide hearing assistance. The proposed system architecture, software design including initialization, calibration, filtering and wayfinding logic, and hardware design including microcontrollers, motors and sensors are described. Expected results include faster obstacle detection, accuracy, user satisfaction, safety and flexibility.
Take control of your SAP testing with UiPath Test Suite
Study of Tactile interactions for visually disabled and hearing impaired
1. Study of Tactile interactions for
visually disabled and hearing
impaired
Supervised by:
Prof. Dr. M.M.A. Hashem
Abu Saleh Md. Musa
Roll-0907013
Taslima Akter
Roll-0907046
3. Introduction
• Over 21.2 million visually impaired in USA.
• Independent tactile interactions is becoming
a bigger challenge.
• Disablers are falling behind.
• Sometimes their lives at risk.
• device that aids disabled with Smartphones.
4. Problem Statement
•
•
•
•
Difficult to develop a single device.
GPS not supporting in indoor
Objects are more congested in indoor
Possible Solution:
• Image Processing
• IR Sensors & Ultrasonic way finder
• New Google Phone(code name “Project Tango”)
5. Specific objectives
To assist physically disabled people.
To navigate for both indoor and outdoor environment.
To detect objects and obstacles in navigation path.
To calculate the threshold value of sensors.
To calculate distance of obstacles using Rangefinder sonar sensor.
To eliminate noises from the pulse information.
To make a system that employs total support for visually disabled
people.
• To perform assistance as hear aid for disabled.
• To analyze a system that employs navigational path using smartphones.
•
•
•
•
•
•
•
8. Initialization and Calibration
• ADC and TRT kernel
• determines threshold based on the height of
the user.
• Three calibration readings at 140ms apart
• chooses median value as calibrated value.
sensor threshold = sqrt(2) * calibrated value
• holding the tactile sensor at a 45 degree
angle
9. Obtaining range information from
sensors
•
•
•
•
•
•
simultaneous use of sensor.
Semaphores are used to ensure that.
delay 50ms
require 49ms to obtain a range reading
8-bit from ADC is converted to distance.
Dis(m)=Vin*(512/5)(in/V)*0.0254(m/in)
=(5/256*ADC)*512/5*0.0254
10. Median Filtering
•
•
•
•
•
Filter of size 3
effective
Two causes for Impulse noises
Sudden change in ranges
overestimating the distance of an object
11. Wayfinding logic
• Two real time tasks
• Navigation logic
• checks for the presence of obstacles in the fields
of view
• object in threshold of 2m, motor will buzz
• Tactile sensor logic
• checks for obstacles by calibration process
• scales intensity of the vibrations proportionately
with the proximity of the obstacles.
13. Real-time scheduling
• sensors are working independently and
simultaneously.
• tactile sensor logic task and ranging tasks
have priority over navigation logic.
• navigation logic frequency =300ms
• 250ms for all the other tasks.
16. External Design for Hearing
impaired
• Amplified Sound and vibration will indicate
command generated by smartphones.
• amplifier circuit will be embedded.
• Mini motor vibrator will be used.
• Vibration indicates navigational way.