2. Outline of the presentation
Objective.
Block diagram
Data Acquisition Methods
Flex sensors
Main Program’s Flow chart
Advantages of gesture based control.
Other applications of gesture control
system
3. Objective
How often do we come across a disabled person, say a
visually or speech challenged individual in mainstream
life? The truth is that there is often little room for the
disabled in the real world.
With our project, we have tried to make a small effort
which can be the first step to providing the disabled an
aid to establish an independent and sustainable lifestyle.
The basic objective of our project is to develop a
portable device for the people who suffer from speech
impairment, providing them an aid to communicate
easily.
4. Continued….
This project is useful for the people who suffer
from speech impairment and use sign language as
a means of communication, which is understood
only by a few[4]. Similarly it can provide aid to
the patients with half of their bodies paralyzed and
who are not able to speak but are able move their
fingers.
But the sign language vary from region to region
and learning it is not an easy task.
5. Motivation
The motivation is American Sign Language
(ASL). ASL uses hand shape, position and
movement. Body movements, gestures,
facial expressions, and other visual cues to
form its words[14,15].
6. Block diagram
Main components used in the project
Flex sensors
PIC microcontroller with built in ADC.
LCD display.
10. EMG
EMG patterns are different for different individuals
•Vary due to location of electrodes
•User fatigue
•Sweat on skin
11. EMG
EMG patterns are different for different individuals
•Vary due to location of electrodes
•User fatigue
•Sweat on skin
12. Coupled microphone accelerometer
sensor pair
•MMG measurement of muscular vibration
•Electrode impedance variation due to sweating
•Signals larger than EMG
•Less sensitive to precise placement
•Special filtering is required
13. Wearable conductive fiber
•Change resistance as length of fiber is changed
•Placed on flexible fabric
•Uncomfortable to wear continuously
14. Deterioration of optical fiber
•Depends on amount of light reached
•Difficult to deteriorate evenly
•Weakens the optical fiber
15. Flex sensors
Flex sensors are the sensors that change in
resistance depending on the mount of bend
on the sensor. They convert the change in
bend to electrical resistance - the more the
bend, the more the resistance value [18,19].
They are usually in the form of a thin strip
from 1"-5" long
Inside the flex sensor are carbon resistive
elements within a thin flexible substrate.
With a typical flex sensor, a flex of 0
degrees will give 10K resistance will a flex
of 90 will give 80-100K ohms.
The Bend Sensor lists resistance of 30-250
K ohms.
16. Electrical characteristics
Size approx 0.28" wide and 1"/3"/5" long
Resistance Range1.5-40K ohms depending on sensor.
Flex point claims a 0-250 resistance range.
Lifetime Lifetime Greater than 1 million life cycles
(rugged)
Temperature Range -35 to +80 degrees Celsius
Hysteresis 7%
Voltage 5 to 12 V
17. As used in the project
Vout = V*Rbend / Rbend+Rm
18. Advantages
Economical
Thin, flexible, robust
Simple one piece construction
Operates in a large temperature range
Provides greater accuracy than tradition
potentiometer
Able to withstand exposure to moisture in
harsh environment
19. Limitations
Major drawback using this sensor is that it is very
sensitive to small bends, due to which its output
deviates slightly even when the hand is steady.
So to over come this problem we have used it in
voltage divider configuration and moreover
stitched pockets on the glove so the sensors do not
change their position, and defined voltage ranges
in out program.
The result of this arrangement is that the output
voltage increases with increasing deflection
20. Look up Table
D14 D7 B9 F16 B1
a 3.4-3.8 1.9-2.3 1.4-1.7 1.2-1.4 1.7-2.5
b 2.8-3.2 1.3-1.7 1.1-1.3 0.9-1 2-2.3
c 3.1-3.9 1.5-1.9 1.2-1.3 0.9-1.1 2-2.3
d 2.9-3.4 1.8-2 1.3-1.4 1-1.1 1.8-1.9
e 3.4-4.5 1.9-2 1.3-1.5 1.1 2.3-2.6
f 3.3-4.1 1.5-1.6 1.1-1.3 0.9-1 1.7-1.9
g 2.9-3.5 2.1-2.4 1.5-1.7 1.2-1.4 1.7-1.8
h 2.8-3.3 1.4-1.6 1.6-2.1 1.2-1.5 2-2.2
i 3.2-3.7 2.1-2.3 1.6-1.9 0.9-1 2-2.1
j 3.4-4.1 2.1-2.4 1.3-1.8 0.8-0.9 1.9-2.1
k 3.0-3.3 1.4-1.6 1.5-1.9 1.2-1.5 1.7-2
l 3.1-3.3 2.3-2.6 1.6-1.8 1.2-1.5 1.7-1.8
21. m 3.6-3.9 1.9-2.5 1.4-1.7 1.3-1.8 2.1-2.7
n 3.4-3.8 1.8-2.0 1.8-2 1.2-1.6 2.2-2.4
o 3.2-3.8 1.8-2 1.4-1.5 1-1.2 1.8-2
p 2.8-3.3 1.9-2.2 1.5-2 1.4-1.6 1.7-2.2
q 2.9-3.2 2.1-2.3 1.6-1.8 1.1-1.5 1.6-1.9
r 2.9-3.2 1.4-1.7 1.8-2 1.2-1.5 1.9-2.1
s 3.7-4.2 2.2-2.3 1.7-1.9 1.2-1.5 1.8-2.2
t 3.1-3.6 2.2-2.4 1.6-1.8 1.3-1.4 2-2.1
u 3-3.4 1.5-1.6 1.9-2 1.1-1.5 2
v 3-3.8 1.5-1.7 1.5-2 1.2-1.5 2-2.3
w 2.9-3.3 1.5-1.6 1.1-1.3 1-1.2 2-2.3
x 3.4-3.6 2.2-2.6 1.6-2 1.3-1.5 1.9-2.2
y 3.7-3.9 2.2-2.4 1.6-1.7 1-1.1 2-3.6
z 3-3.4 2.3-2.6 1.7-1.9 1.1-1.5 2.0-2.4
Continued…
22. Define a two dimensional
array and create a look
up table in ROM
Read data from ADC port
Iterate from A to Z
Compare input data with
data in look up table
Print the alphabet
on LCD Display
true
Increment to next
alphabet
False
Flow chart
24. Advantages of gesture based
control
Does not need Key board, mouse, speech recognition,
touch screen etc.
Does not require expensive and sophisticated Devices
Does not need the attendant or Doctor to understand sign
language as well.
The subject need not learn complex gestures of different
words in ASL.
The prototype can be enhanced to perform various tasks or
turn on/off home appliances/equipments automatically.
With the glove on and device worn as a wrist watch, only
power cable with battery adapter is required to plug in.
With a text to speech converter the person suffering from
speech impairment can actually talk to every one!
25. Applications
In house hold & Security Systems.
In industries.
In biomedicine.
In virtual reality.
