It’s the beginning of a new era of technology where engineering will reach new milestones. Just like in the science fiction movies where display of computer screen appears on walls, commands are given by gestures, the smart digital environment which talks to us to do our work and so on, these all will be possible very soon.
2. Introduction
SixthSense is a wearable gestural interface that
enhances the physical world around us with digital
information and lets us use natural hand gestures to
interact with that information.
SixthSense technology has integrated the real world
objects with digital world.
It associates technologies like hand gesture recognition,
image capturing, processing, and manipulation, etc.
It superimposes the digital world on the real world.
3. Pranav Mistry
Pranav Mistry is an Indian computer scientist and inventor of
SixthSense Technology.
Alma mater
Nirma Institute of Technology(B.Tech.)
IIT Bombay(M.Des.)
MIT Media Lab(PhD)
Doctoral advisor
Pattie Maes
Known for Inventor of
SixthSense
Mouseless
SPARSH
TeleTouch
Samsung Galaxy GEAR
7. Camera
It tracks the movement of the
colored markers using movement
algorithms.
The camera recognizes
individuals, images, pictures,
gestures that user makes with his
hand.
The camera then sends this data
to a smart phone for processing
8. Colored
Marker
Placed at the tip of users
fingers
Red, yellow, green and blue
colored tapes
Helps the webcam to
recognize the hand gestures
Act as an interaction
instruction for the projected
application interfaces
9. Mobile
Component
Web enabled
smartphone
Process the data send
by the camera
Smartphone searches
the web and interprets
the hand gestures with
the help of the colored
markers.
10. Projector
The information that is
interpreted through the
smartphone can be projected
into any surface.
Projects the visual information
enabling surfaces and physical
objects to be used as interfaces
Consists of batteries which
have 3 hours of battery life
The downward facing projector
projects the image on to a
mirror.
11. Mirror
The mirror reflects the image on to a desire surface
The downward-facing projector projects the output
image on to the mirror
And the mirror reflects this image on to the desired
surface.
12. Working
The object in view in captured by the camera and sends
it to webcam for processing.
With the help of the markers, the gestures are identified.
The software program analyses the video data caught
by the camera
Tracks down the locations of the colored markers by
utilizing single computer vision techniques.
The software recognizes 3 kinds of gestures:
Multitouch gestures
Freehand gestures
Iconic gestures
Then the processed information is projected by the
projector onto the mirror which in turn reflects it on the
desired surface.
21. Conclusion
The sixth sense technology provides us with the
freedom of interacting with the digital world with
hand gestures.
The technology has a wide application in the field
of artificial intelligence. This methodology can aid in
synthesis of bots that will be able to interact with
humans.