Group Members
★ D N A Jayamaha
★ A Arunthavanathan
★ S Sobiga
★ Srishiyamalan R
★ Vinojan T
★ Manipulation of real-world objects
★ Transforming real-world objects into displays to the
next level using deformation
★ Capturing complex deformation in high detail and real
time
★ New and robust method for detecting hands and fingers
Projection of visual interfaces…
why?
Approach For Flex Pad
★ Approach to capture the deformable object
○ Capturing the pose and detailed deformation
of a deformable surface from depth data in
real-time
★ Removal of hands and fingers
★ Global deformation model
★ How global deformation model
FlexPad Implementation
★ Exploring and analyzing volumetric
data sets
★ Animating virtual paper characters
★ Slicing through time in videos
Applications
★ Folding and very steep bending angles
★ Makes a trade-off
★ Not suitable for:
○ very sharp bends
○ Particular folds
Limitations...
Feasibility of FlexPad
Evaluation
★ Tracking performance
★ User performance of Deformation
Result
★ Tracking performs very adequately even in challenging
realistic tasks.
★ Users are capable of using highly flexible displays with ease
Future works…
★ Touch input on deformable displays
★ Active flexible displays
★ Smart materials: programmable stiffness and
stretchability
Exploitation of human intuition on manipulation of real-world objects for interacting with computer systems.
Taking transforming real-world objects into displays to the next level by using deformation as another input parameter.
Many degrees of freedom for deformation of everyday objects
Algorithm for capturing complex deformation in high detail and real time
New and robust method for detecting hands and fingers with a Kinect camera using optical analysis of the surface material
Dynamic shader lamps - painting on movable objects
Mirage Table - freehand interaction on projected augmented reality
Omnitouch - wearable multitouch interaction everywhere
WUW - wear ur world; a wearable gestural interface
Capturing the pose and detailed deformation of a deformable surface from depth data in real-time
Exploring and analyzing volumetric data sets
Important in
medicine: CT and MRI scans
curved cross section
geology
engineers to locate the best place for well
earth sciences
Volumetric data set to the 3D volume in physical space
Highly flexible display
Can lock the view
Slicing through time in videos
Inspired by khronos projector
Khronos Vs FlexPad
Khronos:
very bulky
several cubic meters big
immobile setup with a fixed screen
Flexpad:
virtually any sheet of paper
display allows for defining a curvature
Animating virtual paper characters
For children
Animating paper characters
3D models animation
Folding and very steep bending angles
solution- Kinect sensors and projectors
Makes a trade-off
tracking stability & detectable deformations.
Not suitable for:
very sharp bends
Particular folds
Stretchable materials
To evaluate the feasibility of the Flexpad approach, they conducted two evaluations, examining both system performance and the users’ ability of precise interaction with
highly deformable displays.
Test : 1.Tracking performance
Volunteers use slicing-throughtime application and freely create interesting renderings by deforming the display. Recorded the raw video stream from the Kinect camera.calculating the RMS error . This shows that the tracking performs very adequately even in challenging realistic tasks.
2. User performance deformation
evaluate how fast and precise users are able to perform deformations and to examine the influence of flexible vs. shape-retaining display materials.
The result is users are capable of using highly flexible displays with ease. Users can make various single and dual deformations with both materials quickly and easily.
Fully flexible material suited for simple deformations and preferred for the task of the controlled experiments.
Shape-retaining materials well suited for complex deformation and analyzing curve phenomena but it introduce time penalty in shape creation.
Touch input on deformable displays
developing solutions for Kinect sensors to detect touch input reliably on real-time deformable surfaces
more advanced techniques need to be developed, for instance based on the shape of the touch point or on the normal force involved to deform the display
Active flexible displays
Currently available projected display prototypes are still very limited in their flexibility, so that they cannot be used to realize our concepts. Given the rapid advancements in display technology
Smart materials for flexible displays
both fully flexible and shape-retaining displays have unique capabilities. A material that can programmatically switch between both of these states would combine all these advantages. Moreover, future work should examine handheld displays that, in addition to being deformable, are stretchable. This will further increase the expressiveness of interactions with flexible displays