Throughout the history of computers we've been striving to shorten the gap between us and digital information, the gap between our physical world and the world in the screen where our imagination can go wild. And this gap has become shorter, shorter, and even shorter, and now this gap is shortened down to less than a millimeter, the thickness of a touch-screen glass, and the power of computing has become accessible to everyone.
But I wondered, what if there could be no boundary at all? I started to imagine what this would look like. First, I introduce this tool in below which penetrates into the digital space, so when you press it hard on the screen, it transfers its physical body into pixels. Designers can materialize their ideas directly in 3D, and surgeons can practice on virtual organs underneath the screen. So with this tool, this boundary has been broken.
Beyond – Collapsible Tools and Gestures for Computational Design
Since the invention of the personal computer, digital media has remained separate from the physical world, blocked by a rigid screen. We present Beyond, an interface for 3-D design where users can directly manipulate digital media with physically retractable tools and hand gestures. When pushed onto the screen, these tools physically collapse and project themselves onto the screen, letting users perceive as if they were inserting the tools into the digital space beyond the screen. The aim of Beyond is to make the digital 3-D design process straightforward, and more accessible to general users by extending physical affordances to the digital space beyond the computer screen.
SpaceTop: Integrating 2D and Spatial 3D Interactions in a See-through Desktop Environment
WYSIWYF –“what you see is what you feel” :
The digital information reach us instead? I'm sure many of us have had the experience of buying and returning items online. But now you don't have to worry about it. What I got here is an online augmented fitting room. This is a view that you get from head-mounted or see-through display when the system understands the geometry of your body.
ZeroN: Mid-Air Tangible Interaction Enabled by Computer Controlled Magnetic Levitation:
ZeroN, a new tangible interface element that can be levitated and moved freely by computer in a three dimensional space. ZeroN serves as a tangible representation of a 3D coordinate of the virtual world through which users can see, feel, and control computation. To accomplish this we developed a magnetic control system that can levitate and actuate a permanent magnet in a predefined 3D volume. This is combined with an optical tracking and display system that projects images on the levitating object. We present applications that explore this new interaction modality. Users are invited to place or move the ZeroN object just as they can place objects on surfaces. For example, users can place the sun above physical objects to cast digital shadows, or place a planet that will
9. WYSIWYW –“WHAT YOU SEE IS WHAT YOU
WEAR”
Reach into the computer & Grab a Pixel 9
10. PHYSICALLY PIXEL
IN
AIR
How to do ? Act in human
motions and
education or
research
PROGRAMMIN
G THE WORLD
Reach into the computer & Grab a Pixel
10
11. REVIEW, WHAT TECHNOLOGY?
1. BEYOND
2. SPACETOP
3. WHAT YOU CLICK IS WHAT YOU WEAR (WYCIWYW)
4. ZERON
Reach into the computer & Grab a Pixel 11
12. WHAT ARE USED ?
BEYOND
1. PEN [COLLAPSIBLE PEN (TOP) AND SAW (BOTTOM)]
2. HEAD TRACKING CAMERA
3. A TOUCH SCREEN
SPACETOP, WYCIWYW
1. DISPLAY , 22" TRANSPARENT LCD DISPLAYS [1680×1050 PIXELS IMAGES AT 60
HZ WITH 20% LIGHT TRANSMISSION
2. HEAD AND HAND TRACKING WITH DEPTH CAMERAS
Reach into the computer & Grab a Pixel
12
13. ZERON (WHAT ARE USE )
Reach into the computer & Grab a Pixel
13
14. RELATED CONCEPTS
TABLETOP TANGIBLE INTERFACES[ZERON]
2D MANIPULATION OF 3D STEREOSCOPIC IMAGES, 3D
SPATIAL
INTERACTIONS IN EXISTING DESKTOP ENVIRONMENTS
[SPACETOP]
SPACETOP [WYCIWYW]
Reach into the computer & Grab a Pixel
14
15. “
”
DISADVANTAGE OF ALL TOOLS
1. COSTLY
2. SIGNAL USER INTERFACE
3. NOT POTABLE FOR CARRY [WITHOUT BEYOND ]
4. NOT USER FRIENDLY
5. NEED POPPER ENVIRONMENT
6. IT IS A SINGLE USER UI
Reach into the computer & Grab a Pixel
15
16. “
”
“ONLY ONE BOUNDARY LEFT
IT
OUR IMAGINATION”
THANK YOU
Reach into the computer & Grab a Pixel
16
