Rong-Hao Liang, Liwei Chan, Hung-Yu Tseng, Han-Chih Kuo, Da-Yuan Huang, De-Nian Yang, and Bing-Yu Chen.
"GaussBricks: Magnetic Building Blocks for Constructive Tangible Interactions on Portable Displays", In Proceedings of ACM CHI 2014, pp.3153--3162.
[CHI 2014 Best Paper Honorable Mention Award]
[CHI 2014 People's Choice Best Talk Award]
Project page: http://graphics.csie.ntu.edu.tw/~howieliang/GaussBricks.html
--
This work describes a novel building block system for tangible interaction design, GaussBricks, which enables real-time constructive tangible interactions on portable displays. Given its simplicity, the mechanical design of the magnetic building blocks facilitates the construction of configurable forms. The form constructed by the magnetic building blocks, which are connected by the magnetic joints, allows users to stably manipulate with various elastic force feedback mechanisms. With an analog Hall-sensor grid mounted to its back, a portable display determines the geometrical configuration and detects various user interactions in real time. This work also introduce several methods to enable shape changing, multi-touch input, and display capabilities in the construction. The proposed building block system enriches how individuals interact with the portable displays physically.
--
Project Gauss: Portable and Occlusion-Free Magnetic Object Tracking Using Analog Hall-Sensor Grid http://www.cmlab.csie.ntu.edu.tw/~howieliang/HCIProjects/projectGauss.html
Ensuring Technical Readiness For Copilot in Microsoft 365
ACM CHI 2014 - GaussBricks: Magnetic Building Blocks for Constructive Tangible Interactions on Portable Displays
1. GaussBricks:
Magnetic Building Blocks for Constructive Tangible Interactions on Portable Displays
Rong-Hao Liang, Liwei Chan, Hung-Yu Tseng, Han-Chih Kuo, Da-Yuan Huang,
De-Nian Yang, and Bing-Yu Chen
National Taiwan University & Academia Sinica
10. Passive blocks - Cameras
DuploTrack [Gupta et. al. UIST ’12](b)
dels authored using our system.
(a) Baseline interface
Figure 7: Photographs of the
test in the user study. The Bas
views of the model. In the Tr
Redmond, WA, USA
mcohen@microsoft.com
1: System setup. The user builds the model in the
rea and uses the Add/Remove/Recheck boxes to interact
he system. The Kinect R
looks down from the right and
the captured video/depth stream to our system to track
odel and infer the assembly process in realtime. Visual
17. Hardware
2D
TUI Design Space of Portable Displays
Token+Surface Constructive
Assembly
Optical
Cameras
3D
OpticalTags
Optical tracking is occlusion-sensitive
18. Hardware
2D
TUI Design Space of Portable Displays
Token+Surface Constructive
Assembly
3D
Capacitive tracking cannot effectively support
form construction
Capacitance
Tags
Capacitive
Multitouch
Display
CapStones
Optical
Cameras
OpticalTags
[Chan et. al. CHI’12]
19. Hardware
2D
TUI Design Space of Portable Displays
Token+Surface Constructive
Assembly
3D
Capacitance
Tags
Capacitive
Multitouch
Display
CapStones
Optical
Cameras
OpticalTags
[Chan et. al. CHI’12]
New Materials and Techniques are Needed
23. Hardware
2D
TUI Design Space of Portable Displays
Token+Surface Constructive
Assembly
3D
Capacitance
Tags
Capacitive
Multitouch
Display
CapStones
Optical Cameras OpticalTags
[Chan et. al. CHI’12]
Attachable
Hall-Sensor Grid
[Liang et al. UIST’12]
GaussSense GaussBits
Magnetic
Tangible Bits
[Liang et al. CHI’13]
Near-Surface
3D
Portable and Occlusion-Free Interaction Design
On and Above Portable Displays
A technique and material that support
24. A technique and material that
Feasible for Designing Building Blocks by Magnets?
Hardware
2D
TUI Design Space of Portable Displays
Token+Surface Constructive
Assembly
3D
Capacitance
Tags
Capacitive
Multitouch
Display
CapStones
Optical Cameras OpticalTags
[Chan et. al. CHI’12]
Attachable
Hall-Sensor Grid
[Liang et al. UIST’12]
GaussSense GaussBits
Magnetic
Tangible Bits
[Liang et al. CHI’13]
Near-Surface
3D
27. Challenge on Sensing
Magnet
Analog Hall-Sensor Grid
The distribution of magnetic field may differ from
the shape of magnetic sculpture
Resulting
Magnetic Field Distribution
28. Analog Hall-Sensor Grid
Magnet attracting each other also counteract each other
Challenge on Sensing
The distribution of magnetic field may differ from
the shape of magnetic sculpture
29. 4
Analog Hall-Sensor Grid
Magnet attracting each other also counteract each other
Challenge on Sensing
The distribution of magnetic field may differ from
the shape of magnetic sculpture
30. Analog Hall-Sensor Grid
Magnet attracting each other also counteract each other
Challenge
The distribution of magnetic field may differ from
the shape of magnetic sculpture
82. Hardware
2D
TUI Design Space of Portable Displays
Token+Surface Constructive
Assembly
Capacitance
Tags
Capacitive
Multitouch
Display
Attachable
Hall-Sensor Grid
[Liang et al. UIST’12]
GaussSense GaussBits
Magnetic
Tangible Bits
[Liang et al. CHI’13]
Near-Surface
3D
Conclusion
83. Hardware
2D
TUI Design Space of Portable Displays
Token+Surface Constructive
Assembly
Capacitance
Tags
Capacitive
Multitouch
Display
CapStones
[Chan et. al. CHI’12]
Attachable
Hall-Sensor Grid
[Liang et al. UIST’12]
GaussSense GaussBits
Magnetic
Tangible Bits
[Liang et al. CHI’13]
Near-Surface
3D GaussBricks
Magnetic
Building Blocks
Magnetic Building Blocks for Supporting
Constructive Tangible Interactions on Portable Displays
93. 2. Make the Bricks: Vector graphics of GaussBricks are
Available Online for Free Download!
Project Gauss Website:
GaussBricks
Magnetic
Building Blocks
94. 2. Make the Bricks: Vector graphics of GaussBricks are
Available Online for Free Download!
Project Gauss Website:
GaussBricks
Magnetic
Building Blocks
95. 2. Make the Bricks: Vector graphics of GaussBricks are
Available Online for Free Download!
Project Gauss Website:
GaussBricks
Magnetic
Building Blocks
96. 2. Make the Bricks: Vector graphics of GaussBricks are
Available Online for Free Download!
Project Gauss Website:
GaussBricks
Magnetic
Building Blocks
97. 2. Make the Bricks: Vector graphics of GaussBricks are
Available Online for Free Download!
Project Gauss Website:
GaussBricks
Magnetic
Building Blocks
98. 1. Get the Sensor
2. Make the Bricks
3. Develop the Apps
Software Toolkits & Applications Examples
Online in 1 week
CALL FOR 3 ACTIONS
Project Gauss Website:
GaussBricks
Magnetic
Building Blocks
visit our interactivity booth to give a try
99. 1. Get the Sensor
2. Make the Bricks
3. Develop the Apps
CALL FOR 3 ACTIONS
Project Gauss Website:
GaussBricks
Magnetic
Building Blocks
100. GaussBricks:
Magnetic Building Blocks for Constructive Tangible Interactions on Portable Displays
Rong-Hao Liang, Liwei Chan, Hung-Yu Tseng, Han-Chih Kuo, Da-Yuan Huang,
De-Nian Yang, and Bing-Yu Chen
National Taiwan University & Academia Sinica
Project Gauss Website:
Thanks for your attention!
- Q & A-