2. DFKI – German Center of Artificial Intelligence
423 Researchers
Kaiserslautern -
Saarbrücken,
Germany
Research areas
Augmented Vision
Intelligent User Interfaces
Agents and Simulated Reality
Knowledge Management
Language Technology
Robotics Innovation Center
Safe and Secure Cognitive Systems
Innovative Retail Laboratory
Institute for Information Systems
Innovative Factory Systems
3. Department Augmented Vision @ DFKI
• Founded Juli 2008
• 30 fulltime researchers
• 3 strongly connected research Areas
Computer
Vision
HCI and Sensor
Visualization Fusion
4. Future Media GmbH
www.futuremedia-gmbh.com
A spin-off of the Department of Augmented Vision
of the German Research Center for Artificial
Intelligence
15. 3D Reconstruction Dome
• Sandwich hull with 300
integrated LED ledges
inner hull: light strewing
fleece
outer hull: opaque
material
• Funnels for cameras and
projectors
16. 3D Reconstruction Dome
• Anti-glare glass turntable,
Degree of reflection < 1°
• Stepping- /multiphase
motor,
angular resolution > 1
million steps per turn
17. Current work
W. Lehmbruck
Female Torso (1918)
Material : Bronze
Sizes : 670x400x250 mm
Inv-Nr. : PFG 74/13
Photographed using artistic lighting conditions
with multiple light sources
As a loan by:
Museum Pfalzgalerie Kaiserslautern
18. Current work
W. Lehmbruck
Female Torso (1918)
Reconstruction
6
No. points initial : 630·10
No. points final : 22520
No. triangles : 37801
Map-Resolution : 4000 x 4000
Rendered using neutral lighting conditions and a
single light source with Firefox WebGL extension
19. Current work
W. Lehmbruck
Female Torso (1918)
Reconstruction
No. points : 22520
No. triangles : 37801
Map-Resolution : 4000 x 4000
Rendering by A. Kusch
20. Current work
H. Scherer
Little Girl (1924/25)
Material : Stone pine (painted)
Sizes : 760x380x405 mm
Inv-Nr. : P 04/98
Photographed using artistic lighting conditions
As a loan by:
Museum Pfalzgalerie Kaiserslautern
22. 4. Object modeling with Kinect camera
• A 150$ scanning system
– One device
– Free motions
Yan Cui, Didier Stricker, 3D shape scanning with a Kinect
In: ACM Transactions on Graphics (Proc. of SIGGRAPH) 2011. 22
25. 3D body scanning @ home
• Low cost 3D scanning solution for
small shops and even at home!
Full 3D body-scanning with a single Time
of Flight (ToF) or Kinect camera
Automatic extraction of body measures
out of the 3D model
3D shape and appearance (colored 3D
model) of the customer!
• 3D scanning with a single
camera is a unique technology
26. Online configurator - virtual clothes from designs
• Cooperation of designer and
customer
Size adjustment
Design, color and pattern
2D and 3D viewer for interactive design
27. Virtual try-on
• Shopping experience and style selection
Real-time visualization of clothes onto the
body
Natural interaction with the mirror
Saving of snapshots of the prefered clothes –
link to social networks, or send the image per
mail
Online purchase with the correct (measured!)
size and personal design
29. Hypervideos
● Adding informations to objects in videos
● Text, images, hyperlinks etc.
29
30. Challenge: Fast & automatic creation
through robust object tracking
30
31. Technology: Video editor for object tracking
– Load the video
– Select the object(s) to be
tracked
– View the results and eventually
select new objects or do
corrections
– Add the content for the
interactive tags
– Export the results as interactive
videos
32. Technology: Video editor for object tracking
Competitive advantage of the tracker based
on research results at DFKI
• High robustness to appearance
change, occlusion and strong
motions
• The object does not need to
be rigid, i.e. people tracking
34. Deployment: final video
Watch Click Buy Product Web-site
• Tags and meta-data are encoded as video for standard Flash-
players
• Reporting statistics about clicks
