Virtual reality (VR) and augmented reality (AR) techniques can be used in various ways in the field of handicraft. VR allows for virtual prototyping and training, while AR enables in-context presentations and comparing targets to actual states. As 3D planning and data availability increases, VR/AR will see more use for collaboration, documentation, and guiding workers. While some applications are established, many opportunities still require overcoming entry barriers and further technical development. Overall, VR/AR offer potential benefits but also challenges for handicraft industries.
2. Planning, Consulting, Sales VR/AR as a working toolVirtual Techniques
What are virtual techniques?
Virtual Reality (VR) is a computer-generated,
interactive, three-dimensional environment which
simulates a realistic and immersive lifelike experience
In VR, the screen acts like the frame of a
windowpane, in front of which we move. The
perspective is dependent on the viewpoint, objects
Virtual techniques
perspective is dependent on the viewpoint, objects
can even emerge.
Augmented Reality (AR) is the superposition of the
natural viewpoint with computer-generated
information
Content matching the view
Purpose: better understanding of 3D-aspects, better
interaction
2
3. Planning, Consulting, Sales VR/AR as a working toolVirtual Techniques
Virtual techniques in the field of handicraft
Topic overview
Planning,
Consulting, Sales
Planning & Construction
3D-Presentation
Digital showroom
In-Context-Presentations
Virtual techniques
3
Virtual techniques
Handicraft
Virtual prototyping
VR/AR as a
working tool
AR for X-ray function
AR for target/performance comparison
Virtual guidebook
Training
Virtual mobile techniques
3D-Detection
4. Planning, Consulting, Sales VR/AR as a working toolVirtual Techniques
Planning and Construction
Digital draft of the project at the
computer
3D-visualization for coordination with
customers, trades
Early error correction in the digital world
Generation of the basics for
Planning, Consulting, Sales
Generation of the basics for
manufacturing
4
Image: PaletteCAD
Room planning
with PaletteCAD
Image: Human Solutions
CAD Assyst:
Pattern development for
dress. Then takeover of
the pattern data for
visualization. 2D-changes
are carried into 3D.
5. Planning, Consulting, Sales VR/AR as a working toolVirtual Techniques
3D-Presentation
Presentation of products and variants
Interactive 3D view
Perspective freely selectable
Compilations and configurations
In order to:
Development of a customized product
Image: Wurzel-Medien
Design-Visualisation for
Normbau
Planning, Consulting, Sales
Development of a customized product
Development only of technically possible/
available orders
Applications for print, web, sales support in the
store
5
Image: LumoGraphics
3D-elevator-configurator:
selection screens
image: MieleImage: LumoGraphics
Summerhouse-
configurator
for Karibu
6. Planning, Consulting, Sales VR/AR as a working toolVirtual Techniques
3D-Presentations
Planning, Consulting, Sales
Decor-variants
Image: Wurzel-Medien
Presentation of different,
digitally generated variants in
the printed catalogue
25.06.2018 6
7. Planning, Consulting, Sales VR/AR as a working toolVirtual Techniques
Trade concept:
Have a small amount of products in stock in
the store
Customer is advised, configures and orders
online
Interactive presentation of the product, secure
Digital showroom (1/2)
Image: DS 3DXcite
Audi Digital Showroom
in London
Planning, Consulting, Sales
Interactive presentation of the product, secure
common understanding, displaying variants in
a simple way, displaying virtual product during
operation
Display of changing static or dynamic content
on digital ads in the store or outside (such as
airports)
Extension of the attention span with
autostereoscopic 3D-displays
7
Image: DS 3DXcite
3D-Visualisation
Shoe collection
Adidas by DS 3DXcite
Image: NIKE
Application of
autostereoscopic display
Tridelity in the
NIKE-flagship-store
8. Planning, Consulting, Sales VR/AR as a working toolVirtual Techniques
Digital showroom (2/2)
AR-installations e.g. in use at Toys“R“Us
Animated LEGO-model is displayed on the
sales packaging
Customer puts model in the desired
perspective
Virtual fitting of clothes and shoes with AR is
Image: metaio
Interactive LEGO-Box
at Toys‘R‘Us: application of
Augmented Reality
Planning, Consulting, Sales
Virtual fitting of clothes and shoes with AR is
content of research projects
Usage of virtual mirrors
8
Image: Cisco
Augmented Reality:
vision „Magic Mirror“
Image: DS 3DXcite
Screen in
shop-context
9. Planning, Consulting, Sales VR/AR as a working toolVirtual Techniques
In-Context-Presentations (1/3)
Idea:
Displaying the product or
the project in its future
environment using AR
Customer can get a better
idea about the
implementation
AR:
Print and display
marker;
photograph,
augment and
evaluate scene
Planning, Consulting, Sales
implementation
Checking feasibility, size,
colors,…
More reliable purchase
decision
More satisfied customer
Safer planning
9
Projection of a
construction
project at
construction site
(Fh-IGD)Image: Fraunhofer IGD
Image: Palette CAD
AR:
Interior design: new
furniture in existing
housing
10. Planning, Consulting, Sales VR/AR as a working toolVirtual Techniques
In-Context-Presentations (2/3)
Planning, Consulting, Sales
Urban planning:
planned redesign of the
church forecourt as a
graphical overlay with the
view of the real building
10
11. Planning, Consulting, Sales VR/AR as a working toolVirtual Techniques
In-Context-Presentations (3/3)
Planning, Consulting, Sales
Urban planning:
Initial situation church
forecourt
11
12. Planning, Consulting, Sales VR/AR as a working toolVirtual Techniques
Virtual prototyping (1/3)
Equipping of a customer with samples or test
pieces of goods
Assessment and decision
Idea:
Dicision making in virtual environment
But: haptic properties can not be digitally
Image: Audi
Audi City London:
material samples
complement
3D-visualisation
Planning, Consulting, Sales
But: haptic properties can not be digitally
represented -> real samples
12
Sketch architecture,
inspection in VR
Image: Visenso
Image: Fh-IAO
Conference room
extension:
parquet, illumination,
furniture, arrangement
13. Planning, Consulting, Sales VR/AR as a working toolVirtual Techniques
Examples
Interior design
Bathroom planning
Similar: aircraft cabin
Virtual inspection of a
Virtual prototyping (2/3)
Planning, Consulting, Sales
Image: Immersight
Image: Inreal
Virtual inspection of a
bathroom with
6D-tracked HMD
Virtual inspection of a
house
13
Hardware-set up for the virtual house
inspection with Inreal: further persons
(such as spouse) can follow the scene on
the screen.
14. Planning, Consulting, Sales VR/AR as a working toolVirtual Techniques
Virtual prototyping (3/3)
Planning, Consulting, Sales
Image: Miele
Angled projection
walls at Miele:
displaying the
interior design
with products
14
15. Planning, Consulting, Sales VR/AR as a working toolVirtual Techniques
Virtual techniques as a working tool
„X-ray function“ with AR:
superposition of the perspective with non-
visible elements, e.g. technical infrastructure
Requirement: digital model of the
infrastructure
Target/ performance comparison with AR (1):
superposition of real component or existing
Display of the installed
cables under plaster
(Fraunhofer IGD)
VR/AR as a working tool
superposition of real component or existing
geometry with 3D-planning/ construction ->
collisons?
Target/ performance comparison with AR (2):
superposition of actual state with target
planning
o quality control
o project controlling
15
CAD-model overlaps
the physical prototype
(metaio)
Checking the set
welding studs: realised
as planned? (metaio)
16. Planning, Consulting, Sales VR/AR as a working toolVirtual Techniques
Virtual techniques as a working tool – Virtual guidebook
Knowledge transfer via 3D environments
for example:
Position knowledge: Where is what?
Structural knowledge: How is something
related?
Behavioral knowledge: How should I behave?
Image: ESI
Assembly demonstration
with 3D-human model
VR/AR as a working tool
Behavioral knowledge: How should I behave?
How does the system behave?
Procedure knowledge: What do you have to
do to make something happen?
16
Working according to a
digital guidebook at
Daimler
Trucks in BrühlImage: Daimler
Instructions in interactive
environmentimage: xxxImage: Altran/Industriehansa
17. Planning, Consulting, Sales VR/AR as a working toolVirtual Techniques
Virtual techniques as a working tool – Training (1/2)
In case of non-availabilty of site/
plant/ device
Also in advance
Harmless (for human and machine)
Possibly less expensive
Contents:
Coating trainer
SimSprayImage: SimSpray
VR/AR as a working tool
Contents:
Process knowledge (e.g. risk of
damage)
St. Gobain-construction site-
simulator:
https://www.youtube.com/watch?v=TDeRT
T-Xl3Q
Application of technical systems
(paint spray gun, glue gun,
plaster gun, …)
17
Image: St. Gobain
Image: St. Gobain
Interactive
construction site training
Training environment
for plastering
18. Planning, Consulting, Sales VR/AR as a working toolVirtual Techniques
Virtual techniques as a working tool – Training (2/2)
Plastering trainer by St. Gobain
https://www.youtube.com/watch?v=FEnalzHVmdI
VR/AR as a working tool
18
19. Planning, Consulting, Sales VR/AR as a working toolVirtual Techniques
Virtual mobile techniques (1/2)
Craftsman: interconnected information
sink and source
Teleservice/ Tele-Operations:
Craftsman shares his perspective (camera)
with service
Service provides hints and can locate them
(display with AR)
Augmented Reality
image: xxxImage: itizzimo
Information
Analysis
Instructions
Assistance
Communication
possiblity
Service support with AR:
Service preserves the
VR/AR as a working tool
(display with AR)
Location-sensitive annotations,
instructions, work steps, ...
Recording (digitisation) of new knowledge
through mobile devices (camera recording,
sensor data acquisition, etc.); filing for
documentation and sharing with others
(such as knowledge management systems
and social media)
19
Image: Re‘flekt
Service preserves the
craftsman's perspective
and his problem
definition.
Craftsman receives
instructions from the
service with local
assignment
Image: Volkswagen
AR-based, mobile
workshop information
system
20. Planning, Consulting, Sales VR/AR as a working toolVirtual Techniques
Virtual mobile techniques (2/2)
Micosoft vision of HoloLens
VR/AR as a working tool
20
21. Planning, Consulting, Sales VR/AR as a working toolVirtual Techniques
3D-Detection
Depth imaging sensor:
create an image in which each image
point has a depth value
Cost effective alternative to
3D-laser scanning in inventory check,
but with limitations in operation range
and precision
Google Tango on YouTube: 3D-digitalised staircase
https://www.youtube.com/watch?v=Qe10ExwzCqk
VR/AR as a working tool
and precision
Idea:
Usage for documentation,
e.g. making digital 3D-revision plans
21
Primesense
PMD
Leap
Asus
Softkinetics
Sony
22. Planning, Consulting, Sales VR/AR as a working toolVirtual Techniques
Summary
3D-Planning, 3D-Construction and 3D-Presentation are state of the art and
applicable
A lot of things are still a long way off
There are still some entry barriers (availability of 3D-data etc.)
But: there are also drivers for digitization
Virtual techniques Planning, Consulting, Sales VR/AR as a working tool
But: there are also drivers for digitization
Availability of 3D-data will increase continuously
Cooperation in trades will require digital cooperation
Documentation requirements will promote digitization
Compulsory tender process will promote digitization (e.g. BIM)
Further development of technical devices (data glasses, smartphones,...)
22