A talk from the Main Stage at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Phil LaFond (Bosch Automotive Service Solutions Inc.): Bosch Technical Training Supported by AR Learn how Bosch is using Augmented Reality to facilitate technical training. https://awexr.com

1. BOSCH TECHNICAL TRAININGS SUPPORTED BY
AUGMENTED REALITY
AWE USA, 29. MAY. 2019
PHIL LAFOND

2. Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
2
Your speaker
Phil LaFond
North America Technical Lead – Augmented Reality
Bosch Automotive Service Solutions Inc.
Experience:
Automobile Technician
Precision Tune Auto Care Franchisee
Advanced Automobile Electronics Trainer
Welcome

3. Training with AR
Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
3
Hybrid system
Hybrid system
Range extender
EV cars

4. Training with AR
Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
4
Radar and camera systems

5. Training with AR
Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
5
Network
Front-view camera
ECU
Belt retracting
arrangement left
Airbag ECU
Electric fuel
pump
Belt retracting
arrangement
right
Gear shift selector
lever ECU
Automatic
transmission ECU
ABS/ESP ECU
Lane-change
Assist ECU
All-wheel drive
ECU
Adaptive
damping ECU
Active suspension
ECU
Seat ECU Driver
Seat ECU Co-
passenger
Trailer ECU
Tire inflation
pressure check
ECU
Multi-function
switch
Reversing
camera ECU
Air conditioning
system ECU
Passenger
compartment mirror
Sliding roof
control unit
Central electronics 2, REM
Telecommunicati
ons-ECU
Audio
amplifier**
Radio-
Infotainment
unit*
Parking-assist
Tailgate lift
TV Tuner
DVD changer
Instrument
cluster
Structure-borne
noise ECU
MOST
Steering Assist
ECU
PT-CAN 2
K-CAN
Ethernet D-CAN
K-CAN 2
**K-CAN 2-linkage depending on equipping
version
Special vehicle
ECU ***
ACC Control unit
*MOST-and Ethernet-linkage depending on equipping
version
LIN
Engine
Control unit
Central electronics 1, FEM with Gateway
OBD-Port
Central electronics 1, FEM with Gateway
FlexRay

6. Training with AR
Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
6
Workshops

7. Training with AR
Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
7
Training Center
2017 = 1833 trainings – 14.287 trainees

8. Training with AR
Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
8
Training 4.0

9. Training 4.0 Solution
Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
9
Overview
„ Why:
„ New complex vehicle technologies,
‒ e.g. electric vehicles, heavy duty vehicles, Advanced Driver Assistance
Systems (ADAS) and autonomous driving
„ require new methods to meet the information needs of the
workshop operator.
„ AR added to conventional training techniques
‒ provides all the knowledge needed
„ What:
„ New Training 4.0 solution with Bosch CAP
„ CAP Video: https://www.youtube.com/watch?v=gefW8EC-ZCc
„ New training methods integrating Augmented Reality, workshop employees trained for complex systems.
„ The training can be performed on physical or virtual vehicles / components

10. Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
10
„ How:
„ "Trainer Mode"
‒ trainer controls the training devices of the trainees
‒ decides what use cases they see on their devices
‒ trainer actions are transferred to trainee’s user equipment
‒ viewing angle remains individual for each participant
‒ All participants of the group actively follow the explanations of the
trainer and experience the training situation together
„ "Trainee Mode”
‒ trainer switches to the trainee’s device
‒ give direct hints and tips for topic
Training 4.0 Solution
Overview

11. Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
11
T1
T Trainees
HoloLens
«Moderator»
HoloLens
«Attendee»
Training 4.0 Solution - HoloLens or Tablet 1/2
“Trainer controlled”
T2
M Trainer
DTC
DTC
DTC
Control
Control
Physical or augmented
vehicle(s) / object(s)
- on-site or remote locations
M

12. Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
12
T1
T2
T Trainees
HoloLens
Standalone
HoloLens
Standalone
Training 4.0 Solution - HoloLens or Tablet 2/2
“Free exploration by trainee”
T3
M
M Trainer
1 or multiple
physical or
augmented
DTC
DTC
DTC
“Private”
Session

13. CAP Training 4.0 Solution
Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
13
AR Platform high-level overview
Publish
Contextua
lize
Workflow
CAP AR Authoring
Tools
Authors
Viewer (Apps)
Server – Online / Cached - local
Authentication Layer
Data Package N
Data Package 1
Deployment Server
CAP Runtime Server
CAP AR Clients
For iOS, Android, Win, HL
Tablet, Smartphone, HoloLens,

14. Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
Deployment Server
Authoring Delivery CAP training client
AR Content
Provider
AR Content
Training Content
Provider
Training Content
MetaData
Authoring Server (Authoring CMS)
AR PubEng
SI Pub Eng. AR Contentlinked
Training Content
AR Content +
Training
Modules
AR ContentTraining
Content
XML Editor AR 3D Editor AR Tracking
Editor
AR mapping
linked
linked
fetch
fetch
publish
14
Icons
Training
Information
Architecture of AR platform
3D CAD
Target
Image
CAD
Reference
2D
3D
A
u
t
h
e
n
t
i
c
a
t
i
o
n
CAP AR - Training Solution
Core Features (authentication, etc.)
Session control

15. Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
15
Building blocks
Consultancy SW Licenses Authoring Services and Training Integration and Implementation
Services
• Requirements definition
• Solutions scale and setup
definition
• License package for
authoring system, runtime
system and clients
• Content creation
• Publication / Encapsulation
services
• Solution integration (e.g. in
larger environment)
• What do customers need ?
• Best solution approach ?
• Rollout plan ?
• Corresponding maintenance
and support contract
• Authoring training to enable
customer
• Authoring support to
continuously help customer
authors
• Feature implementation (e.g.
custom features)
Training 4.0 Solution
Applicable for:
- Sales training
- Technician Training
- Production Training

16. Automotive Service Solutions | AA-AS - LaFond | 2019-05-29
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
16
Overview – Benefits
„ Modern training methods in the workshop environment to train more complex systems
„ Building knowledge is associated with high costs and time, therefore knowledge retention is important à Higher knowledge retention
„ As a supplement to classic training for more complex system which e.g. need to be disassembled
„ Interactive learning method
„ Disassembled view à non-destructive via AR
„ Reduce cut models à no engine/parts need to be destroyed à save money
„ Information at the right time at the right place
„ Increase quality of training
„ Reduce cost by limiting traveling
„ Reduced effort to create training modules using CAP Augmented Reality Platform for authoring and publishing
„ CAP AR client available for iOS, Android, Windows and HoloLens
„ authored content (single source) can be viewed across devices and operating systems
Training 4.0 Solution

17. Automotive Service Solutions | AA-AS/SVW-Wagner | 2018-10-18
© Bosch Automotive Service Solutions GmbH 2018. All rights reserved, also regarding any disposal, exploitation, reproduction, editing, distribution, as well as in the event of applications for industrial property rights.
17
THANK
YOU
WHAT DRIVES YOU, DRIVES US!