Conference: 1st International Conference on Industrial Cyber-Physical Systems (ICPS-2018). Saint-Petersburg, RUSSIA – MAY 15-18, 2018 Title of the paper: Towards the Deployment of Cloud Robotics at Factory Shop Floors: a Prototype for Smart Material Handling Authors: Ali Hussnain, Borja Ramis Ferrer, Jose L. Martinez Lastra.

1. Towards the Deployment of Cloud Robotics at
Factory Shop Floors: a Prototype for Smart
Material Handling
Date: MAY, 2018
Contact information
Tampere University of Technology,
FAST Laboratory,
P.O. Box 600,
FIN-33101 Tampere,
Finland
Email: fast@tut.fi
www.tut.fi/fast
Conference: 1st International
Conference on Industrial Cyber-Physical
Systems (ICPS-2018). Saint-Petersburg,
RUSSIA – MAY 15-18, 2018
Title of the paper: Towards the
Deployment of Cloud Robotics at
Factory Shop Floors: a Prototype for
Smart Material Handling
Authors: Ali Hussnain, Borja Ramis
Ferrer, Jose L. Martinez Lastra.
If you would like to receive a reprint of
the original paper, please contact us

2. Towards the Deployment of Cloud
Robotics at Factory Shop Floors: a
Prototype for Smart Material
Handling
Ali Hussnain, Borja Ramis Ferrer, Jose L. Martinez Lastra
ali.Hussnain@student.tut.fi, {borja.ramisferrer, jose.lastra}@tut.fi
Tampere University of Technology, Tampere, Finland
1st International Conference on Industrial Cyber-Physical Systems (ICPS-
2018). Saint-Petersburg, RUSSIA – MAY 15-18, 2018

3. Outline
Towards the Deployment of Cloud Robotics at
Factory Shop Floors: a Prototype for Smart Material
Handling
3
• Introduction
• Objectives
• Cloud Computing
• Cloud Robotics
• Problem Statement
• The approach
• Technologies
• Study Case
• Conclusions and further work

4. Towards the Deployment of Cloud Robotics at
Factory Shop Floors: a Prototype for Smart Material
Handling
4
Introduction
• Industry 4.0 and Cyber-Physical Systems (CPS)
• Cloud Computing from Cyber World can be integrated to
Physical World for enhancing the capabilities of systems
on industrial shop floor.

5. Towards the Deployment of Cloud Robotics at
Factory Shop Floors: a Prototype for Smart Material
Handling
5
Objectives
• The ultimate objective of this research work is to
implement Cloud Robotics in order to develop a basic
system for smart material handling.
• As a requirement, cloud based image processing tools
and embedded hardware for material handling must be
integrated

6. Background: Cloud Computing (1/2)
Towards the Deployment of Cloud Robotics at
Factory Shop Floors: a Prototype for Smart Material
Handling
6
Source: Eurostat – http://ec.europa.eu/eurostat/statistics-explained/
index.php/Cloud_computing_-_statistics_on_the_use_by_enterprises

7. Background: Cloud Computing (2/2)
• Provide remote resources which can be
called upon through proper communication
channels.
• Storage, Complex Algorithms, …
• Applications
– Image processing, voice recognition and data
handling
Towards the Deployment of Cloud Robotics at
Factory Shop Floors: a Prototype for Smart Material
Handling
7

8. Background: Cloud Robotics (1/3)
• Mentioned by J.J. Kuffner in 2010
• Robots are restricted to perform in real
environments
• Limited amount of processing, storage, and
programming capabilities
Towards the Deployment of Cloud Robotics at
Factory Shop Floors: a Prototype for Smart Material
Handling
8

9. Background: Cloud Robotics (2/3)
• Platform of networked robots can utilize
parallel processing powers and share their
knowledge with a network of robots.
• Resources are not physically situated with
the robot but can be requested
Towards the Deployment of Cloud Robotics at
Factory Shop Floors: a Prototype for Smart Material
Handling
9

10. Background: Cloud Robotics (3/3)
• Minimum onboard hardware needed for
processing
• Longer battery life
• Knowledge sharing… “Different bodies
common minds”
• Same cloud resource can be used by multiple
robots.
Towards the Deployment of Cloud Robotics at
Factory Shop Floors: a Prototype for Smart Material
Handling
10

11. Problem Statement (1/3)
Towards the Deployment of Cloud Robotics at
Factory Shop Floors: a Prototype for Smart Material
Handling
11
? ? ? ? ?
Context

12. Problem Statement (2/3)
• Context identification crucial for material
handling and flow.
• Context maybe its name, color ,weight etc.
anything describe the item.
• Efficient material handling is important for
overall productivity of modern industries
Towards the Deployment of Cloud Robotics at
Factory Shop Floors: a Prototype for Smart Material
Handling
12

13. Problem Statement (3/3)
• QR Codes
• Barcode
• RFID
• Manual handling
• Need to be designed and printed additionally.
• Items in ware houses are needed to be
sorted before placing at the right position.
Towards the Deployment of Cloud Robotics at
Factory Shop Floors: a Prototype for Smart Material
Handling
13
Current
scenarios

14. Approach (1/3)
• Acquire picture of item through camera
• Use cloud image processing tools for image
analysis
• Acquire Label (text) out of the picture
• Use context (label) for making decision
regarding material handling.
Towards the Deployment of Cloud Robotics at
Factory Shop Floors: a Prototype for Smart Material
Handling
14

15. Approach (2/3)
• Components
Towards the Deployment of Cloud Robotics at
Factory Shop Floors: a Prototype for Smart Material
Handling
15

16. Approach (3/3)
• Mapping agent responsible for mapping the
context of items in area
• Supervisory agent responsible for
communication between devices and storing
the information of items on pallet
• Lifter agent responsible for bringing desired
product to user
• Web Interface permits users to request
mapping and retrieve items
Towards the Deployment of Cloud Robotics at
Factory Shop Floors: a Prototype for Smart Material
Handling
16

17. Towards the Deployment of Cloud Robotics at
Factory Shop Floors: a Prototype for Smart Material
Handling
17
Technologies
• NodeJS and ExpressJS for communication
developments in agents
• Python for picture acquisition and interaction with Google
Cloud Vision API
• Google Cloud Vison API for cloud image processing

18. Study Case (1/6)
• Two LEGO robots with Raspberry Pi
Controller
– One Robot with Pi cam is operated by
mapping agent
– Supervisory agent is a computer but also can
be embedded hardware
Towards the Deployment of Cloud Robotics at
Factory Shop Floors: a Prototype for Smart Material
Handling
18

19. Study Case (1/6)
• Two LEGO robots with Raspberry Pi
Controller
Towards the Deployment of Cloud Robotics at
Factory Shop Floors: a Prototype for Smart Material
Handling
19

20. Study Case (2/6)
• Web interface for communicating and
instruction to system component.
Towards the Deployment of Cloud Robotics at
Factory Shop Floors: a Prototype for Smart Material
Handling
20

21. Study Case (3/6)
• Google Cloud Vision API for image
processing
• Works on Representational State Transfer
(REST) architectural style
• Secure, Credential for each user
• Efficient processing
Towards the Deployment of Cloud Robotics at
Factory Shop Floors: a Prototype for Smart Material
Handling
21

22. Study Case (4/6)
Towards the Deployment of Cloud Robotics at
Factory Shop Floors: a Prototype for Smart Material
Handling
22
PA PB
PC PD
PE
PJ PI
PH PG
PF
Mapping
Robot
Lifter
Robot
Scenario
1
2

23. Study Case (5/6)
• User select map area option
• Mapping agent in robot map the all pallets in
the area
• Acquire image and process it in cloud for
labels, store with supervisory agent
• User input product required in interface
• Lifter agent in robot pic the product for user
Towards the Deployment of Cloud Robotics at
Factory Shop Floors: a Prototype for Smart Material
Handling
23

24. Study Case (6/6)
Towards the Deployment of Cloud Robotics at
Factory Shop Floors: a Prototype for Smart Material
Handling
24

25. Towards the Deployment of Cloud Robotics at
Factory Shop Floors: a Prototype for Smart Material
Handling
25
Conclusions and further work
• This work presents an approach for smart material
handling using the concept of Cloud Robotics
• Minimum onboard resources required, cloud image
processing
• Google Cloud Vison API can be used by multiple robots
in field
• Further, the approach will be implemented in an
industrial scenario for enhancing the flexibility of
manufacturing systems. This will be in the scope of using
cloud image processing tools for context awareness in
manufacturing industry

26. Acknowledge
The research leading to these results has received funding from the European
Union’s Horizon 2020 research and innovation program under grant agreement
n 636909, correspondent to the project shortly entitled C2NET, Cloud
Collaborative Manufacturing Networks .

27. Towards the Deployment of Cloud Robotics at
Factory Shop Floors: a Prototype for Smart Material
Handling
27
THANK YOU!
Any questions?
http://www.youtube.com/user/fastlaboratory
https://www.facebook.com/fast.laboratory
http://www.slideshare.net/fastlaboratory