SlideShare une entreprise Scribd logo
1  sur  14
Télécharger pour lire hors ligne
Jürgen ’Juxi’ Leitner
          S. Harding, M. Frank, A. Förster, J. Schmidhuber

          istituto dalle molle di studi sull’intelligenza artificiale
                                 università della svizzera italiana
                                                   idsia / usi / supsi




              transferring
        spatial perception
between robots operating
   in a shared workspace
                                                         #iros 2012
our iCub
 setup is for
manipulation
visual perception




Harding et al., GPTP 2012, Leitner et al., ICDL 2012   IROS 2012
current
localisation approaches
learning
    approach


+
transferring
spatial perception
COLLISIONS ARE
         BAD
MoBeE
framework
            Frank et al., ICINCO, 2012.
MoBeE
framework
            Frank et al., ICINCO, 2012.
9DOF              bounding box
                                  iCub               6 per eye
                                                        .
                                                        .
                                                        .




                                         fully connected
                                              .
                                              .
                                              .




                                         fully connected




                                           Cartesian
                                          Coordinates
            spatial perception
neural network
600                                                       400                                                        -200
             550                                                       300                                                        -300

             500                                                       200                                                        -400

             450                                                       100                                                        -500
                                                                         0                                                        -600
             400




                                                              Y (mm)
    X (mm)




                                                                                                                         Z (mm)
                                                                       -100                                                       -700
             350
                                                                       -200                                                       -800
             300
                                                                       -300                                                       -900
             250
                                                                       -400                                                  -1000
             200
                                                                       -500                                                  -1100
             150                                                       -600                               Predicted          -1200
                                                                                                          Expected
             100                                                       -700                                                  -1300
                   0   200    400      600      800    1000                   0   200   400       600    800      1000                   0
                                Sample Index                                              Sample Index
         -200
         -300
         -400
         -500
         -600
Z (mm)




         -700
         -800


    -1000
         -900
                                                                                                   results
                                                                                                     ANN
    -1100
    -1200
    -1300
                   0   200   400      600      800    1000
                               Sample Index
spatial perception
neural network
future
 work

 unsupervised learning
 different spatial representations
 “intrinsic motivation” learning
 online, continuous learning
 eye-hand coordination
thanks
                                           for listening
       juxi@idsia.ch   http://Juxi.net/projects
video at http://Juxi.net/projects/im-clever/year3.html

Contenu connexe

Similaire à Transferring Spatial Perception Between Robots Operating In A Shared Workspace

Canopy management tree training & crop loading – opportunities to learn fro...
Canopy management   tree training & crop loading – opportunities to learn fro...Canopy management   tree training & crop loading – opportunities to learn fro...
Canopy management tree training & crop loading – opportunities to learn fro...
MacadamiaSociety
 
L&t%20 investor%20presentation%20 %20feb%202013
L&t%20 investor%20presentation%20 %20feb%202013L&t%20 investor%20presentation%20 %20feb%202013
L&t%20 investor%20presentation%20 %20feb%202013
Vikram Pushparaj
 

Similaire à Transferring Spatial Perception Between Robots Operating In A Shared Workspace (14)

Data generation for Waterfall Diagram
Data generation for Waterfall DiagramData generation for Waterfall Diagram
Data generation for Waterfall Diagram
 
Sl&Et Automation Eng
Sl&Et Automation EngSl&Et Automation Eng
Sl&Et Automation Eng
 
10,00 Modelling and analysis of geophysical data using geostatistics and mach...
10,00 Modelling and analysis of geophysical data using geostatistics and mach...10,00 Modelling and analysis of geophysical data using geostatistics and mach...
10,00 Modelling and analysis of geophysical data using geostatistics and mach...
 
Sabrina Skinner
Sabrina SkinnerSabrina Skinner
Sabrina Skinner
 
Kjøkken 4
Kjøkken 4Kjøkken 4
Kjøkken 4
 
Kjøkken 4
Kjøkken 4Kjøkken 4
Kjøkken 4
 
Kjøkken 3
Kjøkken 3Kjøkken 3
Kjøkken 3
 
Kjøkken 2
Kjøkken 2Kjøkken 2
Kjøkken 2
 
Kjøkken 2
Kjøkken 2Kjøkken 2
Kjøkken 2
 
Objective Capital Precious Metals, Diamonds and Gemstones Investment Summit: ...
Objective Capital Precious Metals, Diamonds and Gemstones Investment Summit: ...Objective Capital Precious Metals, Diamonds and Gemstones Investment Summit: ...
Objective Capital Precious Metals, Diamonds and Gemstones Investment Summit: ...
 
Canopy management tree training & crop loading – opportunities to learn fro...
Canopy management   tree training & crop loading – opportunities to learn fro...Canopy management   tree training & crop loading – opportunities to learn fro...
Canopy management tree training & crop loading – opportunities to learn fro...
 
L&t%20 investor%20presentation%20 %20feb%202013
L&t%20 investor%20presentation%20 %20feb%202013L&t%20 investor%20presentation%20 %20feb%202013
L&t%20 investor%20presentation%20 %20feb%202013
 
Mathur
MathurMathur
Mathur
 
Towards a Sustainable Cocoa Economy:Rural transformation of West African coco...
Towards a Sustainable Cocoa Economy:Rural transformation of West African coco...Towards a Sustainable Cocoa Economy:Rural transformation of West African coco...
Towards a Sustainable Cocoa Economy:Rural transformation of West African coco...
 

Plus de Juxi Leitner

From Vision to Actions - Towards Adaptive & Autonomous Humanoid Robots [PhD D...
From Vision to Actions - Towards Adaptive & Autonomous Humanoid Robots [PhD D...From Vision to Actions - Towards Adaptive & Autonomous Humanoid Robots [PhD D...
From Vision to Actions - Towards Adaptive & Autonomous Humanoid Robots [PhD D...
Juxi Leitner
 

Plus de Juxi Leitner (20)

The Need For Robots To Grasp the World
The Need For Robots To Grasp the WorldThe Need For Robots To Grasp the World
The Need For Robots To Grasp the World
 
Robots that Grasp the World
Robots that Grasp the WorldRobots that Grasp the World
Robots that Grasp the World
 
Improving Robotic Manipulation with Vision and Learning @AmazonDevCentre Berlin
Improving Robotic Manipulation with Vision and Learning @AmazonDevCentre BerlinImproving Robotic Manipulation with Vision and Learning @AmazonDevCentre Berlin
Improving Robotic Manipulation with Vision and Learning @AmazonDevCentre Berlin
 
Cartman, how to win the amazon robotics challenge with robotic vision and dee...
Cartman, how to win the amazon robotics challenge with robotic vision and dee...Cartman, how to win the amazon robotics challenge with robotic vision and dee...
Cartman, how to win the amazon robotics challenge with robotic vision and dee...
 
Deep Reinforcement Learning | Amazon Robotics Challenge, Image Processing Lec...
Deep Reinforcement Learning | Amazon Robotics Challenge, Image Processing Lec...Deep Reinforcement Learning | Amazon Robotics Challenge, Image Processing Lec...
Deep Reinforcement Learning | Amazon Robotics Challenge, Image Processing Lec...
 
ACRV Picking Benchmark: how to benchmark pick and place robotics research
ACRV Picking Benchmark: how to benchmark pick and place robotics researchACRV Picking Benchmark: how to benchmark pick and place robotics research
ACRV Picking Benchmark: how to benchmark pick and place robotics research
 
Team ACRV's experience at #AmazonPickingChallenge 2016
Team ACRV's experience at #AmazonPickingChallenge 2016Team ACRV's experience at #AmazonPickingChallenge 2016
Team ACRV's experience at #AmazonPickingChallenge 2016
 
(deep) reinforcement learning - CAB420
(deep) reinforcement learning - CAB420(deep) reinforcement learning - CAB420
(deep) reinforcement learning - CAB420
 
ACRV : Robotic Vision presentation in Lisbon at IST
ACRV : Robotic Vision presentation in Lisbon at ISTACRV : Robotic Vision presentation in Lisbon at IST
ACRV : Robotic Vision presentation in Lisbon at IST
 
The Australian Centre for Robotic Vision (ACRV)
The Australian Centre for Robotic Vision (ACRV)The Australian Centre for Robotic Vision (ACRV)
The Australian Centre for Robotic Vision (ACRV)
 
How to place 6th in the Amazon Picking Challenge (ENB329, QUT)
How to place 6th in the Amazon Picking Challenge (ENB329, QUT)How to place 6th in the Amazon Picking Challenge (ENB329, QUT)
How to place 6th in the Amazon Picking Challenge (ENB329, QUT)
 
LunaRoo: Designing a Hopping Lunar Science Payload #space #exploration
LunaRoo: Designing a Hopping Lunar Science Payload #space #explorationLunaRoo: Designing a Hopping Lunar Science Payload #space #exploration
LunaRoo: Designing a Hopping Lunar Science Payload #space #exploration
 
Robotic Vision - Vision for Robotics #IEEE #QLD #CIS #Colloquium
Robotic Vision - Vision for Robotics #IEEE #QLD #CIS #ColloquiumRobotic Vision - Vision for Robotics #IEEE #QLD #CIS #Colloquium
Robotic Vision - Vision for Robotics #IEEE #QLD #CIS #Colloquium
 
ROS Hands-On Intro/Tutorial (Robotic Vision Summer School 2015) #RVSS #ACRV
ROS Hands-On Intro/Tutorial (Robotic Vision Summer School 2015) #RVSS #ACRVROS Hands-On Intro/Tutorial (Robotic Vision Summer School 2015) #RVSS #ACRV
ROS Hands-On Intro/Tutorial (Robotic Vision Summer School 2015) #RVSS #ACRV
 
ACRV Research Fellow Intro/Tutorial [Vision and Action]
ACRV Research Fellow Intro/Tutorial [Vision and Action]ACRV Research Fellow Intro/Tutorial [Vision and Action]
ACRV Research Fellow Intro/Tutorial [Vision and Action]
 
From Vision to Actions - Towards Adaptive & Autonomous Humanoid Robots [PhD D...
From Vision to Actions - Towards Adaptive & Autonomous Humanoid Robots [PhD D...From Vision to Actions - Towards Adaptive & Autonomous Humanoid Robots [PhD D...
From Vision to Actions - Towards Adaptive & Autonomous Humanoid Robots [PhD D...
 
Reactive Reaching and Grasping on a Humanoid: Towards Closing the Action-Perc...
Reactive Reaching and Grasping on a Humanoid: Towards Closing the Action-Perc...Reactive Reaching and Grasping on a Humanoid: Towards Closing the Action-Perc...
Reactive Reaching and Grasping on a Humanoid: Towards Closing the Action-Perc...
 
Tele-operation of a Humanoid Robot, Using Operator Bio-data
Tele-operation of a Humanoid Robot, Using Operator Bio-dataTele-operation of a Humanoid Robot, Using Operator Bio-data
Tele-operation of a Humanoid Robot, Using Operator Bio-data
 
Improving Robot Vision Models for Object Detection Through Interaction #ijcnn...
Improving Robot Vision Models for Object Detection Through Interaction #ijcnn...Improving Robot Vision Models for Object Detection Through Interaction #ijcnn...
Improving Robot Vision Models for Object Detection Through Interaction #ijcnn...
 
How does it feel to be a SpaceMaster? [Erasmus Mundus - ACE Talk]
How does it feel to be a SpaceMaster? [Erasmus Mundus - ACE Talk]How does it feel to be a SpaceMaster? [Erasmus Mundus - ACE Talk]
How does it feel to be a SpaceMaster? [Erasmus Mundus - ACE Talk]
 

Dernier

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
Earley Information Science
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
giselly40
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 

Dernier (20)

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 

Transferring Spatial Perception Between Robots Operating In A Shared Workspace

  • 1. Jürgen ’Juxi’ Leitner S. Harding, M. Frank, A. Förster, J. Schmidhuber istituto dalle molle di studi sull’intelligenza artificiale università della svizzera italiana idsia / usi / supsi transferring spatial perception between robots operating in a shared workspace #iros 2012
  • 2. our iCub setup is for manipulation
  • 3. visual perception Harding et al., GPTP 2012, Leitner et al., ICDL 2012 IROS 2012
  • 5. learning approach +
  • 8. MoBeE framework Frank et al., ICINCO, 2012.
  • 9. MoBeE framework Frank et al., ICINCO, 2012.
  • 10. 9DOF bounding box iCub 6 per eye . . . fully connected . . . fully connected Cartesian Coordinates spatial perception neural network
  • 11. 600 400 -200 550 300 -300 500 200 -400 450 100 -500 0 -600 400 Y (mm) X (mm) Z (mm) -100 -700 350 -200 -800 300 -300 -900 250 -400 -1000 200 -500 -1100 150 -600 Predicted -1200 Expected 100 -700 -1300 0 200 400 600 800 1000 0 200 400 600 800 1000 0 Sample Index Sample Index -200 -300 -400 -500 -600 Z (mm) -700 -800 -1000 -900 results ANN -1100 -1200 -1300 0 200 400 600 800 1000 Sample Index
  • 13. future work unsupervised learning different spatial representations “intrinsic motivation” learning online, continuous learning eye-hand coordination
  • 14. thanks for listening juxi@idsia.ch http://Juxi.net/projects video at http://Juxi.net/projects/im-clever/year3.html