SlideShare une entreprise Scribd logo
1  sur  26
Télécharger pour lire hors ligne
Jürgen ’Juxi’ Leitner
                                                    S. Harding, A. Förster, J. Schmidhuber

                                        istituto dalle molle di studi sull’intelligenza artificiale
                                                               università della svizzera italiana
                                                                                 idsia / usi / supsi




                                    mars terrain image
                               classification using CGP
                                                                                  #iSAIRAS 2012


Wednesday, September 5, 2012
thanks to G. Metta and IIT for this picture




                                                   visual
                                              perception




Wednesday, September 5, 2012
detecting
            objects
Wednesday, September 5, 2012
learning
                               approach




Wednesday, September 5, 2012
INP               INP     INP     +      dilate     min     avg  




                                                         cartesian
                                                           genetic
                                                     programming
Wednesday, September 5, 2012
Image credit: NASA




              space
        applications
Wednesday, September 5, 2012
Image credit: NASA




              space
        applications
Wednesday, September 5, 2012
cgp
             approach
Wednesday, September 5, 2012
INP               INP     INP     +      dilate     min     avg  




                                                         cartesian
                                                           genetic
                                                     programming
Wednesday, September 5, 2012
INP               INP     INP     +      dilate     min     avg  




             ()*+,-*"
             .-**/+,-*"%"
             .-**/+,-*"$"
                                         !"
                                        "#$"
                                        "#%"
                                                         cartesian
                                                           genetic
             0"1/23"*)45/1"             &'!"
                                         """
                                           "



                                                     programming
Wednesday, September 5, 2012
detect
Wednesday, September 5, 2012
detect
Wednesday, September 5, 2012
!"#$%&$'()*'+,%-$&+*,.%
                        •      /+0%)1#2$3%"4%)"-$.%5%677%
                        •      /1&+8")%3+&$%5%679%
                        •      :1)'8").%5%;<7%%
                        •      =)>1&%'"1)&%5%?@%%A1&>1&%'"1)&5%6%
                        •      =.,+)-%#"-$,%4"3%$B",18")%
                               –  C<%D"3%."E%*.,+)-.%
                               –  FB",18")+3G%.&3+&$HG%D6I<E%*)%$+'(%*.,+)-%
                        •  J$+K%.$,$'8")%>3$..13$%+>>,*$-%4"3%$0$'18")%
                           .>$$-%


           technical
             details
Wednesday, September 5, 2012
detecting
        rocks
Wednesday, September 5, 2012
Wednesday, September 5, 2012
icImage* RockDetector::runFilter() {
                 !     icImage* node0 = InputImages[6]->gauss(3);
                 !     icImage* node1 = node0->sqrt();
                 !     icImage* node9 = InputImages[5];
                 !     icImage* node12 = node9->unsharpen(13);
                 !     icImage* node15 = node1->mulc(7.00936886295676);
                 !     icImage* node24 = node15->SmoothBilateral(9);
                 !     icImage* node31 = node24->Normalize();
                 !     icImage* node33 = node12->mulc(4.03286868333817);
                 !     icImage* node35 = node33->add(node31);
                 !     icImage* node99 = node35->SmoothBilateral(11);
                       //cleanup
                       ...
                       // return
                 !     return node99->threshold(177.2417f);
                     }




    detecting
        rocks
Wednesday, September 5, 2012
detecting
             specific
               rocks
Wednesday, September 5, 2012
detectingspecificrocks
Wednesday, September 5, 2012
classifying
             martian
              terrain
Wednesday, September 5, 2012
martian
                            terrain classification
I.Halatci,K.Iagnemma,etal.Astudyofvisualand tactile terrain classification and classifier fusion for planetary exploration rovers. Robotica, 26(6):767– 779, 2008.
C. Shang, D. Barnes, and Q. Shen. Facilitating effi- cient mars terrain image classification with fuzzy- rough feature selection. International Journal of Hybrid Intelligent Systems, 8(1):3–13, 2011.
C. Shang and D. Barnes. Classification of mars mcmurdo panorama images using machine learning techniques. Acta Futura, 5:29–38, 2012.

Wednesday, September 5, 2012
Shang et al.                                                                          CGP-IP


                           martian
                            terrain classification
I.Halatci,K.Iagnemma,etal.Astudyofvisualand tactile terrain classification and classifier fusion for planetary exploration rovers. Robotica, 26(6):767– 779, 2008.
C. Shang, D. Barnes, and Q. Shen. Facilitating effi- cient mars terrain image classification with fuzzy- rough feature selection. International Journal of Hybrid Intelligent Systems, 8(1):3–13, 2011.
C. Shang and D. Barnes. Classification of mars mcmurdo panorama images using machine learning techniques. Acta Futura, 5:29–38, 2012.

Wednesday, September 5, 2012
martian
                            terrain classification
I.Halatci,K.Iagnemma,etal.Astudyofvisualand tactile terrain classification and classifier fusion for planetary exploration rovers. Robotica, 26(6):767– 779, 2008.
C. Shang, D. Barnes, and Q. Shen. Facilitating effi- cient mars terrain image classification with fuzzy- rough feature selection. International Journal of Hybrid Intelligent Systems, 8(1):3–13, 2011.
C. Shang and D. Barnes. Classification of mars mcmurdo panorama images using machine learning techniques. Acta Futura, 5:29–38, 2012.

Wednesday, September 5, 2012
Shang et al.                                                                          CGP-IP


                           martian
                            terrain classification
I.Halatci,K.Iagnemma,etal.Astudyofvisualand tactile terrain classification and classifier fusion for planetary exploration rovers. Robotica, 26(6):767– 779, 2008.
C. Shang, D. Barnes, and Q. Shen. Facilitating effi- cient mars terrain image classification with fuzzy- rough feature selection. International Journal of Hybrid Intelligent Systems, 8(1):3–13, 2011.
C. Shang and D. Barnes. Classification of mars mcmurdo panorama images using machine learning techniques. Acta Futura, 5:29–38, 2012.

Wednesday, September 5, 2012
collaboration

                               if you have (labelled) data
                                    please contact us
                               we are not martian terrain
                                       specialists :)
                                    juxi@idsia.ch   http://Juxi.net/projects



Wednesday, September 5, 2012
conclusions
                 combining cgp with opencv creates possibilities

                 output: executable, human-readable code
                         for detection and identification
                 impressive performance (and robustness)




Wednesday, September 5, 2012
thanks
                                                                                                for listening
                                              juxi@idsia.ch            http://Juxi.net/projects

                further references
                Vincent Graziano, Tobias Glasmachers, Tom Schaul, Leo Pape, Giuseppe Cuccu,Jürgen Leitner and Jürgen
                Schmidhuber. Artificial Curiosity for Autonomous Space Exploration. Acta Futura, 4, pp.41-52, 2011.

                M. Frank, J. Leitner, M. Stollenga, S. Harding, A. Förster, and J. Schmidhuber. The modular behavioral environment
                for humanoids and other robots (MoBeE). In Proceedings of the International Conference on Informatics in Control,
                Automation and Robotics (ICINCO), 2012.

                S. Harding, V. Graziano, J. Leitner, J. Schmidhuber. MT-CGP: Mixed Type Cartesian Genetic Programming. In
                Proceedings of the Genetic and Evolutionary Computation Conference (GECCO). Philadelphia, USA. July 2012.

                Leitner, J., Harding, S., Förster, A., and Schmidhuber, J.. Mars Terrain Classification using Cartesian Genetic
                Programming. In the Proceedings of the International Symposium on AI and Robotics for Space (I-SAIRAS). 2012.

                S. Harding, J. Leitner, and J. Schmidhuber. Cartesian genetic programming for image processing. Book Chapter in
                Genetic Programming Theory and Practice X. Springer, 2012. (in print)

                Leitner, J., Harding, S., Frank, M., Förster, A., and Schmidhuber, J. Towards Spatial Perception: Learning to Locate
                Objects From Vision. In Proceedings of the Postgraduate Conference on Robotics and Development of Cognition
                RobotDoc, 2012.

                J. Leitner, S. Harding, M. Frank, A. Förster, and J. Schmidhuber. Transferring spatial perception between robots
                operating in a shared workspace. In Intelligent Robots and Systems, 2012. accepted.

Wednesday, September 5, 2012

Contenu connexe

Similaire à Mars Terrain Image Classification Using Cartesian Genetic Programming #isairas 2012

那些年 Python 攻佔了 GIS / The Year Python Takes Over GIS
那些年 Python 攻佔了 GIS / The Year Python Takes Over GIS那些年 Python 攻佔了 GIS / The Year Python Takes Over GIS
那些年 Python 攻佔了 GIS / The Year Python Takes Over GISpycontw
 
Artificial Neural Networks For Spatial Perception: Towards Visual Object Loca...
Artificial Neural Networks For Spatial Perception: Towards Visual Object Loca...Artificial Neural Networks For Spatial Perception: Towards Visual Object Loca...
Artificial Neural Networks For Spatial Perception: Towards Visual Object Loca...Juxi Leitner
 
Poster 1-13-Paper ID 207
Poster 1-13-Paper ID 207Poster 1-13-Paper ID 207
Poster 1-13-Paper ID 207Sudeshna Roy
 
Abstract_537fbfbb4b9a70c487a6fdc8bca78d5a-2.pdf
Abstract_537fbfbb4b9a70c487a6fdc8bca78d5a-2.pdfAbstract_537fbfbb4b9a70c487a6fdc8bca78d5a-2.pdf
Abstract_537fbfbb4b9a70c487a6fdc8bca78d5a-2.pdfSameeUllaKhan1
 
Pactices of GPS/GIS in/for rural development
Pactices of GPS/GIS in/for rural developmentPactices of GPS/GIS in/for rural development
Pactices of GPS/GIS in/for rural developmentTakahiro Miyoshi
 
YOLO BASED SHIP IMAGE DETECTION AND CLASSIFICATION
YOLO BASED SHIP IMAGE DETECTION AND CLASSIFICATIONYOLO BASED SHIP IMAGE DETECTION AND CLASSIFICATION
YOLO BASED SHIP IMAGE DETECTION AND CLASSIFICATIONIRJET Journal
 
White box in Computer Vision
White box in Computer VisionWhite box in Computer Vision
White box in Computer VisionJaehyuk Heo
 
Massive MapReduce Matrix Computations & Multicore Graph Algorithms
Massive MapReduce Matrix Computations & Multicore Graph AlgorithmsMassive MapReduce Matrix Computations & Multicore Graph Algorithms
Massive MapReduce Matrix Computations & Multicore Graph AlgorithmsDavid Gleich
 
Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoC
Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoCTowards Spatial Perception: Learning to Locate Objects from Vision #robotDoC
Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoCJuxi Leitner
 
Satellite and Land Cover Image Classification using Deep Learning
Satellite and Land Cover Image Classification using Deep LearningSatellite and Land Cover Image Classification using Deep Learning
Satellite and Land Cover Image Classification using Deep Learningijtsrd
 
GeoMeetup kickoff meeting - Overview of Geospatial Landscape
GeoMeetup kickoff meeting - Overview of Geospatial LandscapeGeoMeetup kickoff meeting - Overview of Geospatial Landscape
GeoMeetup kickoff meeting - Overview of Geospatial LandscapeRagi Burhum Espinoza
 
Using deep learning in remote sensing
Using deep learning in remote sensingUsing deep learning in remote sensing
Using deep learning in remote sensingMohamed Yousif
 
Self Automated Rovers
Self Automated RoversSelf Automated Rovers
Self Automated RoversRutikBhoyar
 
INDOOR AND OUTDOOR NAVIGATION ASSISTANCE SYSTEM FOR VISUALLY IMPAIRED PEOPLE ...
INDOOR AND OUTDOOR NAVIGATION ASSISTANCE SYSTEM FOR VISUALLY IMPAIRED PEOPLE ...INDOOR AND OUTDOOR NAVIGATION ASSISTANCE SYSTEM FOR VISUALLY IMPAIRED PEOPLE ...
INDOOR AND OUTDOOR NAVIGATION ASSISTANCE SYSTEM FOR VISUALLY IMPAIRED PEOPLE ...IRJET Journal
 
IRJET - Object Detection using Deep Learning with OpenCV and Python
IRJET - Object Detection using Deep Learning with OpenCV and PythonIRJET - Object Detection using Deep Learning with OpenCV and Python
IRJET - Object Detection using Deep Learning with OpenCV and PythonIRJET Journal
 
Developers + Designers: A Mutalistic Relationship - From BlendConf 2013
Developers + Designers: A Mutalistic Relationship - From BlendConf 2013Developers + Designers: A Mutalistic Relationship - From BlendConf 2013
Developers + Designers: A Mutalistic Relationship - From BlendConf 2013Rachel Parsons
 

Similaire à Mars Terrain Image Classification Using Cartesian Genetic Programming #isairas 2012 (20)

那些年 Python 攻佔了 GIS / The Year Python Takes Over GIS
那些年 Python 攻佔了 GIS / The Year Python Takes Over GIS那些年 Python 攻佔了 GIS / The Year Python Takes Over GIS
那些年 Python 攻佔了 GIS / The Year Python Takes Over GIS
 
Artificial Neural Networks For Spatial Perception: Towards Visual Object Loca...
Artificial Neural Networks For Spatial Perception: Towards Visual Object Loca...Artificial Neural Networks For Spatial Perception: Towards Visual Object Loca...
Artificial Neural Networks For Spatial Perception: Towards Visual Object Loca...
 
Kelm überblick 2013
Kelm überblick 2013Kelm überblick 2013
Kelm überblick 2013
 
“Few-shot Image Generation using Scene Graphs” by Azade Farshad
“Few-shot Image Generation using Scene Graphs” by Azade Farshad“Few-shot Image Generation using Scene Graphs” by Azade Farshad
“Few-shot Image Generation using Scene Graphs” by Azade Farshad
 
Poster 1-13-Paper ID 207
Poster 1-13-Paper ID 207Poster 1-13-Paper ID 207
Poster 1-13-Paper ID 207
 
Abstract_537fbfbb4b9a70c487a6fdc8bca78d5a-2.pdf
Abstract_537fbfbb4b9a70c487a6fdc8bca78d5a-2.pdfAbstract_537fbfbb4b9a70c487a6fdc8bca78d5a-2.pdf
Abstract_537fbfbb4b9a70c487a6fdc8bca78d5a-2.pdf
 
Pactices of GPS/GIS in/for rural development
Pactices of GPS/GIS in/for rural developmentPactices of GPS/GIS in/for rural development
Pactices of GPS/GIS in/for rural development
 
YOLO BASED SHIP IMAGE DETECTION AND CLASSIFICATION
YOLO BASED SHIP IMAGE DETECTION AND CLASSIFICATIONYOLO BASED SHIP IMAGE DETECTION AND CLASSIFICATION
YOLO BASED SHIP IMAGE DETECTION AND CLASSIFICATION
 
White box in Computer Vision
White box in Computer VisionWhite box in Computer Vision
White box in Computer Vision
 
Massive MapReduce Matrix Computations & Multicore Graph Algorithms
Massive MapReduce Matrix Computations & Multicore Graph AlgorithmsMassive MapReduce Matrix Computations & Multicore Graph Algorithms
Massive MapReduce Matrix Computations & Multicore Graph Algorithms
 
Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoC
Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoCTowards Spatial Perception: Learning to Locate Objects from Vision #robotDoC
Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoC
 
PAKDD2013
PAKDD2013PAKDD2013
PAKDD2013
 
Satellite and Land Cover Image Classification using Deep Learning
Satellite and Land Cover Image Classification using Deep LearningSatellite and Land Cover Image Classification using Deep Learning
Satellite and Land Cover Image Classification using Deep Learning
 
GeoMeetup kickoff meeting - Overview of Geospatial Landscape
GeoMeetup kickoff meeting - Overview of Geospatial LandscapeGeoMeetup kickoff meeting - Overview of Geospatial Landscape
GeoMeetup kickoff meeting - Overview of Geospatial Landscape
 
Using deep learning in remote sensing
Using deep learning in remote sensingUsing deep learning in remote sensing
Using deep learning in remote sensing
 
Self Automated Rovers
Self Automated RoversSelf Automated Rovers
Self Automated Rovers
 
INDOOR AND OUTDOOR NAVIGATION ASSISTANCE SYSTEM FOR VISUALLY IMPAIRED PEOPLE ...
INDOOR AND OUTDOOR NAVIGATION ASSISTANCE SYSTEM FOR VISUALLY IMPAIRED PEOPLE ...INDOOR AND OUTDOOR NAVIGATION ASSISTANCE SYSTEM FOR VISUALLY IMPAIRED PEOPLE ...
INDOOR AND OUTDOOR NAVIGATION ASSISTANCE SYSTEM FOR VISUALLY IMPAIRED PEOPLE ...
 
IRJET - Object Detection using Deep Learning with OpenCV and Python
IRJET - Object Detection using Deep Learning with OpenCV and PythonIRJET - Object Detection using Deep Learning with OpenCV and Python
IRJET - Object Detection using Deep Learning with OpenCV and Python
 
Developers + Designers: A Mutalistic Relationship - From BlendConf 2013
Developers + Designers: A Mutalistic Relationship - From BlendConf 2013Developers + Designers: A Mutalistic Relationship - From BlendConf 2013
Developers + Designers: A Mutalistic Relationship - From BlendConf 2013
 
Resume_ml_db_cv
Resume_ml_db_cvResume_ml_db_cv
Resume_ml_db_cv
 

Plus de Juxi Leitner

The Need For Robots To Grasp the World
The Need For Robots To Grasp the WorldThe Need For Robots To Grasp the World
The Need For Robots To Grasp the WorldJuxi Leitner
 
Robots that Grasp the World
Robots that Grasp the WorldRobots that Grasp the World
Robots that Grasp the WorldJuxi Leitner
 
Improving Robotic Manipulation with Vision and Learning @AmazonDevCentre Berlin
Improving Robotic Manipulation with Vision and Learning @AmazonDevCentre BerlinImproving Robotic Manipulation with Vision and Learning @AmazonDevCentre Berlin
Improving Robotic Manipulation with Vision and Learning @AmazonDevCentre BerlinJuxi Leitner
 
Cartman, how to win the amazon robotics challenge with robotic vision and dee...
Cartman, how to win the amazon robotics challenge with robotic vision and dee...Cartman, how to win the amazon robotics challenge with robotic vision and dee...
Cartman, how to win the amazon robotics challenge with robotic vision and dee...Juxi Leitner
 
Deep Reinforcement Learning | Amazon Robotics Challenge, Image Processing Lec...
Deep Reinforcement Learning | Amazon Robotics Challenge, Image Processing Lec...Deep Reinforcement Learning | Amazon Robotics Challenge, Image Processing Lec...
Deep Reinforcement Learning | Amazon Robotics Challenge, Image Processing Lec...Juxi Leitner
 
ACRV Picking Benchmark: how to benchmark pick and place robotics research
ACRV Picking Benchmark: how to benchmark pick and place robotics researchACRV Picking Benchmark: how to benchmark pick and place robotics research
ACRV Picking Benchmark: how to benchmark pick and place robotics researchJuxi Leitner
 
Team ACRV's experience at #AmazonPickingChallenge 2016
Team ACRV's experience at #AmazonPickingChallenge 2016Team ACRV's experience at #AmazonPickingChallenge 2016
Team ACRV's experience at #AmazonPickingChallenge 2016Juxi Leitner
 
(deep) reinforcement learning - CAB420
(deep) reinforcement learning - CAB420(deep) reinforcement learning - CAB420
(deep) reinforcement learning - CAB420Juxi Leitner
 
ACRV : Robotic Vision presentation in Lisbon at IST
ACRV : Robotic Vision presentation in Lisbon at ISTACRV : Robotic Vision presentation in Lisbon at IST
ACRV : Robotic Vision presentation in Lisbon at ISTJuxi Leitner
 
The Australian Centre for Robotic Vision (ACRV)
The Australian Centre for Robotic Vision (ACRV)The Australian Centre for Robotic Vision (ACRV)
The Australian Centre for Robotic Vision (ACRV)Juxi Leitner
 
How to place 6th in the Amazon Picking Challenge (ENB329, QUT)
How to place 6th in the Amazon Picking Challenge (ENB329, QUT)How to place 6th in the Amazon Picking Challenge (ENB329, QUT)
How to place 6th in the Amazon Picking Challenge (ENB329, QUT)Juxi Leitner
 
LunaRoo: Designing a Hopping Lunar Science Payload #space #exploration
LunaRoo: Designing a Hopping Lunar Science Payload #space #explorationLunaRoo: Designing a Hopping Lunar Science Payload #space #exploration
LunaRoo: Designing a Hopping Lunar Science Payload #space #explorationJuxi Leitner
 
Robotic Vision - Vision for Robotics #IEEE #QLD #CIS #Colloquium
Robotic Vision - Vision for Robotics #IEEE #QLD #CIS #ColloquiumRobotic Vision - Vision for Robotics #IEEE #QLD #CIS #Colloquium
Robotic Vision - Vision for Robotics #IEEE #QLD #CIS #ColloquiumJuxi Leitner
 
ROS Hands-On Intro/Tutorial (Robotic Vision Summer School 2015) #RVSS #ACRV
ROS Hands-On Intro/Tutorial (Robotic Vision Summer School 2015) #RVSS #ACRVROS Hands-On Intro/Tutorial (Robotic Vision Summer School 2015) #RVSS #ACRV
ROS Hands-On Intro/Tutorial (Robotic Vision Summer School 2015) #RVSS #ACRVJuxi Leitner
 
ACRV Research Fellow Intro/Tutorial [Vision and Action]
ACRV Research Fellow Intro/Tutorial [Vision and Action]ACRV Research Fellow Intro/Tutorial [Vision and Action]
ACRV Research Fellow Intro/Tutorial [Vision and Action]Juxi Leitner
 
Reactive Reaching and Grasping on a Humanoid: Towards Closing the Action-Perc...
Reactive Reaching and Grasping on a Humanoid: Towards Closing the Action-Perc...Reactive Reaching and Grasping on a Humanoid: Towards Closing the Action-Perc...
Reactive Reaching and Grasping on a Humanoid: Towards Closing the Action-Perc...Juxi Leitner
 
Tele-operation of a Humanoid Robot, Using Operator Bio-data
Tele-operation of a Humanoid Robot, Using Operator Bio-dataTele-operation of a Humanoid Robot, Using Operator Bio-data
Tele-operation of a Humanoid Robot, Using Operator Bio-dataJuxi Leitner
 
Improving Robot Vision Models for Object Detection Through Interaction #ijcnn...
Improving Robot Vision Models for Object Detection Through Interaction #ijcnn...Improving Robot Vision Models for Object Detection Through Interaction #ijcnn...
Improving Robot Vision Models for Object Detection Through Interaction #ijcnn...Juxi Leitner
 
How does it feel to be a SpaceMaster? [Erasmus Mundus - ACE Talk]
How does it feel to be a SpaceMaster? [Erasmus Mundus - ACE Talk]How does it feel to be a SpaceMaster? [Erasmus Mundus - ACE Talk]
How does it feel to be a SpaceMaster? [Erasmus Mundus - ACE Talk]Juxi Leitner
 
Appetizer Talk Slides
Appetizer Talk SlidesAppetizer Talk Slides
Appetizer Talk SlidesJuxi Leitner
 

Plus de Juxi Leitner (20)

The Need For Robots To Grasp the World
The Need For Robots To Grasp the WorldThe Need For Robots To Grasp the World
The Need For Robots To Grasp the World
 
Robots that Grasp the World
Robots that Grasp the WorldRobots that Grasp the World
Robots that Grasp the World
 
Improving Robotic Manipulation with Vision and Learning @AmazonDevCentre Berlin
Improving Robotic Manipulation with Vision and Learning @AmazonDevCentre BerlinImproving Robotic Manipulation with Vision and Learning @AmazonDevCentre Berlin
Improving Robotic Manipulation with Vision and Learning @AmazonDevCentre Berlin
 
Cartman, how to win the amazon robotics challenge with robotic vision and dee...
Cartman, how to win the amazon robotics challenge with robotic vision and dee...Cartman, how to win the amazon robotics challenge with robotic vision and dee...
Cartman, how to win the amazon robotics challenge with robotic vision and dee...
 
Deep Reinforcement Learning | Amazon Robotics Challenge, Image Processing Lec...
Deep Reinforcement Learning | Amazon Robotics Challenge, Image Processing Lec...Deep Reinforcement Learning | Amazon Robotics Challenge, Image Processing Lec...
Deep Reinforcement Learning | Amazon Robotics Challenge, Image Processing Lec...
 
ACRV Picking Benchmark: how to benchmark pick and place robotics research
ACRV Picking Benchmark: how to benchmark pick and place robotics researchACRV Picking Benchmark: how to benchmark pick and place robotics research
ACRV Picking Benchmark: how to benchmark pick and place robotics research
 
Team ACRV's experience at #AmazonPickingChallenge 2016
Team ACRV's experience at #AmazonPickingChallenge 2016Team ACRV's experience at #AmazonPickingChallenge 2016
Team ACRV's experience at #AmazonPickingChallenge 2016
 
(deep) reinforcement learning - CAB420
(deep) reinforcement learning - CAB420(deep) reinforcement learning - CAB420
(deep) reinforcement learning - CAB420
 
ACRV : Robotic Vision presentation in Lisbon at IST
ACRV : Robotic Vision presentation in Lisbon at ISTACRV : Robotic Vision presentation in Lisbon at IST
ACRV : Robotic Vision presentation in Lisbon at IST
 
The Australian Centre for Robotic Vision (ACRV)
The Australian Centre for Robotic Vision (ACRV)The Australian Centre for Robotic Vision (ACRV)
The Australian Centre for Robotic Vision (ACRV)
 
How to place 6th in the Amazon Picking Challenge (ENB329, QUT)
How to place 6th in the Amazon Picking Challenge (ENB329, QUT)How to place 6th in the Amazon Picking Challenge (ENB329, QUT)
How to place 6th in the Amazon Picking Challenge (ENB329, QUT)
 
LunaRoo: Designing a Hopping Lunar Science Payload #space #exploration
LunaRoo: Designing a Hopping Lunar Science Payload #space #explorationLunaRoo: Designing a Hopping Lunar Science Payload #space #exploration
LunaRoo: Designing a Hopping Lunar Science Payload #space #exploration
 
Robotic Vision - Vision for Robotics #IEEE #QLD #CIS #Colloquium
Robotic Vision - Vision for Robotics #IEEE #QLD #CIS #ColloquiumRobotic Vision - Vision for Robotics #IEEE #QLD #CIS #Colloquium
Robotic Vision - Vision for Robotics #IEEE #QLD #CIS #Colloquium
 
ROS Hands-On Intro/Tutorial (Robotic Vision Summer School 2015) #RVSS #ACRV
ROS Hands-On Intro/Tutorial (Robotic Vision Summer School 2015) #RVSS #ACRVROS Hands-On Intro/Tutorial (Robotic Vision Summer School 2015) #RVSS #ACRV
ROS Hands-On Intro/Tutorial (Robotic Vision Summer School 2015) #RVSS #ACRV
 
ACRV Research Fellow Intro/Tutorial [Vision and Action]
ACRV Research Fellow Intro/Tutorial [Vision and Action]ACRV Research Fellow Intro/Tutorial [Vision and Action]
ACRV Research Fellow Intro/Tutorial [Vision and Action]
 
Reactive Reaching and Grasping on a Humanoid: Towards Closing the Action-Perc...
Reactive Reaching and Grasping on a Humanoid: Towards Closing the Action-Perc...Reactive Reaching and Grasping on a Humanoid: Towards Closing the Action-Perc...
Reactive Reaching and Grasping on a Humanoid: Towards Closing the Action-Perc...
 
Tele-operation of a Humanoid Robot, Using Operator Bio-data
Tele-operation of a Humanoid Robot, Using Operator Bio-dataTele-operation of a Humanoid Robot, Using Operator Bio-data
Tele-operation of a Humanoid Robot, Using Operator Bio-data
 
Improving Robot Vision Models for Object Detection Through Interaction #ijcnn...
Improving Robot Vision Models for Object Detection Through Interaction #ijcnn...Improving Robot Vision Models for Object Detection Through Interaction #ijcnn...
Improving Robot Vision Models for Object Detection Through Interaction #ijcnn...
 
How does it feel to be a SpaceMaster? [Erasmus Mundus - ACE Talk]
How does it feel to be a SpaceMaster? [Erasmus Mundus - ACE Talk]How does it feel to be a SpaceMaster? [Erasmus Mundus - ACE Talk]
How does it feel to be a SpaceMaster? [Erasmus Mundus - ACE Talk]
 
Appetizer Talk Slides
Appetizer Talk SlidesAppetizer Talk Slides
Appetizer Talk Slides
 

Dernier

2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?Antenna Manufacturer Coco
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUK Journal
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfhans926745
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdflior mazor
 

Dernier (20)

2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 

Mars Terrain Image Classification Using Cartesian Genetic Programming #isairas 2012

  • 1. Jürgen ’Juxi’ Leitner S. Harding, A. Förster, J. Schmidhuber istituto dalle molle di studi sull’intelligenza artificiale università della svizzera italiana idsia / usi / supsi mars terrain image classification using CGP #iSAIRAS 2012 Wednesday, September 5, 2012
  • 2. thanks to G. Metta and IIT for this picture visual perception Wednesday, September 5, 2012
  • 3. detecting objects Wednesday, September 5, 2012
  • 4. learning approach Wednesday, September 5, 2012
  • 5. INP   INP   INP   +   dilate   min   avg   cartesian genetic programming Wednesday, September 5, 2012
  • 6. Image credit: NASA space applications Wednesday, September 5, 2012
  • 7. Image credit: NASA space applications Wednesday, September 5, 2012
  • 8. cgp approach Wednesday, September 5, 2012
  • 9. INP   INP   INP   +   dilate   min   avg   cartesian genetic programming Wednesday, September 5, 2012
  • 10. INP   INP   INP   +   dilate   min   avg   ()*+,-*" .-**/+,-*"%" .-**/+,-*"$" !" "#$" "#%" cartesian genetic 0"1/23"*)45/1" &'!" """ " programming Wednesday, September 5, 2012
  • 13. !"#$%&$'()*'+,%-$&+*,.% •  /+0%)1#2$3%"4%)"-$.%5%677% •  /1&+8")%3+&$%5%679% •  :1)'8").%5%;<7%% •  =)>1&%'"1)&%5%?@%%A1&>1&%'"1)&5%6% •  =.,+)-%#"-$,%4"3%$B",18")% –  C<%D"3%."E%*.,+)-.% –  FB",18")+3G%.&3+&$HG%D6I<E%*)%$+'(%*.,+)-% •  J$+K%.$,$'8")%>3$..13$%+>>,*$-%4"3%$0$'18")% .>$$-% technical details Wednesday, September 5, 2012
  • 14. detecting rocks Wednesday, September 5, 2012
  • 16. icImage* RockDetector::runFilter() { ! icImage* node0 = InputImages[6]->gauss(3); ! icImage* node1 = node0->sqrt(); ! icImage* node9 = InputImages[5]; ! icImage* node12 = node9->unsharpen(13); ! icImage* node15 = node1->mulc(7.00936886295676); ! icImage* node24 = node15->SmoothBilateral(9); ! icImage* node31 = node24->Normalize(); ! icImage* node33 = node12->mulc(4.03286868333817); ! icImage* node35 = node33->add(node31); ! icImage* node99 = node35->SmoothBilateral(11); //cleanup ... // return ! return node99->threshold(177.2417f); } detecting rocks Wednesday, September 5, 2012
  • 17. detecting specific rocks Wednesday, September 5, 2012
  • 19. classifying martian terrain Wednesday, September 5, 2012
  • 20. martian terrain classification I.Halatci,K.Iagnemma,etal.Astudyofvisualand tactile terrain classification and classifier fusion for planetary exploration rovers. Robotica, 26(6):767– 779, 2008. C. Shang, D. Barnes, and Q. Shen. Facilitating effi- cient mars terrain image classification with fuzzy- rough feature selection. International Journal of Hybrid Intelligent Systems, 8(1):3–13, 2011. C. Shang and D. Barnes. Classification of mars mcmurdo panorama images using machine learning techniques. Acta Futura, 5:29–38, 2012. Wednesday, September 5, 2012
  • 21. Shang et al. CGP-IP martian terrain classification I.Halatci,K.Iagnemma,etal.Astudyofvisualand tactile terrain classification and classifier fusion for planetary exploration rovers. Robotica, 26(6):767– 779, 2008. C. Shang, D. Barnes, and Q. Shen. Facilitating effi- cient mars terrain image classification with fuzzy- rough feature selection. International Journal of Hybrid Intelligent Systems, 8(1):3–13, 2011. C. Shang and D. Barnes. Classification of mars mcmurdo panorama images using machine learning techniques. Acta Futura, 5:29–38, 2012. Wednesday, September 5, 2012
  • 22. martian terrain classification I.Halatci,K.Iagnemma,etal.Astudyofvisualand tactile terrain classification and classifier fusion for planetary exploration rovers. Robotica, 26(6):767– 779, 2008. C. Shang, D. Barnes, and Q. Shen. Facilitating effi- cient mars terrain image classification with fuzzy- rough feature selection. International Journal of Hybrid Intelligent Systems, 8(1):3–13, 2011. C. Shang and D. Barnes. Classification of mars mcmurdo panorama images using machine learning techniques. Acta Futura, 5:29–38, 2012. Wednesday, September 5, 2012
  • 23. Shang et al. CGP-IP martian terrain classification I.Halatci,K.Iagnemma,etal.Astudyofvisualand tactile terrain classification and classifier fusion for planetary exploration rovers. Robotica, 26(6):767– 779, 2008. C. Shang, D. Barnes, and Q. Shen. Facilitating effi- cient mars terrain image classification with fuzzy- rough feature selection. International Journal of Hybrid Intelligent Systems, 8(1):3–13, 2011. C. Shang and D. Barnes. Classification of mars mcmurdo panorama images using machine learning techniques. Acta Futura, 5:29–38, 2012. Wednesday, September 5, 2012
  • 24. collaboration if you have (labelled) data please contact us we are not martian terrain specialists :) juxi@idsia.ch http://Juxi.net/projects Wednesday, September 5, 2012
  • 25. conclusions combining cgp with opencv creates possibilities output: executable, human-readable code for detection and identification impressive performance (and robustness) Wednesday, September 5, 2012
  • 26. thanks for listening juxi@idsia.ch http://Juxi.net/projects further references Vincent Graziano, Tobias Glasmachers, Tom Schaul, Leo Pape, Giuseppe Cuccu,Jürgen Leitner and Jürgen Schmidhuber. Artificial Curiosity for Autonomous Space Exploration. Acta Futura, 4, pp.41-52, 2011. M. Frank, J. Leitner, M. Stollenga, S. Harding, A. Förster, and J. Schmidhuber. The modular behavioral environment for humanoids and other robots (MoBeE). In Proceedings of the International Conference on Informatics in Control, Automation and Robotics (ICINCO), 2012. S. Harding, V. Graziano, J. Leitner, J. Schmidhuber. MT-CGP: Mixed Type Cartesian Genetic Programming. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO). Philadelphia, USA. July 2012. Leitner, J., Harding, S., Förster, A., and Schmidhuber, J.. Mars Terrain Classification using Cartesian Genetic Programming. In the Proceedings of the International Symposium on AI and Robotics for Space (I-SAIRAS). 2012. S. Harding, J. Leitner, and J. Schmidhuber. Cartesian genetic programming for image processing. Book Chapter in Genetic Programming Theory and Practice X. Springer, 2012. (in print) Leitner, J., Harding, S., Frank, M., Förster, A., and Schmidhuber, J. Towards Spatial Perception: Learning to Locate Objects From Vision. In Proceedings of the Postgraduate Conference on Robotics and Development of Cognition RobotDoc, 2012. J. Leitner, S. Harding, M. Frank, A. Förster, and J. Schmidhuber. Transferring spatial perception between robots operating in a shared workspace. In Intelligent Robots and Systems, 2012. accepted. Wednesday, September 5, 2012