SlideShare une entreprise Scribd logo
1  sur  12
Télécharger pour lire hors ligne
Focus set based reconstruction of micro-objects- http://vision.eng.shu.ac.uk/mechrob04/MechRob-paper.pdf



             Focus set based reconstruction of micro-objects

                                          Jan Wedekind

                                             13.9.2004




                     MiCRoN        http://wwwipr.ira.uka.de/~micron/
                     MMVL          http://www.shu.ac.uk/mmvl/
            People: Balasundram Amavasai, Manuel Boissenin, Axel B¨rkle,
                                                                  u
                       Fabio Caparrelli, Arul Selvan, Jon Travis



     microsystems & machine vision lab          -1-         MiCRoN http://wwwipr.ira.uka.de/~micron/
Focus set based reconstruction of micro-objects- http://vision.eng.shu.ac.uk/mechrob04/MechRob-paper.pdf



                             micro-vision and micro-robotics




 Closed-loop control
   • Estimate pose of manipulator in real time
 Task planning
   • Estimate pose of known micro-objects
   • Recognize obstacles for avoiding collisions
   • Provide data for determining gripping points



     microsystems & machine vision lab          -2-         MiCRoN http://wwwipr.ira.uka.de/~micron/
Focus set based reconstruction of micro-objects- http://vision.eng.shu.ac.uk/mechrob04/MechRob-paper.pdf



                                present state of micro-vision



 characteristics
   • Limited depth of focus
   • Teleoptical settings
 vision problems
   • unstable feature extraction
   • limited depth of view
 ⇒ most standard approaches are failing




     microsystems & machine vision lab          -3-         MiCRoN http://wwwipr.ira.uka.de/~micron/
Focus set based reconstruction of micro-objects- http://vision.eng.shu.ac.uk/mechrob04/MechRob-paper.pdf




                          spin images (Andrew Johnson 1997)




     microsystems & machine vision lab          -4-         MiCRoN http://wwwipr.ira.uka.de/~micron/
Focus set based reconstruction of micro-objects- http://vision.eng.shu.ac.uk/mechrob04/MechRob-paper.pdf




                          spin images (Andrew Johnson 1997)




     microsystems & machine vision lab          -5-         MiCRoN http://wwwipr.ira.uka.de/~micron/
Focus set based reconstruction of micro-objects- http://vision.eng.shu.ac.uk/mechrob04/MechRob-paper.pdf



                                          depth of focus




   • Acquire focus set of images g(x1 , x2 , z)
   • Compute local sharpness measure s(x1 , x2 , z)
   • Compute depth map d(x1 , x2 ) := argmax s(x1 , x2 , z)
                                                 z∈Z




     microsystems & machine vision lab          -6-         MiCRoN http://wwwipr.ira.uka.de/~micron/
Focus set based reconstruction of micro-objects- http://vision.eng.shu.ac.uk/mechrob04/MechRob-paper.pdf



                                            systematic error


 test with micro-ridge
   • Algorithm fails when contrast low
   • Systematic errors
   • Trade-off between resolution and stability
 ⇒ Filter-bench


  image index z     insufficient contrast                                                  PSF
                                                                               d
                                                                                   c
                                                                               b       a

                                         pixel−position in image y             d c
                               systematic error




     microsystems & machine vision lab           -7-         MiCRoN http://wwwipr.ira.uka.de/~micron/
Focus set based reconstruction of micro-objects- http://vision.eng.shu.ac.uk/mechrob04/MechRob-paper.pdf



                                      multiscale approach
                                                                  s                  maximum sharpness

     • Recursive filtering
     • Not real-time efficient
                                                                                                z
                                                                          large filter kernel
     • Complexity
                                                                  s
       (N = number of pixel)
         – O(N ) time
         – O(N ) memory                                                                   z
           √          2                                                    medium−sized filter kernel
         – 3 N O(N 3 )                                            s
           parallelisation
     • No systematic error                       image
                                                (x1,x2)                                     z
                                                                           small filter−kernel




     microsystems & machine vision lab          -8-         MiCRoN http://wwwipr.ira.uka.de/~micron/
Focus set based reconstruction of micro-objects- http://vision.eng.shu.ac.uk/mechrob04/MechRob-paper.pdf



                                               results




     microsystems & machine vision lab          -9-         MiCRoN http://wwwipr.ira.uka.de/~micron/
Focus set based reconstruction of micro-objects- http://vision.eng.shu.ac.uk/mechrob04/MechRob-paper.pdf



                                               results




     microsystems & machine vision lab         - 10 -        MiCRoN http://wwwipr.ira.uka.de/~micron/
Focus set based reconstruction of micro-objects- http://vision.eng.shu.ac.uk/mechrob04/MechRob-paper.pdf



                                               results




     microsystems & machine vision lab         - 11 -        MiCRoN http://wwwipr.ira.uka.de/~micron/
Focus set based reconstruction of micro-objects- http://vision.eng.shu.ac.uk/mechrob04/MechRob-paper.pdf



                                               results




     microsystems & machine vision lab         - 12 -        MiCRoN http://wwwipr.ira.uka.de/~micron/

Contenu connexe

Tendances

Effective Object Detection and Background Subtraction by using M.O.I
Effective Object Detection and Background Subtraction by using M.O.IEffective Object Detection and Background Subtraction by using M.O.I
Effective Object Detection and Background Subtraction by using M.O.I
IJMTST Journal
 

Tendances (9)

[Review] BoxInst: High-Performance Instance Segmentation with Box Annotations...
[Review] BoxInst: High-Performance Instance Segmentation with Box Annotations...[Review] BoxInst: High-Performance Instance Segmentation with Box Annotations...
[Review] BoxInst: High-Performance Instance Segmentation with Box Annotations...
 
[unofficial] Pyramid Scene Parsing Network (CVPR 2017)
[unofficial] Pyramid Scene Parsing Network (CVPR 2017)[unofficial] Pyramid Scene Parsing Network (CVPR 2017)
[unofficial] Pyramid Scene Parsing Network (CVPR 2017)
 
Survey of Super Resolution Task (SISR Only)
Survey of Super Resolution Task (SISR Only)Survey of Super Resolution Task (SISR Only)
Survey of Super Resolution Task (SISR Only)
 
Effective Object Detection and Background Subtraction by using M.O.I
Effective Object Detection and Background Subtraction by using M.O.IEffective Object Detection and Background Subtraction by using M.O.I
Effective Object Detection and Background Subtraction by using M.O.I
 
Batch normalization
Batch normalizationBatch normalization
Batch normalization
 
Deformable DETR Review [CDM]
Deformable DETR Review [CDM]Deformable DETR Review [CDM]
Deformable DETR Review [CDM]
 
Review : Prototype Mixture Models for Few-shot Semantic Segmentation
Review : Prototype Mixture Models for Few-shot Semantic SegmentationReview : Prototype Mixture Models for Few-shot Semantic Segmentation
Review : Prototype Mixture Models for Few-shot Semantic Segmentation
 
Deep Learning for Structure-from-Motion (SfM)
Deep Learning for Structure-from-Motion (SfM)Deep Learning for Structure-from-Motion (SfM)
Deep Learning for Structure-from-Motion (SfM)
 
Double-constrained RPCA based on Saliency Maps for Foreground Detection in Au...
Double-constrained RPCA based on Saliency Maps for Foreground Detection in Au...Double-constrained RPCA based on Saliency Maps for Foreground Detection in Au...
Double-constrained RPCA based on Saliency Maps for Foreground Detection in Au...
 

En vedette

The MiCRoN Project
The MiCRoN ProjectThe MiCRoN Project
The MiCRoN Project
Jan Wedekind
 
Efficient implementations of machine vision algorithms using a dynamically ty...
Efficient implementations of machine vision algorithms using a dynamically ty...Efficient implementations of machine vision algorithms using a dynamically ty...
Efficient implementations of machine vision algorithms using a dynamically ty...
Jan Wedekind
 

En vedette (7)

Play Squash with Ruby, OpenGL, and a Wiimote - ShRUG Feb 2011
Play Squash with Ruby, OpenGL, and a Wiimote - ShRUG Feb 2011Play Squash with Ruby, OpenGL, and a Wiimote - ShRUG Feb 2011
Play Squash with Ruby, OpenGL, and a Wiimote - ShRUG Feb 2011
 
Machine vision and device integration with the Ruby programming language (2008)
Machine vision and device integration with the Ruby programming language (2008)Machine vision and device integration with the Ruby programming language (2008)
Machine vision and device integration with the Ruby programming language (2008)
 
The MiCRoN Project
The MiCRoN ProjectThe MiCRoN Project
The MiCRoN Project
 
Efficient implementations of machine vision algorithms using a dynamically ty...
Efficient implementations of machine vision algorithms using a dynamically ty...Efficient implementations of machine vision algorithms using a dynamically ty...
Efficient implementations of machine vision algorithms using a dynamically ty...
 
Using Generic Image Processing Operations to Detect a Calibration Grid
Using Generic Image Processing Operations to Detect a Calibration GridUsing Generic Image Processing Operations to Detect a Calibration Grid
Using Generic Image Processing Operations to Detect a Calibration Grid
 
Advances in nutrition for squash coaches 2012
Advances in nutrition for squash coaches  2012Advances in nutrition for squash coaches  2012
Advances in nutrition for squash coaches 2012
 
Fundamentals of Computing
Fundamentals of ComputingFundamentals of Computing
Fundamentals of Computing
 

Similaire à Focus set based reconstruction of micro-objects

ETHZ CV2012: Tutorial openCV
ETHZ CV2012: Tutorial openCVETHZ CV2012: Tutorial openCV
ETHZ CV2012: Tutorial openCV
zukun
 
IJCER (www.ijceronline.com) International Journal of computational Engineerin...
IJCER (www.ijceronline.com) International Journal of computational Engineerin...IJCER (www.ijceronline.com) International Journal of computational Engineerin...
IJCER (www.ijceronline.com) International Journal of computational Engineerin...
ijceronline
 
(Research Note) Delving deeper into convolutional neural networks for camera ...
(Research Note) Delving deeper into convolutional neural networks for camera ...(Research Note) Delving deeper into convolutional neural networks for camera ...
(Research Note) Delving deeper into convolutional neural networks for camera ...
Jacky Liu
 

Similaire à Focus set based reconstruction of micro-objects (20)

Nadia2013 research
Nadia2013 researchNadia2013 research
Nadia2013 research
 
IRJET- Real-Time Object Detection using Deep Learning: A Survey
IRJET- Real-Time Object Detection using Deep Learning: A SurveyIRJET- Real-Time Object Detection using Deep Learning: A Survey
IRJET- Real-Time Object Detection using Deep Learning: A Survey
 
Poster_Final
Poster_FinalPoster_Final
Poster_Final
 
Surveillance scene classification using machine learning
Surveillance scene classification using machine learningSurveillance scene classification using machine learning
Surveillance scene classification using machine learning
 
R-FCN : object detection via region-based fully convolutional networks
R-FCN :  object detection via region-based fully convolutional networksR-FCN :  object detection via region-based fully convolutional networks
R-FCN : object detection via region-based fully convolutional networks
 
ETHZ CV2012: Tutorial openCV
ETHZ CV2012: Tutorial openCVETHZ CV2012: Tutorial openCV
ETHZ CV2012: Tutorial openCV
 
SkyStitch: a Cooperative Multi-UAV-based Real-time Video Surveillance System ...
SkyStitch: a Cooperative Multi-UAV-based Real-time Video Surveillance System ...SkyStitch: a Cooperative Multi-UAV-based Real-time Video Surveillance System ...
SkyStitch: a Cooperative Multi-UAV-based Real-time Video Surveillance System ...
 
K-Means Clustering in Moving Objects Extraction with Selective Background
K-Means Clustering in Moving Objects Extraction with Selective BackgroundK-Means Clustering in Moving Objects Extraction with Selective Background
K-Means Clustering in Moving Objects Extraction with Selective Background
 
CVGIP 2010 Part 3
CVGIP 2010 Part 3CVGIP 2010 Part 3
CVGIP 2010 Part 3
 
Fn2611681170
Fn2611681170Fn2611681170
Fn2611681170
 
“Understanding DNN-Based Object Detectors,” a Presentation from Au-Zone Techn...
“Understanding DNN-Based Object Detectors,” a Presentation from Au-Zone Techn...“Understanding DNN-Based Object Detectors,” a Presentation from Au-Zone Techn...
“Understanding DNN-Based Object Detectors,” a Presentation from Au-Zone Techn...
 
IRJET-Multiple Object Detection using Deep Neural Networks
IRJET-Multiple Object Detection using Deep Neural NetworksIRJET-Multiple Object Detection using Deep Neural Networks
IRJET-Multiple Object Detection using Deep Neural Networks
 
Fisheye/Omnidirectional View in Autonomous Driving IV
Fisheye/Omnidirectional View in Autonomous Driving IVFisheye/Omnidirectional View in Autonomous Driving IV
Fisheye/Omnidirectional View in Autonomous Driving IV
 
IJCER (www.ijceronline.com) International Journal of computational Engineerin...
IJCER (www.ijceronline.com) International Journal of computational Engineerin...IJCER (www.ijceronline.com) International Journal of computational Engineerin...
IJCER (www.ijceronline.com) International Journal of computational Engineerin...
 
IRJET- Moving Object Detection using Foreground Detection for Video Surveil...
IRJET- 	 Moving Object Detection using Foreground Detection for Video Surveil...IRJET- 	 Moving Object Detection using Foreground Detection for Video Surveil...
IRJET- Moving Object Detection using Foreground Detection for Video Surveil...
 
(Research Note) Delving deeper into convolutional neural networks for camera ...
(Research Note) Delving deeper into convolutional neural networks for camera ...(Research Note) Delving deeper into convolutional neural networks for camera ...
(Research Note) Delving deeper into convolutional neural networks for camera ...
 
Convolutional Neural Network Based Real Time Object Detection Using YOLO V4
Convolutional Neural Network Based Real Time Object Detection Using YOLO V4Convolutional Neural Network Based Real Time Object Detection Using YOLO V4
Convolutional Neural Network Based Real Time Object Detection Using YOLO V4
 
998-isvc16
998-isvc16998-isvc16
998-isvc16
 
Deep learning fundamental and Research project on IBM POWER9 system from NUS
Deep learning fundamental and Research project on IBM POWER9 system from NUSDeep learning fundamental and Research project on IBM POWER9 system from NUS
Deep learning fundamental and Research project on IBM POWER9 system from NUS
 
Visual odometry _report
Visual odometry _reportVisual odometry _report
Visual odometry _report
 

Plus de Jan Wedekind

Computer vision for microscopes
Computer vision for microscopesComputer vision for microscopes
Computer vision for microscopes
Jan Wedekind
 
Reconstruction (of micro-objects) based on focus-sets using blind deconvoluti...
Reconstruction (of micro-objects) based on focus-sets using blind deconvoluti...Reconstruction (of micro-objects) based on focus-sets using blind deconvoluti...
Reconstruction (of micro-objects) based on focus-sets using blind deconvoluti...
Jan Wedekind
 
Fokus-serien basierte Rekonstruktion von Mikroobjekten (2002)
Fokus-serien basierte Rekonstruktion von Mikroobjekten (2002)Fokus-serien basierte Rekonstruktion von Mikroobjekten (2002)
Fokus-serien basierte Rekonstruktion von Mikroobjekten (2002)
Jan Wedekind
 

Plus de Jan Wedekind (11)

The SOLID Principles for Software Design
The SOLID Principles for Software DesignThe SOLID Principles for Software Design
The SOLID Principles for Software Design
 
Computer vision for microscopes
Computer vision for microscopesComputer vision for microscopes
Computer vision for microscopes
 
Reconstruction (of micro-objects) based on focus-sets using blind deconvoluti...
Reconstruction (of micro-objects) based on focus-sets using blind deconvoluti...Reconstruction (of micro-objects) based on focus-sets using blind deconvoluti...
Reconstruction (of micro-objects) based on focus-sets using blind deconvoluti...
 
Fokus-serien basierte Rekonstruktion von Mikroobjekten (2002)
Fokus-serien basierte Rekonstruktion von Mikroobjekten (2002)Fokus-serien basierte Rekonstruktion von Mikroobjekten (2002)
Fokus-serien basierte Rekonstruktion von Mikroobjekten (2002)
 
Digital Imaging with Free Software - Talk at Sheffield Astronomical Society J...
Digital Imaging with Free Software - Talk at Sheffield Astronomical Society J...Digital Imaging with Free Software - Talk at Sheffield Astronomical Society J...
Digital Imaging with Free Software - Talk at Sheffield Astronomical Society J...
 
Machine Vision made easy with Ruby - ShRUG June 2010
Machine Vision made easy with Ruby - ShRUG June 2010Machine Vision made easy with Ruby - ShRUG June 2010
Machine Vision made easy with Ruby - ShRUG June 2010
 
Computer Vision using Ruby and libJIT - RubyConf 2009
Computer Vision using Ruby and libJIT - RubyConf 2009Computer Vision using Ruby and libJIT - RubyConf 2009
Computer Vision using Ruby and libJIT - RubyConf 2009
 
Real-time Computer Vision With Ruby - OSCON 2008
Real-time Computer Vision With Ruby - OSCON 2008Real-time Computer Vision With Ruby - OSCON 2008
Real-time Computer Vision With Ruby - OSCON 2008
 
Object Recognition and Real-Time Tracking in Microscope Imaging - IMVIP 2006
Object Recognition and Real-Time Tracking in Microscope Imaging - IMVIP 2006Object Recognition and Real-Time Tracking in Microscope Imaging - IMVIP 2006
Object Recognition and Real-Time Tracking in Microscope Imaging - IMVIP 2006
 
Steerable Filters generated with the Hypercomplex Dual-Tree Wavelet Transform...
Steerable Filters generated with the Hypercomplex Dual-Tree Wavelet Transform...Steerable Filters generated with the Hypercomplex Dual-Tree Wavelet Transform...
Steerable Filters generated with the Hypercomplex Dual-Tree Wavelet Transform...
 
Ruby & Machine Vision - Talk at Sheffield Hallam University Feb 2009
Ruby & Machine Vision - Talk at Sheffield Hallam University Feb 2009Ruby & Machine Vision - Talk at Sheffield Hallam University Feb 2009
Ruby & Machine Vision - Talk at Sheffield Hallam University Feb 2009
 

Dernier

Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Dernier (20)

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 

Focus set based reconstruction of micro-objects

  • 1. Focus set based reconstruction of micro-objects- http://vision.eng.shu.ac.uk/mechrob04/MechRob-paper.pdf Focus set based reconstruction of micro-objects Jan Wedekind 13.9.2004 MiCRoN http://wwwipr.ira.uka.de/~micron/ MMVL http://www.shu.ac.uk/mmvl/ People: Balasundram Amavasai, Manuel Boissenin, Axel B¨rkle, u Fabio Caparrelli, Arul Selvan, Jon Travis microsystems & machine vision lab -1- MiCRoN http://wwwipr.ira.uka.de/~micron/
  • 2. Focus set based reconstruction of micro-objects- http://vision.eng.shu.ac.uk/mechrob04/MechRob-paper.pdf micro-vision and micro-robotics Closed-loop control • Estimate pose of manipulator in real time Task planning • Estimate pose of known micro-objects • Recognize obstacles for avoiding collisions • Provide data for determining gripping points microsystems & machine vision lab -2- MiCRoN http://wwwipr.ira.uka.de/~micron/
  • 3. Focus set based reconstruction of micro-objects- http://vision.eng.shu.ac.uk/mechrob04/MechRob-paper.pdf present state of micro-vision characteristics • Limited depth of focus • Teleoptical settings vision problems • unstable feature extraction • limited depth of view ⇒ most standard approaches are failing microsystems & machine vision lab -3- MiCRoN http://wwwipr.ira.uka.de/~micron/
  • 4. Focus set based reconstruction of micro-objects- http://vision.eng.shu.ac.uk/mechrob04/MechRob-paper.pdf spin images (Andrew Johnson 1997) microsystems & machine vision lab -4- MiCRoN http://wwwipr.ira.uka.de/~micron/
  • 5. Focus set based reconstruction of micro-objects- http://vision.eng.shu.ac.uk/mechrob04/MechRob-paper.pdf spin images (Andrew Johnson 1997) microsystems & machine vision lab -5- MiCRoN http://wwwipr.ira.uka.de/~micron/
  • 6. Focus set based reconstruction of micro-objects- http://vision.eng.shu.ac.uk/mechrob04/MechRob-paper.pdf depth of focus • Acquire focus set of images g(x1 , x2 , z) • Compute local sharpness measure s(x1 , x2 , z) • Compute depth map d(x1 , x2 ) := argmax s(x1 , x2 , z) z∈Z microsystems & machine vision lab -6- MiCRoN http://wwwipr.ira.uka.de/~micron/
  • 7. Focus set based reconstruction of micro-objects- http://vision.eng.shu.ac.uk/mechrob04/MechRob-paper.pdf systematic error test with micro-ridge • Algorithm fails when contrast low • Systematic errors • Trade-off between resolution and stability ⇒ Filter-bench image index z insufficient contrast PSF d c b a pixel−position in image y d c systematic error microsystems & machine vision lab -7- MiCRoN http://wwwipr.ira.uka.de/~micron/
  • 8. Focus set based reconstruction of micro-objects- http://vision.eng.shu.ac.uk/mechrob04/MechRob-paper.pdf multiscale approach s maximum sharpness • Recursive filtering • Not real-time efficient z large filter kernel • Complexity s (N = number of pixel) – O(N ) time – O(N ) memory z √ 2 medium−sized filter kernel – 3 N O(N 3 ) s parallelisation • No systematic error image (x1,x2) z small filter−kernel microsystems & machine vision lab -8- MiCRoN http://wwwipr.ira.uka.de/~micron/
  • 9. Focus set based reconstruction of micro-objects- http://vision.eng.shu.ac.uk/mechrob04/MechRob-paper.pdf results microsystems & machine vision lab -9- MiCRoN http://wwwipr.ira.uka.de/~micron/
  • 10. Focus set based reconstruction of micro-objects- http://vision.eng.shu.ac.uk/mechrob04/MechRob-paper.pdf results microsystems & machine vision lab - 10 - MiCRoN http://wwwipr.ira.uka.de/~micron/
  • 11. Focus set based reconstruction of micro-objects- http://vision.eng.shu.ac.uk/mechrob04/MechRob-paper.pdf results microsystems & machine vision lab - 11 - MiCRoN http://wwwipr.ira.uka.de/~micron/
  • 12. Focus set based reconstruction of micro-objects- http://vision.eng.shu.ac.uk/mechrob04/MechRob-paper.pdf results microsystems & machine vision lab - 12 - MiCRoN http://wwwipr.ira.uka.de/~micron/