SlideShare une entreprise Scribd logo
1  sur  19
Project Presentation
How to detect vanishing points
on architectural scenes
PERNEY Benjamin - 20121
Contents
• Why compute vanishing points ?
• Application on architectural scenes
• What is a vanishing point ?
• Chasles-Steiner theorem
• Algorithm
• Results
• Summary & conclusion
PERNEY Benjamin - 20122
Vanishing points :
Why ?
PERNEY Benjamin - 20123
2D image : 3D information LOST• Real life : Parallel lines
• Environments created by humans contains many parallel lines
Vanishing points :
Why ?
• Providing strong information about 3D
structure of a scene (Best way)
• Applications :
– Camera calibration
– Augmented Reality
– Create 3D map
– Help land surveyor to
align buildings
PERNEY Benjamin - 20124
• Compute the photo orientation
Vertical of the scene
• Minimize the error
High numbers of segments
Purpose :
Application on architectural scene
PERNEY Benjamin - 20125
Allows to :
Vanishing points :
What is it ?
PERNEY Benjamin - 20126
2D image : Converging linesReal life : Parallel lines
Vanishing point
Vanishing line
Related works
• Different methods were proposed :
– Gaussian sphere : more accurate but complex
– Projective Geometry approach
• Chasles-Steiner theorem :
PERNEY Benjamin - 20127
« An homography between two
bundles of converging lines define
a conic section, and reciprocally »
Algorithm steps
PERNEY Benjamin - 20128
1. Extract segments
• Based on Canny-Deriche detection
2. Transform segments in points
• Apply the Chasles-Steiner theorem
3. Extract circles among previous points found
• RanSac method adapted
4. Compute coordinates of the vanishing points
2 steps :
-Smoothing
- Calculation of magnitude and gradient direction
- Non-maximum suppression
- Hysteresis thresholding
Extract segments
Canny-Deriche
detection
Local maxima
detection
Polygonization
PERNEY Benjamin - 20129
4th step : Thanks to the circle parameters (especially, center coordinates),
We can determine the vanishing points as the opposite point of the image origin
Chasles-Steiner Theorem
• Applied to vanishing points computing :
PERNEY Benjamin - 201210
O
P
C
Image
H1
H2
H3
S1
S2
S3
1st step : Thanks to the segments, compute the carrier lines2nd step : H points are computed : OH and Segments should make a 90° angle3rd step : A circle is found passing through the H points
Chasles-Steiner Theorem
PERNEY Benjamin - 201211
Extract circles
RanSac method
PERNEY Benjamin - 201212
O
2. Compute the circle which intersect the 2 points and O1. Two points H are chosen randomly among all3. Create a band of epsilon size and count the number of H points inside4. Repeat steps 1 to 3 many times5. Keep in memory the 2 H points and captured points
-> Remove them from the beginning ensemble and iterate
Compute the P coordinates
• XP = 2 x Xc
• YP = 2 x Yc
• We could compute uncertainty with the variance-covariance matrix
PERNEY Benjamin - 201213
O
P
C
Results
• On 100 different images :
PERNEY Benjamin - 201214
Pourcentage of correct
detection of the vertical
vanishing point
100%
Pourcentage of correct
detection of the horizontal
vanishing points
92%
Good performance
Results
• Issues :
– Segments near to the origin -> the H point
position will change a lot the circle
– Noisy image : edge detection not precise
– Complex architectures whith many curves
PERNEY Benjamin - 201215
Results & improvements
PERNEY Benjamin - 201216
Summary
PERNEY Benjamin - 201217
(a) (b)
(c) (d)
Bibliography
• Automatic detection of vanishing points and
their uncertainty based on projective
geometry, M. Kalantari, F. Jung, JP. Guédon, N.
Paparoditis
• Détéction entièrement automatique de points
de fuite dans des scènes architecturales
urbaines, M. Kalantari, F. Jung
• A new Approach to Vanishing Point Detection
in Architectural Environments, Carsten Rother
PERNEY Benjamin - 201218
Conclusion
• Interesting and contemporary subject
• What’s next : Smartphone applications etc.
SOME QUESTIONS ?
PERNEY Benjamin - 201219

Contenu connexe

Similaire à How to detect vanishing points on architectural scenes ?

Angel6E25educationmaterial for reference
Angel6E25educationmaterial for referenceAngel6E25educationmaterial for reference
Angel6E25educationmaterial for reference
kanchang3684
 
Stixel based real time object detection for ADAS using surface normal
Stixel based real time object detection for ADAS using surface normalStixel based real time object detection for ADAS using surface normal
Stixel based real time object detection for ADAS using surface normal
TaeKang Woo
 
A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...
A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...
A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...
grssieee
 
A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...
A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...
A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...
grssieee
 
A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...
A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...
A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...
grssieee
 
A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...
A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...
A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...
grssieee
 

Similaire à How to detect vanishing points on architectural scenes ? (20)

Two marks with answers ME6501 CAD
Two marks with answers ME6501 CADTwo marks with answers ME6501 CAD
Two marks with answers ME6501 CAD
 
Computer Vision - Single View
Computer Vision - Single ViewComputer Vision - Single View
Computer Vision - Single View
 
Lecture 6-computer vision features descriptors matching
Lecture 6-computer vision features descriptors matchingLecture 6-computer vision features descriptors matching
Lecture 6-computer vision features descriptors matching
 
Computer Vision panoramas
Computer Vision  panoramasComputer Vision  panoramas
Computer Vision panoramas
 
05_optics.ppt
05_optics.ppt05_optics.ppt
05_optics.ppt
 
05_optics.ppt
05_optics.ppt05_optics.ppt
05_optics.ppt
 
05_optics.ppt
05_optics.ppt05_optics.ppt
05_optics.ppt
 
Angel6E25educationmaterial for reference
Angel6E25educationmaterial for referenceAngel6E25educationmaterial for reference
Angel6E25educationmaterial for reference
 
Fisheye Omnidirectional View in Autonomous Driving II
Fisheye Omnidirectional View in Autonomous Driving IIFisheye Omnidirectional View in Autonomous Driving II
Fisheye Omnidirectional View in Autonomous Driving II
 
Stixel based real time object detection for ADAS using surface normal
Stixel based real time object detection for ADAS using surface normalStixel based real time object detection for ADAS using surface normal
Stixel based real time object detection for ADAS using surface normal
 
cv1.ppt
cv1.pptcv1.ppt
cv1.ppt
 
A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...
A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...
A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...
 
A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...
A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...
A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...
 
A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...
A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...
A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...
 
A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...
A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...
A SELF-ADJUSTIVE GEOMETRIC CORRECTION METHOD FOR SERIOUSLY OBLIQUE AERO IMAGE...
 
Lecture24
Lecture24Lecture24
Lecture24
 
Cameras
CamerasCameras
Cameras
 
Lec13 stereo converted
Lec13 stereo convertedLec13 stereo converted
Lec13 stereo converted
 
Schematic eye and cardinal points
Schematic eye and cardinal pointsSchematic eye and cardinal points
Schematic eye and cardinal points
 
Passive stereo vision with deep learning
Passive stereo vision with deep learningPassive stereo vision with deep learning
Passive stereo vision with deep learning
 

Dernier

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Dernier (20)

Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 

How to detect vanishing points on architectural scenes ?

  • 1. Project Presentation How to detect vanishing points on architectural scenes PERNEY Benjamin - 20121
  • 2. Contents • Why compute vanishing points ? • Application on architectural scenes • What is a vanishing point ? • Chasles-Steiner theorem • Algorithm • Results • Summary & conclusion PERNEY Benjamin - 20122
  • 3. Vanishing points : Why ? PERNEY Benjamin - 20123 2D image : 3D information LOST• Real life : Parallel lines • Environments created by humans contains many parallel lines
  • 4. Vanishing points : Why ? • Providing strong information about 3D structure of a scene (Best way) • Applications : – Camera calibration – Augmented Reality – Create 3D map – Help land surveyor to align buildings PERNEY Benjamin - 20124
  • 5. • Compute the photo orientation Vertical of the scene • Minimize the error High numbers of segments Purpose : Application on architectural scene PERNEY Benjamin - 20125 Allows to :
  • 6. Vanishing points : What is it ? PERNEY Benjamin - 20126 2D image : Converging linesReal life : Parallel lines Vanishing point Vanishing line
  • 7. Related works • Different methods were proposed : – Gaussian sphere : more accurate but complex – Projective Geometry approach • Chasles-Steiner theorem : PERNEY Benjamin - 20127 « An homography between two bundles of converging lines define a conic section, and reciprocally »
  • 8. Algorithm steps PERNEY Benjamin - 20128 1. Extract segments • Based on Canny-Deriche detection 2. Transform segments in points • Apply the Chasles-Steiner theorem 3. Extract circles among previous points found • RanSac method adapted 4. Compute coordinates of the vanishing points
  • 9. 2 steps : -Smoothing - Calculation of magnitude and gradient direction - Non-maximum suppression - Hysteresis thresholding Extract segments Canny-Deriche detection Local maxima detection Polygonization PERNEY Benjamin - 20129
  • 10. 4th step : Thanks to the circle parameters (especially, center coordinates), We can determine the vanishing points as the opposite point of the image origin Chasles-Steiner Theorem • Applied to vanishing points computing : PERNEY Benjamin - 201210 O P C Image H1 H2 H3 S1 S2 S3 1st step : Thanks to the segments, compute the carrier lines2nd step : H points are computed : OH and Segments should make a 90° angle3rd step : A circle is found passing through the H points
  • 12. Extract circles RanSac method PERNEY Benjamin - 201212 O 2. Compute the circle which intersect the 2 points and O1. Two points H are chosen randomly among all3. Create a band of epsilon size and count the number of H points inside4. Repeat steps 1 to 3 many times5. Keep in memory the 2 H points and captured points -> Remove them from the beginning ensemble and iterate
  • 13. Compute the P coordinates • XP = 2 x Xc • YP = 2 x Yc • We could compute uncertainty with the variance-covariance matrix PERNEY Benjamin - 201213 O P C
  • 14. Results • On 100 different images : PERNEY Benjamin - 201214 Pourcentage of correct detection of the vertical vanishing point 100% Pourcentage of correct detection of the horizontal vanishing points 92% Good performance
  • 15. Results • Issues : – Segments near to the origin -> the H point position will change a lot the circle – Noisy image : edge detection not precise – Complex architectures whith many curves PERNEY Benjamin - 201215
  • 16. Results & improvements PERNEY Benjamin - 201216
  • 17. Summary PERNEY Benjamin - 201217 (a) (b) (c) (d)
  • 18. Bibliography • Automatic detection of vanishing points and their uncertainty based on projective geometry, M. Kalantari, F. Jung, JP. Guédon, N. Paparoditis • Détéction entièrement automatique de points de fuite dans des scènes architecturales urbaines, M. Kalantari, F. Jung • A new Approach to Vanishing Point Detection in Architectural Environments, Carsten Rother PERNEY Benjamin - 201218
  • 19. Conclusion • Interesting and contemporary subject • What’s next : Smartphone applications etc. SOME QUESTIONS ? PERNEY Benjamin - 201219