SlideShare une entreprise Scribd logo
1  sur  21
Towards Auto-Extracting
Car Park Structures:
Image Processing
Approach on Low
Powered Devices
Ian K.T.Tan, Poo Kuan Hoong andYap
Chin Hong
Multimedia University
Introduction
Problem
• Time wasted for motorist to search for available car
park space.
– Leads to traffic congestion, wastage of resources in the
process.
– Inefficient use of available car parks.
• Implementation of digital signages coupled with
sensors are expensive and complicated
– No effective delivery of this information from car park
management to the motorists.
– Localized signage, only viewable in the vicinity.
• Integrated car park management system for open
car park such as recreational parks or stadiums would
be unjustifiable
Research Area
• There have been numerous interests in the
area of detecting availability of car park
bay using image processing techniques.
• An area that has been neglected in doing
so is the initial calibration of the image
capturing device.
– On determining the car park structures
• We propose a technique that attempts to
address this issue
– using the limited processing capabilities of
embedded systems.
References 1 – 13.
Extracting Car Park Structures
• Considerable works have been conducted on
extracting car park structures. However, many of
them (Cheng et al., 2014) (Seo & Urmson, 2009)
(Tong et al., 2014) (Tschentscher et al, 2013) are
from images captured from an aerial view.
– This will incur significant cost, and
– Unrealistic for commercial implementations
• Another approach would be to conduct scene
determination using object identification
(Felzenszwalb et al., 2010) (Schneiderman &
Kanade, 2004).
– The computational resource requirements to conduct
object identification will not be easily achieved on low
powered devices.
References 18 - 22.
References 23 - 24.
Method
Actual Image from the System
• Low cost (initial and maintenance)
solution for open space car park using low
powered devices,
– Remove the need of manual mapping of the
car park structures for each installation of the
camera.
– Reduce the need to re-calibrate the device due
to movement.
• Two main process involved
– Pre-processing to produce a binary image, and
– Car park structure extraction.
Hardware
• Raspberry Pi Model B+
• Raspberry Pi Camera
• 8GB SD Card
Software
• RaspbianWheezy
• GNU C++ Compiler
• OpenCV 2.4.4
Tools
Image Pro-processing
Original RGB
Image
RGB Grayscale
Conversion
Background
subtraction
Denoise
(smoother
filtering,
thresholding,
dilation filtering)
Binary image
output
Extraction Method
HoughlineP Algorithm will detect
numerous lines, from which they are
used to determine the corners
A FitLine algorithm is then used to
“connect the dots (corners)”. This is
done for two axes.
From the lines, the FindSquare which is
technically find the “trapeziums” in the
images and finally a MergeSquare
algorithm is applied which is heuristics
based on adjacent “squares” that may
be a single square.
Results
• Applied to images downloaded from the
Internet for testing
– Different image sizes
– From approximately “lamp post” angle
– The car park structures of interest are the nearest
rows only
• Results vary from 25% to greater than 90%
Current Limitations and Conclusion
• Robust solution but is still work in progress to achieve acceptable
consistent accuracy rates.
• Current limitations of the solution
– The image has to be taken at approximately right angles in order for the lines to be
drawn appropriately.
– The angle of the image has to be taken from approximately between 30º to 60º.
– The physical car park structure lines demarcations are required.
• Future Plans
– Multi-camera aggregation method where results from multiple cameras are taken
into consideration in order to determine the car park structures.
• Initial results shows improvement.
– In funding proposal stage for alternative approach.
Sample Process
A more detailed output graphically of each stage of the process
Original Image
Binary Image
Pixel SegmentationTechnique
Line Detection
Corner Detection
Linking the Corners
Square Box Mapping
Merged (from multiple cameras) Boxes Mapped to
Original Image
ThankYou

Contenu connexe

En vedette

09 uniform circular motion
09 uniform circular motion09 uniform circular motion
09 uniform circular motion
IZZUDIN IBRAHIM
 
RFID based car parking system-final ver
RFID based car parking system-final verRFID based car parking system-final ver
RFID based car parking system-final ver
Debasis Nayak
 

En vedette (13)

Vertical Rotary Parking System by Park Layer Pvt Ltd, Coimbatore
Vertical Rotary Parking System by Park Layer Pvt Ltd, CoimbatoreVertical Rotary Parking System by Park Layer Pvt Ltd, Coimbatore
Vertical Rotary Parking System by Park Layer Pvt Ltd, Coimbatore
 
Car Park Design- David tittle, Design Review
Car Park Design- David tittle, Design ReviewCar Park Design- David tittle, Design Review
Car Park Design- David tittle, Design Review
 
09 uniform circular motion
09 uniform circular motion09 uniform circular motion
09 uniform circular motion
 
PPT OF MLCP
PPT OF MLCPPPT OF MLCP
PPT OF MLCP
 
CAR PARK VENTILATION CFD SERVICES - CAEDTECH
CAR PARK VENTILATION CFD SERVICES - CAEDTECHCAR PARK VENTILATION CFD SERVICES - CAEDTECH
CAR PARK VENTILATION CFD SERVICES - CAEDTECH
 
parking problems in metro cities
parking problems in metro citiesparking problems in metro cities
parking problems in metro cities
 
Customer Churn Analytics using Microsoft R Open
Customer Churn Analytics using Microsoft R OpenCustomer Churn Analytics using Microsoft R Open
Customer Churn Analytics using Microsoft R Open
 
Parking final
Parking finalParking final
Parking final
 
Car parking
Car parkingCar parking
Car parking
 
Car park 02
Car park 02Car park 02
Car park 02
 
Smart parking
Smart parkingSmart parking
Smart parking
 
RFID based car parking system-final ver
RFID based car parking system-final verRFID based car parking system-final ver
RFID based car parking system-final ver
 
Pheonix shopping mall
Pheonix shopping mall Pheonix shopping mall
Pheonix shopping mall
 

Similaire à Towards Auto-Extracting Car Park Structures: Image Processing Approach on Low Powered Devices

Reverse engineering & its application
Reverse engineering & its applicationReverse engineering & its application
Reverse engineering & its application
mapqrs
 
Portfolio - Ramsundar K G
Portfolio - Ramsundar K GPortfolio - Ramsundar K G
Portfolio - Ramsundar K G
Ramsundar K G
 
ravi reverseengineeringitsapplication01 121101044845-phpapp02
ravi reverseengineeringitsapplication01 121101044845-phpapp02ravi reverseengineeringitsapplication01 121101044845-phpapp02
ravi reverseengineeringitsapplication01 121101044845-phpapp02
Akash Maurya
 
traffic jam detection using image processing
traffic jam detection using image processingtraffic jam detection using image processing
traffic jam detection using image processing
Malika Alix
 

Similaire à Towards Auto-Extracting Car Park Structures: Image Processing Approach on Low Powered Devices (20)

TRAFFIC MANAGEMENT THROUGH SATELLITE IMAGING-- Part 3
TRAFFIC MANAGEMENT THROUGH SATELLITE IMAGING-- Part 3TRAFFIC MANAGEMENT THROUGH SATELLITE IMAGING-- Part 3
TRAFFIC MANAGEMENT THROUGH SATELLITE IMAGING-- Part 3
 
FINAL PPT ALL.pptx
FINAL PPT ALL.pptxFINAL PPT ALL.pptx
FINAL PPT ALL.pptx
 
Reverse engineering & its application
Reverse engineering & its applicationReverse engineering & its application
Reverse engineering & its application
 
ANALYSIS OF INSTANCE SEGMENTATION APPROACH FOR LANE DETECTION
ANALYSIS OF INSTANCE SEGMENTATION APPROACH FOR LANE DETECTIONANALYSIS OF INSTANCE SEGMENTATION APPROACH FOR LANE DETECTION
ANALYSIS OF INSTANCE SEGMENTATION APPROACH FOR LANE DETECTION
 
Self Driving Car
Self Driving CarSelf Driving Car
Self Driving Car
 
Identifying Parking Spots from Surveillance Cameras using CNN
Identifying Parking Spots from Surveillance Cameras using CNNIdentifying Parking Spots from Surveillance Cameras using CNN
Identifying Parking Spots from Surveillance Cameras using CNN
 
High quality single shot capture of facial geometry
High quality single shot capture of facial geometryHigh quality single shot capture of facial geometry
High quality single shot capture of facial geometry
 
IRJET- Parking Space Detection using Image Processing in MATLAB
IRJET- Parking Space Detection using Image Processing in MATLABIRJET- Parking Space Detection using Image Processing in MATLAB
IRJET- Parking Space Detection using Image Processing in MATLAB
 
Fisheye/Omnidirectional View in Autonomous Driving V
Fisheye/Omnidirectional View in Autonomous Driving VFisheye/Omnidirectional View in Autonomous Driving V
Fisheye/Omnidirectional View in Autonomous Driving V
 
Portfolio - Ramsundar K G
Portfolio - Ramsundar K GPortfolio - Ramsundar K G
Portfolio - Ramsundar K G
 
Deep reinforcement learning framework for autonomous driving
Deep reinforcement learning framework for autonomous drivingDeep reinforcement learning framework for autonomous driving
Deep reinforcement learning framework for autonomous driving
 
Photovoltaic Systems: System Design Tools
Photovoltaic Systems: System Design ToolsPhotovoltaic Systems: System Design Tools
Photovoltaic Systems: System Design Tools
 
IRJET - Traffic Density Estimation by Counting Vehicles using Aggregate Chann...
IRJET - Traffic Density Estimation by Counting Vehicles using Aggregate Chann...IRJET - Traffic Density Estimation by Counting Vehicles using Aggregate Chann...
IRJET - Traffic Density Estimation by Counting Vehicles using Aggregate Chann...
 
Automated Testing of Autonomous Driving Assistance Systems
Automated Testing of Autonomous Driving Assistance SystemsAutomated Testing of Autonomous Driving Assistance Systems
Automated Testing of Autonomous Driving Assistance Systems
 
ravi reverseengineeringitsapplication01 121101044845-phpapp02
ravi reverseengineeringitsapplication01 121101044845-phpapp02ravi reverseengineeringitsapplication01 121101044845-phpapp02
ravi reverseengineeringitsapplication01 121101044845-phpapp02
 
Improving Resource Utilization in Cloud using Application Placement Heuristics
Improving Resource Utilization in Cloud using Application Placement HeuristicsImproving Resource Utilization in Cloud using Application Placement Heuristics
Improving Resource Utilization in Cloud using Application Placement Heuristics
 
Simultaneous Mapping and Navigation For Rendezvous in Space Applications
Simultaneous Mapping and Navigation For Rendezvous in Space ApplicationsSimultaneous Mapping and Navigation For Rendezvous in Space Applications
Simultaneous Mapping and Navigation For Rendezvous in Space Applications
 
traffic jam detection using image processing
traffic jam detection using image processingtraffic jam detection using image processing
traffic jam detection using image processing
 
Achieving Scalability in Software Testing with Machine Learning and Metaheuri...
Achieving Scalability in Software Testing with Machine Learning and Metaheuri...Achieving Scalability in Software Testing with Machine Learning and Metaheuri...
Achieving Scalability in Software Testing with Machine Learning and Metaheuri...
 
project final ppt.pptx
project final ppt.pptxproject final ppt.pptx
project final ppt.pptx
 

Plus de Poo Kuan Hoong

Plus de Poo Kuan Hoong (20)

Build an efficient Machine Learning model with LightGBM
Build an efficient Machine Learning model with LightGBMBuild an efficient Machine Learning model with LightGBM
Build an efficient Machine Learning model with LightGBM
 
Tensor flow 2.0 what's new
Tensor flow 2.0  what's newTensor flow 2.0  what's new
Tensor flow 2.0 what's new
 
The future outlook and the path to be Data Scientist
The future outlook and the path to be Data ScientistThe future outlook and the path to be Data Scientist
The future outlook and the path to be Data Scientist
 
Data Driven Organization and Data Commercialization
Data Driven Organization and Data CommercializationData Driven Organization and Data Commercialization
Data Driven Organization and Data Commercialization
 
TensorFlow and Keras: An Overview
TensorFlow and Keras: An OverviewTensorFlow and Keras: An Overview
TensorFlow and Keras: An Overview
 
Explore and Have Fun with TensorFlow: Transfer Learning
Explore and Have Fun with TensorFlow: Transfer LearningExplore and Have Fun with TensorFlow: Transfer Learning
Explore and Have Fun with TensorFlow: Transfer Learning
 
Deep Learning with R
Deep Learning with RDeep Learning with R
Deep Learning with R
 
Explore and have fun with TensorFlow: An introductory to TensorFlow
Explore and have fun with TensorFlow: An introductory	to TensorFlowExplore and have fun with TensorFlow: An introductory	to TensorFlow
Explore and have fun with TensorFlow: An introductory to TensorFlow
 
The path to be a Data Scientist
The path to be a Data ScientistThe path to be a Data Scientist
The path to be a Data Scientist
 
Deep Learning with Microsoft R Open
Deep Learning with Microsoft R OpenDeep Learning with Microsoft R Open
Deep Learning with Microsoft R Open
 
Microsoft APAC Machine Learning & Data Science Community Bootcamp
Microsoft APAC Machine Learning & Data Science Community BootcampMicrosoft APAC Machine Learning & Data Science Community Bootcamp
Microsoft APAC Machine Learning & Data Science Community Bootcamp
 
Machine Learning and Deep Learning with R
Machine Learning and Deep Learning with RMachine Learning and Deep Learning with R
Machine Learning and Deep Learning with R
 
The path to be a data scientist
The path to be a data scientistThe path to be a data scientist
The path to be a data scientist
 
MDEC Data Matters Series: machine learning and Deep Learning, A Primer
MDEC Data Matters Series: machine learning and Deep Learning, A PrimerMDEC Data Matters Series: machine learning and Deep Learning, A Primer
MDEC Data Matters Series: machine learning and Deep Learning, A Primer
 
Big Data Malaysia - A Primer on Deep Learning
Big Data Malaysia - A Primer on Deep LearningBig Data Malaysia - A Primer on Deep Learning
Big Data Malaysia - A Primer on Deep Learning
 
Handwritten Recognition using Deep Learning with R
Handwritten Recognition using Deep Learning with RHandwritten Recognition using Deep Learning with R
Handwritten Recognition using Deep Learning with R
 
An Introduction to Deep Learning
An Introduction to Deep LearningAn Introduction to Deep Learning
An Introduction to Deep Learning
 
Machine learning and big data
Machine learning and big dataMachine learning and big data
Machine learning and big data
 
DSRLab seminar Introduction to deep learning
DSRLab seminar   Introduction to deep learningDSRLab seminar   Introduction to deep learning
DSRLab seminar Introduction to deep learning
 
Context Aware Road Traffic Speech Information System from Social Media
Context Aware Road Traffic Speech Information System from Social MediaContext Aware Road Traffic Speech Information System from Social Media
Context Aware Road Traffic Speech Information System from Social Media
 

Dernier

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Victor Rentea
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Dernier (20)

presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 

Towards Auto-Extracting Car Park Structures: Image Processing Approach on Low Powered Devices

  • 1. Towards Auto-Extracting Car Park Structures: Image Processing Approach on Low Powered Devices Ian K.T.Tan, Poo Kuan Hoong andYap Chin Hong Multimedia University
  • 3. Problem • Time wasted for motorist to search for available car park space. – Leads to traffic congestion, wastage of resources in the process. – Inefficient use of available car parks. • Implementation of digital signages coupled with sensors are expensive and complicated – No effective delivery of this information from car park management to the motorists. – Localized signage, only viewable in the vicinity. • Integrated car park management system for open car park such as recreational parks or stadiums would be unjustifiable
  • 4. Research Area • There have been numerous interests in the area of detecting availability of car park bay using image processing techniques. • An area that has been neglected in doing so is the initial calibration of the image capturing device. – On determining the car park structures • We propose a technique that attempts to address this issue – using the limited processing capabilities of embedded systems. References 1 – 13.
  • 5. Extracting Car Park Structures • Considerable works have been conducted on extracting car park structures. However, many of them (Cheng et al., 2014) (Seo & Urmson, 2009) (Tong et al., 2014) (Tschentscher et al, 2013) are from images captured from an aerial view. – This will incur significant cost, and – Unrealistic for commercial implementations • Another approach would be to conduct scene determination using object identification (Felzenszwalb et al., 2010) (Schneiderman & Kanade, 2004). – The computational resource requirements to conduct object identification will not be easily achieved on low powered devices. References 18 - 22. References 23 - 24.
  • 6. Method Actual Image from the System • Low cost (initial and maintenance) solution for open space car park using low powered devices, – Remove the need of manual mapping of the car park structures for each installation of the camera. – Reduce the need to re-calibrate the device due to movement. • Two main process involved – Pre-processing to produce a binary image, and – Car park structure extraction.
  • 7. Hardware • Raspberry Pi Model B+ • Raspberry Pi Camera • 8GB SD Card Software • RaspbianWheezy • GNU C++ Compiler • OpenCV 2.4.4 Tools
  • 8. Image Pro-processing Original RGB Image RGB Grayscale Conversion Background subtraction Denoise (smoother filtering, thresholding, dilation filtering) Binary image output
  • 9. Extraction Method HoughlineP Algorithm will detect numerous lines, from which they are used to determine the corners A FitLine algorithm is then used to “connect the dots (corners)”. This is done for two axes. From the lines, the FindSquare which is technically find the “trapeziums” in the images and finally a MergeSquare algorithm is applied which is heuristics based on adjacent “squares” that may be a single square.
  • 10. Results • Applied to images downloaded from the Internet for testing – Different image sizes – From approximately “lamp post” angle – The car park structures of interest are the nearest rows only • Results vary from 25% to greater than 90%
  • 11. Current Limitations and Conclusion • Robust solution but is still work in progress to achieve acceptable consistent accuracy rates. • Current limitations of the solution – The image has to be taken at approximately right angles in order for the lines to be drawn appropriately. – The angle of the image has to be taken from approximately between 30º to 60º. – The physical car park structure lines demarcations are required. • Future Plans – Multi-camera aggregation method where results from multiple cameras are taken into consideration in order to determine the car park structures. • Initial results shows improvement. – In funding proposal stage for alternative approach.
  • 12. Sample Process A more detailed output graphically of each stage of the process
  • 20. Merged (from multiple cameras) Boxes Mapped to Original Image