SlideShare une entreprise Scribd logo
1  sur  4
Télécharger pour lire hors ligne
International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 09 Issue: 03 | Mar 2022 www.irjet.net p-ISSN: 2395-0072
© 2022, IRJET | Impact Factor value: 7.529 | ISO 9001:2008 Certified Journal | Page 592
Social Distance Detector Using Computer Vision, OpenCV and YOLO
Deep Learning Algorithm
Suyash Paradkar1, Shreya Tekade2, Komal Ganatra3, Saloni Sarwade4, Prof. Rahul Bhole5
1,2,3,4B.E. Students, Department of IT, Zeal College of Engineering and Research, Maharashtra, India
5Professor, Department of IT, Zeal College of Engineering and Research, Maharashtra, India
---------------------------------------------------------------------***----------------------------------------------------------------------
Abstract – This paper presents a method of detecting social
distance using concepts like computer vision, OpenCV and
YOLO deep learning algorithm among people to detect and
control the spread of infectious disease like corona virus
(covid-19). By using a pre-recorded video as input, the
computer screen as output stream and OpenCV using YOLO
algorithm we can tell if people are following social distancing
or not. These types of implementations have been successful
but due to speed issues of the computer on which these models
are run, we can generate accurate results.
Hence by using CUDA we can increase the performance of the
model by utilizing the computing power of GPU which is
available in most of the systems. It has great uses in
applications like CCTV cameras, security cameras, web
camera-based systems etc., and it can detect activity of people
in real time. It has great use in automation side.
Our system is able to monitor people and tell us whether they
are following the rules of safe distancing or not. It can detect
whether distance between 2 people is at least 1 meter or not.
Keywords: Social Distance Detector, Computer Vision,
OpenCV, YOLO, CUDA
1.INTRODUCTION
Covid-19 is caused by the SARS-CoV-2 virus. It can cause
different ranges of problems ranging from mild fever to
sever respiratory disease, which can even lead to death. The
corona or covid-19 pandemic has created so much problem
all across world and even after countries succeeding in
vaccinating 50% of their population, still covid-19 spread is
not stopping. People are being advised to wear masks and
maintain social distance among them but they seem too
careless for the same. Governments across the globe have
made it mandatory to follow a minimum distance of 1 meter
among them and to make sure that it is being followed this
paper can provide a robust and fast solution. Especially we
have to monitor those places in which there is predicted
large number of people like hospitals, public gathering
places, religious places, fairs etc. In these places there is less
chances that people will follow social distancing rules hence
we need to implement this model in these areas. With the
help of CCTV cameras or files we can detect different people
distances and henceforth can inform the designated
authority about the same. This way people can be fined and
punished accordingly.
Fig -1: Social distancing is important to stop covid-19
2. PROBLEM STATEMENT
To control the spread of disease which are infectious like
covid-19 we use many measures but major one is social
distancing which is a nonpharmaceuticalwayofavoidingthis
disease. In this paper we propose a model in which we
perform real-time analysis and detection of people to see if
social distancing is being followed or not? By using CUDA we
also make use the graphical power of graphic cards which
have dedicated memory to perform daunting tasks easily
without putting much load on CPU. Below we present the
solution we used for this particular model.
3. REQUIREMENT ENGINEERING / ANALYSIS
3.1 Python Programming Language
Pythonishigh-level,general-purposeprogramminglanguage.
Python’s code emphasizes on code readability, reusability
with the use of very easy to use, maintainable indentation.
It is dynamically typed and it is garbage collected. It has very
useful libraries forvarious stuff but it’s mostly famousforit’s
useful and easy machine learning modules.
International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 09 Issue: 03 | Mar 2022 www.irjet.net p-ISSN: 2395-0072
© 2022, IRJET | Impact Factor value: 7.529 | ISO 9001:2008 Certified Journal | Page 593
3.2 Computer Vision
Computer Vision is an interdisciplinary scientific field which
is evolving with time that deals with how computers and
other related machines can gain high-level understanding
from digital images or videos. It includes different methods
which includes concepts like acquiring, processing and
analyzing digital images and videos and it is also used for
extraction of high-dimensional data from real world
scenarios in order to produce numerical or symbolic
information which can be used by computers to process
upon.
Fig -2: Green box shows distance > 1 m
Fig -3: Red box shows distance < 1 m
3.3 OpenCV
OpenCV is a special library mainly aimed at real-time
computer vision. It is a cross-platform and free to use as it is
open source. OpenCV also has special features like GPU
acceleration for real-time operations in machines like
computers. OpenCV CPU version is 9x faster. If we use DNN
module implementation of OpenCV then it is faster. To judge
speed of OpenCV, OpenMP takes 2 seconds when used with
Dark net but OpenCV implementation takes mere 0.22
seconds! It has various use cases like object detection,
landmark detection, face detection, tracking eyemovements,
extracting 3D models of objects, tracking modern camera
movements etc.
3.4 YOLO for object detection
YOLO stands forYou Only Look Once. It is extensivelyusedin
field of objectdetectioncomputertechnologywhichisrelated
to computer vision and image signal processing. It is used to
detect instances of class objects like humans, buildings, cats,
dogs, etc. It is used in locations like face detection,pedestrian
detection, video surveillance, image retrieval etc.
4. PROPOSED SYSTEM
Our proposed system is a four-level module that focuses on
things like human identification, their trackingandthenafter
their distance detection (mainly humans using YOLO object
detection algorithm) and calculation using computer vision
and deep learning by using OpenCV.
We will follow the following criteria given below: -
4.1 Pass the input which will be image or video and we will
pass it frame by frame.
4.2 Detect the human object in the image or video frame
using YOLO object detection.
4.3 Compute the pairwise distances between centroids of
boxes drawn on the people.
4.4 Check if the distance between any twopersonsis‘x’pixels
and check whether it is above or below the given threshold.
4.5 Generate the output in the output stream.
Flowchart -1: Workflow of our proposed system
5. IMPLEMENTATION
5.1 Image / Video Input
First, weprovideimage / video input to ourmodelwhichwill
extract it frameby frame. When we will usevideosthenno.of
frames per seconds will be much more hence it will be
difficult to process hence, we use CUDA powered system so
that processing is done at faster rates. It will be beneficial to
use high performance GPUs for better results.
5.2 Object detection
Now we are going to detect people object using YOLO. We
will only use people class filter to filter only people out of
many classes available. This implementation is done using
Darknet which is a neural net implementation and open
International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 09 Issue: 03 | Mar 2022 www.irjet.net p-ISSN: 2395-0072
© 2022, IRJET | Impact Factor value: 7.529 | ISO 9001:2008 Certified Journal | Page 594
source. YOLO looks at the entire image only once and then
goes through the network once and detects objects.
5.3 Distance measurement between person
After detecting people available in the frame provided as
input, the model is going to detect the person and draw
different bounding boxes on the person. So, this can create
many boxes around the person and this can be avoided by
using an algorithm called as Non-maximum suppression
(NMS). NMS is going to take intoconsiderationtheboxwhich
will have highest probability of covering that person and
hence only one box will be drawn around the person. After
this step we are going to use this box for further calculations
(I) After the bounding box is drawn, we are going to find
centroid of bounding box.
(II) After finding centroid, we are going to find distance
between two these two centroids whichwillfindthedistance
between the bounding boxes.
(III) After finding distance we are going to compare this
distance with ‘x’ pixelsdistancealreadypredefinedandcheck
whether it is above or below the mentioned limit.
(IV) Add the total combinations of boxes which are not
following social distance norms and put it in some storage
class. We will use thisafterwards to displayrealtimenumber
of people disobeying social distancing rules.
5.4 Output the results
After storing the number of comparisons falling below
threshold value, we are going to add these up and display it
under violation label. We are going to combine the frame in
case of video stream and because we are using CUDA, we
expect to get the results faster than conventional methods.
The output stream can be anything like computer screen,
monitors, web displays, TVs, etc.
6. FLOWCHART
7. FUTURE SCOPE
We can make a dashboard to display various different
parameters along with number of people disobeying social
distancing norms. We can display data like frequency of
having maximum population in specific time intervals and
getting the timein which thereismaximumviolationofsocial
distancing. Also, we can improve the camera calibration or
take that images or videos as input in which people are
clearly visible in frame to get more accurate results. We used
boxes to calculate centroids and then calculated distances
between them but if wewantmoreaccuracy,wecantaketop-
down approach instead of boxy approach. This way we can
calculate circle centers and find distances between them so
International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 09 Issue: 03 | Mar 2022 www.irjet.net p-ISSN: 2395-0072
© 2022, IRJET | Impact Factor value: 7.529 | ISO 9001:2008 Certified Journal | Page 595
that we can obtain better distance approximations among
different combinations of people.
8. CONCLUSIONS
This paper used computer vision, deep learning algorithms
like YOLO and OpenCV to reduce the impact of covid-19 by
accessing distance between people and if any pair fails to
follow the social distance norm then we will indicate it with
red line and this all will be done in real-time and because we
are using CUDA, we will get faster results than traditional
methods. Our proposed method demonstrated this by using
a pre-recorded video of people walking on a road. This
model can be used in other places like hospitals, offices,
public areas etc. Also, some improvements can be done in
the model to get more functionalities and improve
performance.
9. REFERENCES
[1] Sadettin Melenli and Aylin Topkaya, “Real-Time
Maintaining of Social Distance in Covid-19Environment
using Image Processing and Big Data”, IEEE
[2] Payal Panchal, Gaurav Prajapati, Savan Patel,Hinal Shah
and Jitendra Nasriwala, “A Review on Object Detection
and Tracking methods”, International Journal for
Research in Emerging ScienceAndTechnology,Volume-
2, Issue-I, January 2015
[3] Yew Cheong Hou, Mohd Zafri Baharuddin, Salman
Yussof and Sumayyah Dzulkifly, “Social Distancing
Detection with Deep Learning Model”.
[4] Shashi Yadav, “Deep Learning based Social distancing
detection”, International Journal forResearchinApplied
Science & Engineering Technology (IJRAET), vol. 08, no.
07, pp. 2321-9653, 2020.
[5] M. Andriluka, S. Roth and B. Schiele, “People-tracking-
by-detection and people-detection-by-tracking”, 2008
IEEE Conference on computer vision and pattern
recognition, pp. 1-8, 2008.
[6] B. Benfold and I. Reid, “Stable multi-target tracking in
real-time surveillance video”, IEEE Conference on
Computer Vision and Pattern Recognition, pp. 3457-
3464, 2011.

Contenu connexe

Tendances

Feature pyramid networks for object detection
Feature pyramid networks for object detection Feature pyramid networks for object detection
Feature pyramid networks for object detection
heedaeKwon
 

Tendances (20)

Cnn
CnnCnn
Cnn
 
Bag of tricks for image classification with convolutional neural networks r...
Bag of tricks for image classification with convolutional neural networks   r...Bag of tricks for image classification with convolutional neural networks   r...
Bag of tricks for image classification with convolutional neural networks r...
 
Feature pyramid networks for object detection
Feature pyramid networks for object detection Feature pyramid networks for object detection
Feature pyramid networks for object detection
 
Image classification using convolutional neural network
Image classification using convolutional neural networkImage classification using convolutional neural network
Image classification using convolutional neural network
 
Lec14 multiview stereo
Lec14 multiview stereoLec14 multiview stereo
Lec14 multiview stereo
 
CNN and its applications by ketaki
CNN and its applications by ketakiCNN and its applications by ketaki
CNN and its applications by ketaki
 
Image Inpainting Using Deep Learning
Image Inpainting Using Deep Learning Image Inpainting Using Deep Learning
Image Inpainting Using Deep Learning
 
“Introduction to DNN Model Compression Techniques,” a Presentation from Xailient
“Introduction to DNN Model Compression Techniques,” a Presentation from Xailient“Introduction to DNN Model Compression Techniques,” a Presentation from Xailient
“Introduction to DNN Model Compression Techniques,” a Presentation from Xailient
 
Image classification using CNN
Image classification using CNNImage classification using CNN
Image classification using CNN
 
Skip, residual and densely connected RNN architectures
Skip, residual and densely connected RNN architecturesSkip, residual and densely connected RNN architectures
Skip, residual and densely connected RNN architectures
 
Convolutional neural networks
Convolutional neural networks Convolutional neural networks
Convolutional neural networks
 
You only look once
You only look onceYou only look once
You only look once
 
Yolo
YoloYolo
Yolo
 
Introduction to object detection
Introduction to object detectionIntroduction to object detection
Introduction to object detection
 
A Short Introduction to Generative Adversarial Networks
A Short Introduction to Generative Adversarial NetworksA Short Introduction to Generative Adversarial Networks
A Short Introduction to Generative Adversarial Networks
 
CNN Machine learning DeepLearning
CNN Machine learning DeepLearningCNN Machine learning DeepLearning
CNN Machine learning DeepLearning
 
ResNet basics (Deep Residual Network for Image Recognition)
ResNet basics (Deep Residual Network for Image Recognition)ResNet basics (Deep Residual Network for Image Recognition)
ResNet basics (Deep Residual Network for Image Recognition)
 
Deep Learning for Computer Vision: Attention Models (UPC 2016)
Deep Learning for Computer Vision: Attention Models (UPC 2016)Deep Learning for Computer Vision: Attention Models (UPC 2016)
Deep Learning for Computer Vision: Attention Models (UPC 2016)
 
Perceptron & Neural Networks
Perceptron & Neural NetworksPerceptron & Neural Networks
Perceptron & Neural Networks
 
Convolution Neural Network (CNN)
Convolution Neural Network (CNN)Convolution Neural Network (CNN)
Convolution Neural Network (CNN)
 

Similaire à Social Distance Detector Using Computer Vision, OpenCV and YOLO Deep Learning Algorithm

Similaire à Social Distance Detector Using Computer Vision, OpenCV and YOLO Deep Learning Algorithm (20)

A Social Distancing Monitoring System Using OpenCV to Ensure Social Distancin...
A Social Distancing Monitoring System Using OpenCV to Ensure Social Distancin...A Social Distancing Monitoring System Using OpenCV to Ensure Social Distancin...
A Social Distancing Monitoring System Using OpenCV to Ensure Social Distancin...
 
Real Time Social Distance Detector using Deep learning
Real Time Social Distance Detector using Deep learningReal Time Social Distance Detector using Deep learning
Real Time Social Distance Detector using Deep learning
 
Drishyam - Virtual Eye for Blind
Drishyam - Virtual Eye for BlindDrishyam - Virtual Eye for Blind
Drishyam - Virtual Eye for Blind
 
SOCIAL DISTANCING DETECTION
SOCIAL DISTANCING DETECTIONSOCIAL DISTANCING DETECTION
SOCIAL DISTANCING DETECTION
 
Social Distancing Detector Management System
Social Distancing Detector Management SystemSocial Distancing Detector Management System
Social Distancing Detector Management System
 
Social Distance Detection System
Social Distance Detection SystemSocial Distance Detection System
Social Distance Detection System
 
Realtime Face mask Detector using YoloV4
Realtime Face mask Detector using YoloV4Realtime Face mask Detector using YoloV4
Realtime Face mask Detector using YoloV4
 
Advance Intelligent Video Surveillance System Using OpenCV
Advance Intelligent Video Surveillance System Using OpenCVAdvance Intelligent Video Surveillance System Using OpenCV
Advance Intelligent Video Surveillance System Using OpenCV
 
IRJET- Object Detection and Recognition for Blind Assistance
IRJET- Object Detection and Recognition for Blind AssistanceIRJET- Object Detection and Recognition for Blind Assistance
IRJET- Object Detection and Recognition for Blind Assistance
 
Covid Mask Detection and Social Distancing Using Raspberry pi
Covid Mask Detection and Social Distancing Using Raspberry piCovid Mask Detection and Social Distancing Using Raspberry pi
Covid Mask Detection and Social Distancing Using Raspberry pi
 
Precaution for Covid-19 based on Mask detection and sensor
Precaution for Covid-19 based on Mask detection and sensorPrecaution for Covid-19 based on Mask detection and sensor
Precaution for Covid-19 based on Mask detection and sensor
 
INDOOR AND OUTDOOR NAVIGATION ASSISTANCE SYSTEM FOR VISUALLY IMPAIRED PEOPLE ...
INDOOR AND OUTDOOR NAVIGATION ASSISTANCE SYSTEM FOR VISUALLY IMPAIRED PEOPLE ...INDOOR AND OUTDOOR NAVIGATION ASSISTANCE SYSTEM FOR VISUALLY IMPAIRED PEOPLE ...
INDOOR AND OUTDOOR NAVIGATION ASSISTANCE SYSTEM FOR VISUALLY IMPAIRED PEOPLE ...
 
ROAD POTHOLE DETECTION USING YOLOV4 DARKNET
ROAD POTHOLE DETECTION USING YOLOV4 DARKNETROAD POTHOLE DETECTION USING YOLOV4 DARKNET
ROAD POTHOLE DETECTION USING YOLOV4 DARKNET
 
YOLOv4: A Face Mask Detection System
YOLOv4: A Face Mask Detection SystemYOLOv4: A Face Mask Detection System
YOLOv4: A Face Mask Detection System
 
DYNAMIC ENERGY MANAGEMENT USING REAL TIME OBJECT DETECTION
DYNAMIC ENERGY MANAGEMENT USING REAL TIME OBJECT DETECTIONDYNAMIC ENERGY MANAGEMENT USING REAL TIME OBJECT DETECTION
DYNAMIC ENERGY MANAGEMENT USING REAL TIME OBJECT DETECTION
 
Object and Currency Detection for the Visually Impaired
Object and Currency Detection for the Visually ImpairedObject and Currency Detection for the Visually Impaired
Object and Currency Detection for the Visually Impaired
 
Voice Enable Blind Assistance System -Real time Object Detection
Voice Enable Blind Assistance System -Real time Object DetectionVoice Enable Blind Assistance System -Real time Object Detection
Voice Enable Blind Assistance System -Real time Object Detection
 
Social Distance Monitoring and Mask Detection Using Deep Learning Techniques
Social Distance Monitoring and Mask Detection Using Deep Learning TechniquesSocial Distance Monitoring and Mask Detection Using Deep Learning Techniques
Social Distance Monitoring and Mask Detection Using Deep Learning Techniques
 
IMPLEMENTATION OF IDS (INTRUDER DETECTION SYSTEM)
IMPLEMENTATION OF IDS (INTRUDER DETECTION SYSTEM)IMPLEMENTATION OF IDS (INTRUDER DETECTION SYSTEM)
IMPLEMENTATION OF IDS (INTRUDER DETECTION SYSTEM)
 
Smart Navigation Assistance System for Blind People
Smart Navigation Assistance System for Blind PeopleSmart Navigation Assistance System for Blind People
Smart Navigation Assistance System for Blind People
 

Plus de IRJET Journal

Plus de IRJET Journal (20)

TUNNELING IN HIMALAYAS WITH NATM METHOD: A SPECIAL REFERENCES TO SUNGAL TUNNE...
TUNNELING IN HIMALAYAS WITH NATM METHOD: A SPECIAL REFERENCES TO SUNGAL TUNNE...TUNNELING IN HIMALAYAS WITH NATM METHOD: A SPECIAL REFERENCES TO SUNGAL TUNNE...
TUNNELING IN HIMALAYAS WITH NATM METHOD: A SPECIAL REFERENCES TO SUNGAL TUNNE...
 
STUDY THE EFFECT OF RESPONSE REDUCTION FACTOR ON RC FRAMED STRUCTURE
STUDY THE EFFECT OF RESPONSE REDUCTION FACTOR ON RC FRAMED STRUCTURESTUDY THE EFFECT OF RESPONSE REDUCTION FACTOR ON RC FRAMED STRUCTURE
STUDY THE EFFECT OF RESPONSE REDUCTION FACTOR ON RC FRAMED STRUCTURE
 
A COMPARATIVE ANALYSIS OF RCC ELEMENT OF SLAB WITH STARK STEEL (HYSD STEEL) A...
A COMPARATIVE ANALYSIS OF RCC ELEMENT OF SLAB WITH STARK STEEL (HYSD STEEL) A...A COMPARATIVE ANALYSIS OF RCC ELEMENT OF SLAB WITH STARK STEEL (HYSD STEEL) A...
A COMPARATIVE ANALYSIS OF RCC ELEMENT OF SLAB WITH STARK STEEL (HYSD STEEL) A...
 
Effect of Camber and Angles of Attack on Airfoil Characteristics
Effect of Camber and Angles of Attack on Airfoil CharacteristicsEffect of Camber and Angles of Attack on Airfoil Characteristics
Effect of Camber and Angles of Attack on Airfoil Characteristics
 
A Review on the Progress and Challenges of Aluminum-Based Metal Matrix Compos...
A Review on the Progress and Challenges of Aluminum-Based Metal Matrix Compos...A Review on the Progress and Challenges of Aluminum-Based Metal Matrix Compos...
A Review on the Progress and Challenges of Aluminum-Based Metal Matrix Compos...
 
Dynamic Urban Transit Optimization: A Graph Neural Network Approach for Real-...
Dynamic Urban Transit Optimization: A Graph Neural Network Approach for Real-...Dynamic Urban Transit Optimization: A Graph Neural Network Approach for Real-...
Dynamic Urban Transit Optimization: A Graph Neural Network Approach for Real-...
 
Structural Analysis and Design of Multi-Storey Symmetric and Asymmetric Shape...
Structural Analysis and Design of Multi-Storey Symmetric and Asymmetric Shape...Structural Analysis and Design of Multi-Storey Symmetric and Asymmetric Shape...
Structural Analysis and Design of Multi-Storey Symmetric and Asymmetric Shape...
 
A Review of “Seismic Response of RC Structures Having Plan and Vertical Irreg...
A Review of “Seismic Response of RC Structures Having Plan and Vertical Irreg...A Review of “Seismic Response of RC Structures Having Plan and Vertical Irreg...
A Review of “Seismic Response of RC Structures Having Plan and Vertical Irreg...
 
A REVIEW ON MACHINE LEARNING IN ADAS
A REVIEW ON MACHINE LEARNING IN ADASA REVIEW ON MACHINE LEARNING IN ADAS
A REVIEW ON MACHINE LEARNING IN ADAS
 
Long Term Trend Analysis of Precipitation and Temperature for Asosa district,...
Long Term Trend Analysis of Precipitation and Temperature for Asosa district,...Long Term Trend Analysis of Precipitation and Temperature for Asosa district,...
Long Term Trend Analysis of Precipitation and Temperature for Asosa district,...
 
P.E.B. Framed Structure Design and Analysis Using STAAD Pro
P.E.B. Framed Structure Design and Analysis Using STAAD ProP.E.B. Framed Structure Design and Analysis Using STAAD Pro
P.E.B. Framed Structure Design and Analysis Using STAAD Pro
 
A Review on Innovative Fiber Integration for Enhanced Reinforcement of Concre...
A Review on Innovative Fiber Integration for Enhanced Reinforcement of Concre...A Review on Innovative Fiber Integration for Enhanced Reinforcement of Concre...
A Review on Innovative Fiber Integration for Enhanced Reinforcement of Concre...
 
Survey Paper on Cloud-Based Secured Healthcare System
Survey Paper on Cloud-Based Secured Healthcare SystemSurvey Paper on Cloud-Based Secured Healthcare System
Survey Paper on Cloud-Based Secured Healthcare System
 
Review on studies and research on widening of existing concrete bridges
Review on studies and research on widening of existing concrete bridgesReview on studies and research on widening of existing concrete bridges
Review on studies and research on widening of existing concrete bridges
 
React based fullstack edtech web application
React based fullstack edtech web applicationReact based fullstack edtech web application
React based fullstack edtech web application
 
A Comprehensive Review of Integrating IoT and Blockchain Technologies in the ...
A Comprehensive Review of Integrating IoT and Blockchain Technologies in the ...A Comprehensive Review of Integrating IoT and Blockchain Technologies in the ...
A Comprehensive Review of Integrating IoT and Blockchain Technologies in the ...
 
A REVIEW ON THE PERFORMANCE OF COCONUT FIBRE REINFORCED CONCRETE.
A REVIEW ON THE PERFORMANCE OF COCONUT FIBRE REINFORCED CONCRETE.A REVIEW ON THE PERFORMANCE OF COCONUT FIBRE REINFORCED CONCRETE.
A REVIEW ON THE PERFORMANCE OF COCONUT FIBRE REINFORCED CONCRETE.
 
Optimizing Business Management Process Workflows: The Dynamic Influence of Mi...
Optimizing Business Management Process Workflows: The Dynamic Influence of Mi...Optimizing Business Management Process Workflows: The Dynamic Influence of Mi...
Optimizing Business Management Process Workflows: The Dynamic Influence of Mi...
 
Multistoried and Multi Bay Steel Building Frame by using Seismic Design
Multistoried and Multi Bay Steel Building Frame by using Seismic DesignMultistoried and Multi Bay Steel Building Frame by using Seismic Design
Multistoried and Multi Bay Steel Building Frame by using Seismic Design
 
Cost Optimization of Construction Using Plastic Waste as a Sustainable Constr...
Cost Optimization of Construction Using Plastic Waste as a Sustainable Constr...Cost Optimization of Construction Using Plastic Waste as a Sustainable Constr...
Cost Optimization of Construction Using Plastic Waste as a Sustainable Constr...
 

Dernier

XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
ssuser89054b
 
notes on Evolution Of Analytic Scalability.ppt
notes on Evolution Of Analytic Scalability.pptnotes on Evolution Of Analytic Scalability.ppt
notes on Evolution Of Analytic Scalability.ppt
MsecMca
 
Call Girls in South Ex (delhi) call me [🔝9953056974🔝] escort service 24X7
Call Girls in South Ex (delhi) call me [🔝9953056974🔝] escort service 24X7Call Girls in South Ex (delhi) call me [🔝9953056974🔝] escort service 24X7
Call Girls in South Ex (delhi) call me [🔝9953056974🔝] escort service 24X7
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 

Dernier (20)

Bridge Jacking Design Sample Calculation.pptx
Bridge Jacking Design Sample Calculation.pptxBridge Jacking Design Sample Calculation.pptx
Bridge Jacking Design Sample Calculation.pptx
 
HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR
HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKARHAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR
HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR
 
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
 
Design For Accessibility: Getting it right from the start
Design For Accessibility: Getting it right from the startDesign For Accessibility: Getting it right from the start
Design For Accessibility: Getting it right from the start
 
Engineering Drawing focus on projection of planes
Engineering Drawing focus on projection of planesEngineering Drawing focus on projection of planes
Engineering Drawing focus on projection of planes
 
Generative AI or GenAI technology based PPT
Generative AI or GenAI technology based PPTGenerative AI or GenAI technology based PPT
Generative AI or GenAI technology based PPT
 
Unleashing the Power of the SORA AI lastest leap
Unleashing the Power of the SORA AI lastest leapUnleashing the Power of the SORA AI lastest leap
Unleashing the Power of the SORA AI lastest leap
 
AIRCANVAS[1].pdf mini project for btech students
AIRCANVAS[1].pdf mini project for btech studentsAIRCANVAS[1].pdf mini project for btech students
AIRCANVAS[1].pdf mini project for btech students
 
Introduction to Serverless with AWS Lambda
Introduction to Serverless with AWS LambdaIntroduction to Serverless with AWS Lambda
Introduction to Serverless with AWS Lambda
 
Hazard Identification (HAZID) vs. Hazard and Operability (HAZOP): A Comparati...
Hazard Identification (HAZID) vs. Hazard and Operability (HAZOP): A Comparati...Hazard Identification (HAZID) vs. Hazard and Operability (HAZOP): A Comparati...
Hazard Identification (HAZID) vs. Hazard and Operability (HAZOP): A Comparati...
 
A CASE STUDY ON CERAMIC INDUSTRY OF BANGLADESH.pptx
A CASE STUDY ON CERAMIC INDUSTRY OF BANGLADESH.pptxA CASE STUDY ON CERAMIC INDUSTRY OF BANGLADESH.pptx
A CASE STUDY ON CERAMIC INDUSTRY OF BANGLADESH.pptx
 
notes on Evolution Of Analytic Scalability.ppt
notes on Evolution Of Analytic Scalability.pptnotes on Evolution Of Analytic Scalability.ppt
notes on Evolution Of Analytic Scalability.ppt
 
FEA Based Level 3 Assessment of Deformed Tanks with Fluid Induced Loads
FEA Based Level 3 Assessment of Deformed Tanks with Fluid Induced LoadsFEA Based Level 3 Assessment of Deformed Tanks with Fluid Induced Loads
FEA Based Level 3 Assessment of Deformed Tanks with Fluid Induced Loads
 
kiln thermal load.pptx kiln tgermal load
kiln thermal load.pptx kiln tgermal loadkiln thermal load.pptx kiln tgermal load
kiln thermal load.pptx kiln tgermal load
 
DC MACHINE-Motoring and generation, Armature circuit equation
DC MACHINE-Motoring and generation, Armature circuit equationDC MACHINE-Motoring and generation, Armature circuit equation
DC MACHINE-Motoring and generation, Armature circuit equation
 
Online food ordering system project report.pdf
Online food ordering system project report.pdfOnline food ordering system project report.pdf
Online food ordering system project report.pdf
 
Tamil Call Girls Bhayandar WhatsApp +91-9930687706, Best Service
Tamil Call Girls Bhayandar WhatsApp +91-9930687706, Best ServiceTamil Call Girls Bhayandar WhatsApp +91-9930687706, Best Service
Tamil Call Girls Bhayandar WhatsApp +91-9930687706, Best Service
 
2016EF22_0 solar project report rooftop projects
2016EF22_0 solar project report rooftop projects2016EF22_0 solar project report rooftop projects
2016EF22_0 solar project report rooftop projects
 
Thermal Engineering-R & A / C - unit - V
Thermal Engineering-R & A / C - unit - VThermal Engineering-R & A / C - unit - V
Thermal Engineering-R & A / C - unit - V
 
Call Girls in South Ex (delhi) call me [🔝9953056974🔝] escort service 24X7
Call Girls in South Ex (delhi) call me [🔝9953056974🔝] escort service 24X7Call Girls in South Ex (delhi) call me [🔝9953056974🔝] escort service 24X7
Call Girls in South Ex (delhi) call me [🔝9953056974🔝] escort service 24X7
 

Social Distance Detector Using Computer Vision, OpenCV and YOLO Deep Learning Algorithm

  • 1. International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056 Volume: 09 Issue: 03 | Mar 2022 www.irjet.net p-ISSN: 2395-0072 © 2022, IRJET | Impact Factor value: 7.529 | ISO 9001:2008 Certified Journal | Page 592 Social Distance Detector Using Computer Vision, OpenCV and YOLO Deep Learning Algorithm Suyash Paradkar1, Shreya Tekade2, Komal Ganatra3, Saloni Sarwade4, Prof. Rahul Bhole5 1,2,3,4B.E. Students, Department of IT, Zeal College of Engineering and Research, Maharashtra, India 5Professor, Department of IT, Zeal College of Engineering and Research, Maharashtra, India ---------------------------------------------------------------------***---------------------------------------------------------------------- Abstract – This paper presents a method of detecting social distance using concepts like computer vision, OpenCV and YOLO deep learning algorithm among people to detect and control the spread of infectious disease like corona virus (covid-19). By using a pre-recorded video as input, the computer screen as output stream and OpenCV using YOLO algorithm we can tell if people are following social distancing or not. These types of implementations have been successful but due to speed issues of the computer on which these models are run, we can generate accurate results. Hence by using CUDA we can increase the performance of the model by utilizing the computing power of GPU which is available in most of the systems. It has great uses in applications like CCTV cameras, security cameras, web camera-based systems etc., and it can detect activity of people in real time. It has great use in automation side. Our system is able to monitor people and tell us whether they are following the rules of safe distancing or not. It can detect whether distance between 2 people is at least 1 meter or not. Keywords: Social Distance Detector, Computer Vision, OpenCV, YOLO, CUDA 1.INTRODUCTION Covid-19 is caused by the SARS-CoV-2 virus. It can cause different ranges of problems ranging from mild fever to sever respiratory disease, which can even lead to death. The corona or covid-19 pandemic has created so much problem all across world and even after countries succeeding in vaccinating 50% of their population, still covid-19 spread is not stopping. People are being advised to wear masks and maintain social distance among them but they seem too careless for the same. Governments across the globe have made it mandatory to follow a minimum distance of 1 meter among them and to make sure that it is being followed this paper can provide a robust and fast solution. Especially we have to monitor those places in which there is predicted large number of people like hospitals, public gathering places, religious places, fairs etc. In these places there is less chances that people will follow social distancing rules hence we need to implement this model in these areas. With the help of CCTV cameras or files we can detect different people distances and henceforth can inform the designated authority about the same. This way people can be fined and punished accordingly. Fig -1: Social distancing is important to stop covid-19 2. PROBLEM STATEMENT To control the spread of disease which are infectious like covid-19 we use many measures but major one is social distancing which is a nonpharmaceuticalwayofavoidingthis disease. In this paper we propose a model in which we perform real-time analysis and detection of people to see if social distancing is being followed or not? By using CUDA we also make use the graphical power of graphic cards which have dedicated memory to perform daunting tasks easily without putting much load on CPU. Below we present the solution we used for this particular model. 3. REQUIREMENT ENGINEERING / ANALYSIS 3.1 Python Programming Language Pythonishigh-level,general-purposeprogramminglanguage. Python’s code emphasizes on code readability, reusability with the use of very easy to use, maintainable indentation. It is dynamically typed and it is garbage collected. It has very useful libraries forvarious stuff but it’s mostly famousforit’s useful and easy machine learning modules.
  • 2. International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056 Volume: 09 Issue: 03 | Mar 2022 www.irjet.net p-ISSN: 2395-0072 © 2022, IRJET | Impact Factor value: 7.529 | ISO 9001:2008 Certified Journal | Page 593 3.2 Computer Vision Computer Vision is an interdisciplinary scientific field which is evolving with time that deals with how computers and other related machines can gain high-level understanding from digital images or videos. It includes different methods which includes concepts like acquiring, processing and analyzing digital images and videos and it is also used for extraction of high-dimensional data from real world scenarios in order to produce numerical or symbolic information which can be used by computers to process upon. Fig -2: Green box shows distance > 1 m Fig -3: Red box shows distance < 1 m 3.3 OpenCV OpenCV is a special library mainly aimed at real-time computer vision. It is a cross-platform and free to use as it is open source. OpenCV also has special features like GPU acceleration for real-time operations in machines like computers. OpenCV CPU version is 9x faster. If we use DNN module implementation of OpenCV then it is faster. To judge speed of OpenCV, OpenMP takes 2 seconds when used with Dark net but OpenCV implementation takes mere 0.22 seconds! It has various use cases like object detection, landmark detection, face detection, tracking eyemovements, extracting 3D models of objects, tracking modern camera movements etc. 3.4 YOLO for object detection YOLO stands forYou Only Look Once. It is extensivelyusedin field of objectdetectioncomputertechnologywhichisrelated to computer vision and image signal processing. It is used to detect instances of class objects like humans, buildings, cats, dogs, etc. It is used in locations like face detection,pedestrian detection, video surveillance, image retrieval etc. 4. PROPOSED SYSTEM Our proposed system is a four-level module that focuses on things like human identification, their trackingandthenafter their distance detection (mainly humans using YOLO object detection algorithm) and calculation using computer vision and deep learning by using OpenCV. We will follow the following criteria given below: - 4.1 Pass the input which will be image or video and we will pass it frame by frame. 4.2 Detect the human object in the image or video frame using YOLO object detection. 4.3 Compute the pairwise distances between centroids of boxes drawn on the people. 4.4 Check if the distance between any twopersonsis‘x’pixels and check whether it is above or below the given threshold. 4.5 Generate the output in the output stream. Flowchart -1: Workflow of our proposed system 5. IMPLEMENTATION 5.1 Image / Video Input First, weprovideimage / video input to ourmodelwhichwill extract it frameby frame. When we will usevideosthenno.of frames per seconds will be much more hence it will be difficult to process hence, we use CUDA powered system so that processing is done at faster rates. It will be beneficial to use high performance GPUs for better results. 5.2 Object detection Now we are going to detect people object using YOLO. We will only use people class filter to filter only people out of many classes available. This implementation is done using Darknet which is a neural net implementation and open
  • 3. International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056 Volume: 09 Issue: 03 | Mar 2022 www.irjet.net p-ISSN: 2395-0072 © 2022, IRJET | Impact Factor value: 7.529 | ISO 9001:2008 Certified Journal | Page 594 source. YOLO looks at the entire image only once and then goes through the network once and detects objects. 5.3 Distance measurement between person After detecting people available in the frame provided as input, the model is going to detect the person and draw different bounding boxes on the person. So, this can create many boxes around the person and this can be avoided by using an algorithm called as Non-maximum suppression (NMS). NMS is going to take intoconsiderationtheboxwhich will have highest probability of covering that person and hence only one box will be drawn around the person. After this step we are going to use this box for further calculations (I) After the bounding box is drawn, we are going to find centroid of bounding box. (II) After finding centroid, we are going to find distance between two these two centroids whichwillfindthedistance between the bounding boxes. (III) After finding distance we are going to compare this distance with ‘x’ pixelsdistancealreadypredefinedandcheck whether it is above or below the mentioned limit. (IV) Add the total combinations of boxes which are not following social distance norms and put it in some storage class. We will use thisafterwards to displayrealtimenumber of people disobeying social distancing rules. 5.4 Output the results After storing the number of comparisons falling below threshold value, we are going to add these up and display it under violation label. We are going to combine the frame in case of video stream and because we are using CUDA, we expect to get the results faster than conventional methods. The output stream can be anything like computer screen, monitors, web displays, TVs, etc. 6. FLOWCHART 7. FUTURE SCOPE We can make a dashboard to display various different parameters along with number of people disobeying social distancing norms. We can display data like frequency of having maximum population in specific time intervals and getting the timein which thereismaximumviolationofsocial distancing. Also, we can improve the camera calibration or take that images or videos as input in which people are clearly visible in frame to get more accurate results. We used boxes to calculate centroids and then calculated distances between them but if wewantmoreaccuracy,wecantaketop- down approach instead of boxy approach. This way we can calculate circle centers and find distances between them so
  • 4. International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056 Volume: 09 Issue: 03 | Mar 2022 www.irjet.net p-ISSN: 2395-0072 © 2022, IRJET | Impact Factor value: 7.529 | ISO 9001:2008 Certified Journal | Page 595 that we can obtain better distance approximations among different combinations of people. 8. CONCLUSIONS This paper used computer vision, deep learning algorithms like YOLO and OpenCV to reduce the impact of covid-19 by accessing distance between people and if any pair fails to follow the social distance norm then we will indicate it with red line and this all will be done in real-time and because we are using CUDA, we will get faster results than traditional methods. Our proposed method demonstrated this by using a pre-recorded video of people walking on a road. This model can be used in other places like hospitals, offices, public areas etc. Also, some improvements can be done in the model to get more functionalities and improve performance. 9. REFERENCES [1] Sadettin Melenli and Aylin Topkaya, “Real-Time Maintaining of Social Distance in Covid-19Environment using Image Processing and Big Data”, IEEE [2] Payal Panchal, Gaurav Prajapati, Savan Patel,Hinal Shah and Jitendra Nasriwala, “A Review on Object Detection and Tracking methods”, International Journal for Research in Emerging ScienceAndTechnology,Volume- 2, Issue-I, January 2015 [3] Yew Cheong Hou, Mohd Zafri Baharuddin, Salman Yussof and Sumayyah Dzulkifly, “Social Distancing Detection with Deep Learning Model”. [4] Shashi Yadav, “Deep Learning based Social distancing detection”, International Journal forResearchinApplied Science & Engineering Technology (IJRAET), vol. 08, no. 07, pp. 2321-9653, 2020. [5] M. Andriluka, S. Roth and B. Schiele, “People-tracking- by-detection and people-detection-by-tracking”, 2008 IEEE Conference on computer vision and pattern recognition, pp. 1-8, 2008. [6] B. Benfold and I. Reid, “Stable multi-target tracking in real-time surveillance video”, IEEE Conference on Computer Vision and Pattern Recognition, pp. 3457- 3464, 2011.