SlideShare une entreprise Scribd logo
1  sur  9
SIFT vs Other Feature descriptor
Nisar Ahmed Rana
• SIFT is an algorithm in computer vision to detect and
describe local features in images.
• Feature description is obtained by extracting interesting
points on the object in a training image. This description
is used to identify the object in an image containing many
other objects.
• The relative positions between these features in the
original scene shouldn't change from one image to
another. For example, if only the four corners of a door
were used as features, they would work regardless of the
door's position; but if points in the frame were also
used, the recognition would fail if the door is opened or
closed.
• Scale Invariance
• Rotation Invariance
• Illumination Invariance
• Viewpoint Invariance (Mostly)
• Computationally Expensive
• Variant to Light Color Changes
• Variant to non-uniform Illumination (i.e. Shadows)
• The performance evolution of different local descriptors and their
comparison with SIFT are summarized below:
• SIFT and SIFT-like GLOH features exhibit the highest
matching accuracies for an affine transformation of 50
degrees. After this transformation limit, results start to
become unreliable.
• Distinctiveness of descriptors is measured by summing
the eigenvalues of the descriptors, obtained by the
Principal components analysis of the descriptors
normalized by their variance. This corresponds to the
amount of variance captured by different
descriptors, therefore, to their distinctiveness. PCA-
SIFT (Principal Components Analysis applied to SIFT
descriptors), GLOH (Gradient Location and Orientation
Histogram) and SIFT features give the highest values.
• SIFT-based descriptors outperform other contemporary
local descriptors on both textured and structured
scenes, with the difference in performance larger on the
textured scene.
• For scale changes in the range 2-2.5 and image rotations
in the range 30 to 45 degrees, SIFT and SIFT-based
descriptors again outperform other contemporary local
descriptors with both textured and structured scene
content.
• Introduction of blur affects all local descriptors, especially
those based on edges, like shape context, because
edges disappear in the case of a strong blur. But
GLOH, PCA-SIFT and SIFT still performed better than
the others. This is also true for evaluation in the case of
illumination changes.
• SURF (Speeded Up Robust Features) is a robust local
feature detector. It has shown to have similar
performance to SIFT, while at the same time being much
faster.
• The standard version of SURF is several times faster
than SIFT and claimed by its authors to be more robust
against different image transformations than SIFT. SURF
is based on sums of 2D Haar wavelet responses and
makes an efficient use of integral images.
• It uses an integer approximation to the determinant of
Hessian blob detector, which can be computed extremely
quickly with an integral image. For features, it uses the
sum of the Haar wavelet response around the point of
interest. Again, these can be computed with the aid of the
integral image.
• LESH is a recently proposed image descriptor which can
be used to get a description of the underlying shape.
• The LESH feature descriptor is built on local energy
model of feature perception.
• It is designed to be scale invariant.
• It encodes the underlying shape by accumulating local
energy of the underlying signal along several filter
orientations, several local histograms from different parts
of the image/patch are generated and concatenated
together into a 128-dimensional compact spatial
histogram.
• The LESH features can be used in applications like
shape-based image retrieval, object detection, and pose
estimation.
• GLOH is a robust image descriptor that can be used in
computer vision tasks.
• It is a SIFT-like descriptor that considers more spatial
regions for the histograms.
• The higher dimensionality of the descriptor is reduced to
64 through principal components analysis (PCA).

Contenu connexe

Tendances

Lecture11
Lecture11Lecture11
Lecture11
zukun
 

Tendances (20)

Image segmentation
Image segmentationImage segmentation
Image segmentation
 
Image feature extraction
Image feature extractionImage feature extraction
Image feature extraction
 
Color Image Processing: Basics
Color Image Processing: BasicsColor Image Processing: Basics
Color Image Processing: Basics
 
Lecture11
Lecture11Lecture11
Lecture11
 
Feature Matching using SIFT algorithm
Feature Matching using SIFT algorithmFeature Matching using SIFT algorithm
Feature Matching using SIFT algorithm
 
Image enhancement
Image enhancementImage enhancement
Image enhancement
 
Edge detection
Edge detectionEdge detection
Edge detection
 
Lecture 6-computer vision features descriptors matching
Lecture 6-computer vision features descriptors matchingLecture 6-computer vision features descriptors matching
Lecture 6-computer vision features descriptors matching
 
COM2304: Color and Color Models
COM2304: Color and Color ModelsCOM2304: Color and Color Models
COM2304: Color and Color Models
 
Chapter10 image segmentation
Chapter10 image segmentationChapter10 image segmentation
Chapter10 image segmentation
 
Support Vector Machines- SVM
Support Vector Machines- SVMSupport Vector Machines- SVM
Support Vector Machines- SVM
 
Scale Invariant Feature Transform
Scale Invariant Feature TransformScale Invariant Feature Transform
Scale Invariant Feature Transform
 
Shape Features
 Shape Features  Shape Features
Shape Features
 
Image enhancement sharpening
Image enhancement  sharpeningImage enhancement  sharpening
Image enhancement sharpening
 
Image recognition
Image recognitionImage recognition
Image recognition
 
Image segmentation
Image segmentationImage segmentation
Image segmentation
 
Lecture 1 computer vision introduction
Lecture 1 computer vision introductionLecture 1 computer vision introduction
Lecture 1 computer vision introduction
 
Hands-on ML - CH3
Hands-on ML - CH3Hands-on ML - CH3
Hands-on ML - CH3
 
Edge detection
Edge detectionEdge detection
Edge detection
 
Edge Detection and Segmentation
Edge Detection and SegmentationEdge Detection and Segmentation
Edge Detection and Segmentation
 

En vedette

Matching with Invariant Features
Matching with Invariant FeaturesMatching with Invariant Features
Matching with Invariant Features
zukun
 
Modern features-part-1-detectors
Modern features-part-1-detectorsModern features-part-1-detectors
Modern features-part-1-detectors
zukun
 
Modern features-part-2-descriptors
Modern features-part-2-descriptorsModern features-part-2-descriptors
Modern features-part-2-descriptors
zukun
 
AAAI08 tutorial: visual object recognition
AAAI08 tutorial: visual object recognitionAAAI08 tutorial: visual object recognition
AAAI08 tutorial: visual object recognition
zukun
 

En vedette (20)

SURF
SURFSURF
SURF
 
A comparison of SIFT, PCA-SIFT and SURF
A comparison of SIFT, PCA-SIFT and SURFA comparison of SIFT, PCA-SIFT and SURF
A comparison of SIFT, PCA-SIFT and SURF
 
Global Context Descriptors for SURF and MSER Feature Descriptors
Global Context Descriptors for SURF and MSER Feature DescriptorsGlobal Context Descriptors for SURF and MSER Feature Descriptors
Global Context Descriptors for SURF and MSER Feature Descriptors
 
Matching with Invariant Features
Matching with Invariant FeaturesMatching with Invariant Features
Matching with Invariant Features
 
Local feature descriptors for visual recognition
Local feature descriptors for visual recognitionLocal feature descriptors for visual recognition
Local feature descriptors for visual recognition
 
Modern features-part-1-detectors
Modern features-part-1-detectorsModern features-part-1-detectors
Modern features-part-1-detectors
 
Off-line Signature Verification
Off-line Signature VerificationOff-line Signature Verification
Off-line Signature Verification
 
Scale invariant feature transform
Scale invariant feature transformScale invariant feature transform
Scale invariant feature transform
 
Lec07 aggregation-and-retrieval-system
Lec07 aggregation-and-retrieval-systemLec07 aggregation-and-retrieval-system
Lec07 aggregation-and-retrieval-system
 
Modern features-part-2-descriptors
Modern features-part-2-descriptorsModern features-part-2-descriptors
Modern features-part-2-descriptors
 
AAAI08 tutorial: visual object recognition
AAAI08 tutorial: visual object recognitionAAAI08 tutorial: visual object recognition
AAAI08 tutorial: visual object recognition
 
Scale Invariant Feature Tranform
Scale Invariant Feature TranformScale Invariant Feature Tranform
Scale Invariant Feature Tranform
 
Powerpoint mack jackson
Powerpoint   mack jacksonPowerpoint   mack jackson
Powerpoint mack jackson
 
Slovak consular services in Glasgow 12 and 13 June 2014
Slovak consular services in Glasgow 12 and 13 June 2014Slovak consular services in Glasgow 12 and 13 June 2014
Slovak consular services in Glasgow 12 and 13 June 2014
 
Lean Prod Development ProductCamp Vancouver Feb15
Lean Prod Development ProductCamp Vancouver Feb15Lean Prod Development ProductCamp Vancouver Feb15
Lean Prod Development ProductCamp Vancouver Feb15
 
ARTS AT U.K.
ARTS AT U.K.ARTS AT U.K.
ARTS AT U.K.
 
Eskiden Facebook yoktu, buralar hep dutluktu...
Eskiden Facebook yoktu, buralar hep dutluktu...Eskiden Facebook yoktu, buralar hep dutluktu...
Eskiden Facebook yoktu, buralar hep dutluktu...
 
DOĞASI GİRİŞİM: ETKİNLİK YÖNETİMİ
DOĞASI GİRİŞİM: ETKİNLİK YÖNETİMİ DOĞASI GİRİŞİM: ETKİNLİK YÖNETİMİ
DOĞASI GİRİŞİM: ETKİNLİK YÖNETİMİ
 
Gol a history[1]
Gol a history[1]Gol a history[1]
Gol a history[1]
 
36
3636
36
 

Similaire à SIFT vs other Feature Descriptor

IJERD (www.ijerd.com) International Journal of Engineering Research and Devel...
IJERD (www.ijerd.com) International Journal of Engineering Research and Devel...IJERD (www.ijerd.com) International Journal of Engineering Research and Devel...
IJERD (www.ijerd.com) International Journal of Engineering Research and Devel...
IJERD Editor
 
IJERD (www.ijerd.com) International Journal of Engineering Research and Devel...
IJERD (www.ijerd.com) International Journal of Engineering Research and Devel...IJERD (www.ijerd.com) International Journal of Engineering Research and Devel...
IJERD (www.ijerd.com) International Journal of Engineering Research and Devel...
IJERD Editor
 
IJERD (www.ijerd.com) International Journal of Engineering Research and Devel...
IJERD (www.ijerd.com) International Journal of Engineering Research and Devel...IJERD (www.ijerd.com) International Journal of Engineering Research and Devel...
IJERD (www.ijerd.com) International Journal of Engineering Research and Devel...
IJERD Editor
 
Radial Fourier Analysis (RFA) Descriptor with Fourier-based Keypoint Orientation
Radial Fourier Analysis (RFA) Descriptor with Fourier-based Keypoint OrientationRadial Fourier Analysis (RFA) Descriptor with Fourier-based Keypoint Orientation
Radial Fourier Analysis (RFA) Descriptor with Fourier-based Keypoint Orientation
CSCJournals
 

Similaire à SIFT vs other Feature Descriptor (20)

Vf sift
Vf siftVf sift
Vf sift
 
PPT s11-machine vision-s2
PPT s11-machine vision-s2PPT s11-machine vision-s2
PPT s11-machine vision-s2
 
06 image features
06 image features06 image features
06 image features
 
IJERD (www.ijerd.com) International Journal of Engineering Research and Devel...
IJERD (www.ijerd.com) International Journal of Engineering Research and Devel...IJERD (www.ijerd.com) International Journal of Engineering Research and Devel...
IJERD (www.ijerd.com) International Journal of Engineering Research and Devel...
 
IJERD (www.ijerd.com) International Journal of Engineering Research and Devel...
IJERD (www.ijerd.com) International Journal of Engineering Research and Devel...IJERD (www.ijerd.com) International Journal of Engineering Research and Devel...
IJERD (www.ijerd.com) International Journal of Engineering Research and Devel...
 
IJERD (www.ijerd.com) International Journal of Engineering Research and Devel...
IJERD (www.ijerd.com) International Journal of Engineering Research and Devel...IJERD (www.ijerd.com) International Journal of Engineering Research and Devel...
IJERD (www.ijerd.com) International Journal of Engineering Research and Devel...
 
Practical Digital Image Processing 4
Practical Digital Image Processing 4Practical Digital Image Processing 4
Practical Digital Image Processing 4
 
Performance Evaluation of Illumination Invariant Face Recognition Algorthims
Performance Evaluation of Illumination Invariant Face Recognition AlgorthimsPerformance Evaluation of Illumination Invariant Face Recognition Algorthims
Performance Evaluation of Illumination Invariant Face Recognition Algorthims
 
Computer Vision descriptors
Computer Vision descriptorsComputer Vision descriptors
Computer Vision descriptors
 
CV PPT.pptx
CV PPT.pptxCV PPT.pptx
CV PPT.pptx
 
An Assessment of Image Matching Algorithms in Depth Estimation
An Assessment of Image Matching Algorithms in Depth EstimationAn Assessment of Image Matching Algorithms in Depth Estimation
An Assessment of Image Matching Algorithms in Depth Estimation
 
Radial Fourier Analysis (RFA) Descriptor with Fourier-based Keypoint Orientation
Radial Fourier Analysis (RFA) Descriptor with Fourier-based Keypoint OrientationRadial Fourier Analysis (RFA) Descriptor with Fourier-based Keypoint Orientation
Radial Fourier Analysis (RFA) Descriptor with Fourier-based Keypoint Orientation
 
Object Capturing In A Cluttered Scene By Using Point Feature Matching
Object Capturing In A Cluttered Scene By Using Point Feature MatchingObject Capturing In A Cluttered Scene By Using Point Feature Matching
Object Capturing In A Cluttered Scene By Using Point Feature Matching
 
Features
FeaturesFeatures
Features
 
Improved Characters Feature Extraction and Matching Algorithm Based on SIFT
Improved Characters Feature Extraction and Matching Algorithm Based on SIFTImproved Characters Feature Extraction and Matching Algorithm Based on SIFT
Improved Characters Feature Extraction and Matching Algorithm Based on SIFT
 
K010236168
K010236168K010236168
K010236168
 
Segmentation - based Historical Handwritten Word Spotting using document-spec...
Segmentation - based Historical Handwritten Word Spotting using document-spec...Segmentation - based Historical Handwritten Word Spotting using document-spec...
Segmentation - based Historical Handwritten Word Spotting using document-spec...
 
MIT 6.870 - Template Matching and Histograms (Nicolas Pinto, MIT)
MIT 6.870 - Template Matching and Histograms (Nicolas Pinto, MIT)MIT 6.870 - Template Matching and Histograms (Nicolas Pinto, MIT)
MIT 6.870 - Template Matching and Histograms (Nicolas Pinto, MIT)
 
IRJET-Comparison of SIFT & SURF Corner Detector as Features and other Machine...
IRJET-Comparison of SIFT & SURF Corner Detector as Features and other Machine...IRJET-Comparison of SIFT & SURF Corner Detector as Features and other Machine...
IRJET-Comparison of SIFT & SURF Corner Detector as Features and other Machine...
 
A survey on feature descriptors for texture image classification
A survey on feature descriptors for texture image classificationA survey on feature descriptors for texture image classification
A survey on feature descriptors for texture image classification
 

Plus de Nisar Ahmed Rana

Digital radiographic image enhancement for improved visualization
Digital radiographic image enhancement for improved visualizationDigital radiographic image enhancement for improved visualization
Digital radiographic image enhancement for improved visualization
Nisar Ahmed Rana
 

Plus de Nisar Ahmed Rana (9)

Digital Image Communication and Enhancement
Digital Image Communication and EnhancementDigital Image Communication and Enhancement
Digital Image Communication and Enhancement
 
Project Proposal
Project ProposalProject Proposal
Project Proposal
 
Project proposal
Project proposalProject proposal
Project proposal
 
Say No to Child Labour
Say No to Child LabourSay No to Child Labour
Say No to Child Labour
 
Project Launch
Project LaunchProject Launch
Project Launch
 
Gandhara Civilization
Gandhara CivilizationGandhara Civilization
Gandhara Civilization
 
The application of image enhancement in color and grayscale images
The application of image enhancement in color and grayscale imagesThe application of image enhancement in color and grayscale images
The application of image enhancement in color and grayscale images
 
Digital radiographic image enhancement for improved visualization
Digital radiographic image enhancement for improved visualizationDigital radiographic image enhancement for improved visualization
Digital radiographic image enhancement for improved visualization
 
Project launch
Project launchProject launch
Project launch
 

Dernier

Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Dernier (20)

Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 

SIFT vs other Feature Descriptor

  • 1. SIFT vs Other Feature descriptor Nisar Ahmed Rana
  • 2. • SIFT is an algorithm in computer vision to detect and describe local features in images. • Feature description is obtained by extracting interesting points on the object in a training image. This description is used to identify the object in an image containing many other objects. • The relative positions between these features in the original scene shouldn't change from one image to another. For example, if only the four corners of a door were used as features, they would work regardless of the door's position; but if points in the frame were also used, the recognition would fail if the door is opened or closed.
  • 3.
  • 4. • Scale Invariance • Rotation Invariance • Illumination Invariance • Viewpoint Invariance (Mostly) • Computationally Expensive • Variant to Light Color Changes • Variant to non-uniform Illumination (i.e. Shadows)
  • 5. • The performance evolution of different local descriptors and their comparison with SIFT are summarized below: • SIFT and SIFT-like GLOH features exhibit the highest matching accuracies for an affine transformation of 50 degrees. After this transformation limit, results start to become unreliable. • Distinctiveness of descriptors is measured by summing the eigenvalues of the descriptors, obtained by the Principal components analysis of the descriptors normalized by their variance. This corresponds to the amount of variance captured by different descriptors, therefore, to their distinctiveness. PCA- SIFT (Principal Components Analysis applied to SIFT descriptors), GLOH (Gradient Location and Orientation Histogram) and SIFT features give the highest values.
  • 6. • SIFT-based descriptors outperform other contemporary local descriptors on both textured and structured scenes, with the difference in performance larger on the textured scene. • For scale changes in the range 2-2.5 and image rotations in the range 30 to 45 degrees, SIFT and SIFT-based descriptors again outperform other contemporary local descriptors with both textured and structured scene content. • Introduction of blur affects all local descriptors, especially those based on edges, like shape context, because edges disappear in the case of a strong blur. But GLOH, PCA-SIFT and SIFT still performed better than the others. This is also true for evaluation in the case of illumination changes.
  • 7. • SURF (Speeded Up Robust Features) is a robust local feature detector. It has shown to have similar performance to SIFT, while at the same time being much faster. • The standard version of SURF is several times faster than SIFT and claimed by its authors to be more robust against different image transformations than SIFT. SURF is based on sums of 2D Haar wavelet responses and makes an efficient use of integral images. • It uses an integer approximation to the determinant of Hessian blob detector, which can be computed extremely quickly with an integral image. For features, it uses the sum of the Haar wavelet response around the point of interest. Again, these can be computed with the aid of the integral image.
  • 8. • LESH is a recently proposed image descriptor which can be used to get a description of the underlying shape. • The LESH feature descriptor is built on local energy model of feature perception. • It is designed to be scale invariant. • It encodes the underlying shape by accumulating local energy of the underlying signal along several filter orientations, several local histograms from different parts of the image/patch are generated and concatenated together into a 128-dimensional compact spatial histogram. • The LESH features can be used in applications like shape-based image retrieval, object detection, and pose estimation.
  • 9. • GLOH is a robust image descriptor that can be used in computer vision tasks. • It is a SIFT-like descriptor that considers more spatial regions for the histograms. • The higher dimensionality of the descriptor is reduced to 64 through principal components analysis (PCA).