SlideShare une entreprise Scribd logo
1  sur  1
LEARNING TO RANK USING USER CLICKS AND VISUAL FEATURES FOR IMAGE
RETRIEVAL
ABSTRACT
The inconsistency between textual features andvisual contents can cause poor image
search results. To solvethis problem, click features, which are more reliable than
textualinformation in justifying the relevance between a query andclicked images, are adopted in
image ranking model. However, theexisting ranking model cannot integrate visual features,
which areefficient in refining the click-based search results. In this paper,we propose a novel
ranking model based on the learning to rankframework. Visual features and click features are
simultaneouslyutilized to obtain the ranking model. Specifically, the proposedapproach is based
on large margin structured output learningand the visual consistency is integrated with the click
featuresthrough a hypergraphregularizer term. In accordance with thefast alternating linearization
method, we design a novel algorithmto optimize the objective function. This algorithm
alternately minimizestwo different approximations of the original objective functionby keeping
one function unchanged and linear zing the other.We conduct experiments on a large-scale
dataset collected fromthe Microsoft Bing image search engine, and the results demonstratethat
the proposed learning to rank models based on visualfeatures and user clicks outperforms state-
of-the-art algorithms.

Contenu connexe

En vedette (7)

Portales para compartir video
Portales para compartir videoPortales para compartir video
Portales para compartir video
 
complicitat
complicitatcomplicitat
complicitat
 
Mico newsletter april 2016
Mico newsletter april 2016 Mico newsletter april 2016
Mico newsletter april 2016
 
Acróstico
AcrósticoAcróstico
Acróstico
 
Education Certficate - KKuchumovJavaI
Education Certficate - KKuchumovJavaIEducation Certficate - KKuchumovJavaI
Education Certficate - KKuchumovJavaI
 
Human development degree program pacific oaks college
Human development degree program   pacific oaks collegeHuman development degree program   pacific oaks college
Human development degree program pacific oaks college
 
Security/Risk issues
Security/Risk issuesSecurity/Risk issues
Security/Risk issues
 

Similaire à Learning to rank using user clicks and visual features for image retrieval

Similaire à Learning to rank using user clicks and visual features for image retrieval (20)

click prediction for web image reranking using multimodal sparse coding
click prediction for web image reranking using multimodal sparse codingclick prediction for web image reranking using multimodal sparse coding
click prediction for web image reranking using multimodal sparse coding
 
JPD1437 Click Prediction for Web Image Reranking Using Multimodal Sparse Coding
JPD1437  Click Prediction for Web Image Reranking Using Multimodal Sparse CodingJPD1437  Click Prediction for Web Image Reranking Using Multimodal Sparse Coding
JPD1437 Click Prediction for Web Image Reranking Using Multimodal Sparse Coding
 
7
77
7
 
7
77
7
 
2014 IEEE JAVA IMAGE PROCESSING PROJECT Click prediction-for-web-image-rerank...
2014 IEEE JAVA IMAGE PROCESSING PROJECT Click prediction-for-web-image-rerank...2014 IEEE JAVA IMAGE PROCESSING PROJECT Click prediction-for-web-image-rerank...
2014 IEEE JAVA IMAGE PROCESSING PROJECT Click prediction-for-web-image-rerank...
 
2014 IEEE JAVA IMAGE PROCESSING PROJECT Click prediction-for-web-image-rerank...
2014 IEEE JAVA IMAGE PROCESSING PROJECT Click prediction-for-web-image-rerank...2014 IEEE JAVA IMAGE PROCESSING PROJECT Click prediction-for-web-image-rerank...
2014 IEEE JAVA IMAGE PROCESSING PROJECT Click prediction-for-web-image-rerank...
 
2014 IEEE JAVA IMAGE PROCESSING PROJECT Click prediction for web image rerank...
2014 IEEE JAVA IMAGE PROCESSING PROJECT Click prediction for web image rerank...2014 IEEE JAVA IMAGE PROCESSING PROJECT Click prediction for web image rerank...
2014 IEEE JAVA IMAGE PROCESSING PROJECT Click prediction for web image rerank...
 
IEEE 2014 JAVA IMAGE PROCESSING PROJECTS Click prediction-for-web-image-reran...
IEEE 2014 JAVA IMAGE PROCESSING PROJECTS Click prediction-for-web-image-reran...IEEE 2014 JAVA IMAGE PROCESSING PROJECTS Click prediction-for-web-image-reran...
IEEE 2014 JAVA IMAGE PROCESSING PROJECTS Click prediction-for-web-image-reran...
 
2014 IEEE DOTNET IMAGE PROCESSING PROJECT Click prediction-for-web-image-rera...
2014 IEEE DOTNET IMAGE PROCESSING PROJECT Click prediction-for-web-image-rera...2014 IEEE DOTNET IMAGE PROCESSING PROJECT Click prediction-for-web-image-rera...
2014 IEEE DOTNET IMAGE PROCESSING PROJECT Click prediction-for-web-image-rera...
 
IEEE 2014 DOTNET IMAGE PROCESSING PROJECTS Click prediction-for-web-image-rer...
IEEE 2014 DOTNET IMAGE PROCESSING PROJECTS Click prediction-for-web-image-rer...IEEE 2014 DOTNET IMAGE PROCESSING PROJECTS Click prediction-for-web-image-rer...
IEEE 2014 DOTNET IMAGE PROCESSING PROJECTS Click prediction-for-web-image-rer...
 
An attribute assisted reranking model
An attribute assisted reranking modelAn attribute assisted reranking model
An attribute assisted reranking model
 
M phil-computer-science-pattern-recognition-projects
M phil-computer-science-pattern-recognition-projectsM phil-computer-science-pattern-recognition-projects
M phil-computer-science-pattern-recognition-projects
 
web image re-ranking using query-specific semantic signatures
web image re-ranking using query-specific semantic signaturesweb image re-ranking using query-specific semantic signatures
web image re-ranking using query-specific semantic signatures
 
An attribute
An attributeAn attribute
An attribute
 
An attribute assisted reranking model for web image search
An attribute assisted reranking model for web image searchAn attribute assisted reranking model for web image search
An attribute assisted reranking model for web image search
 
WEB IMAGE RE-RANKING USING QUERY-SPECIFIC SEMANTIC SIGNATURES
WEB IMAGE RE-RANKING USING QUERY-SPECIFIC SEMANTIC SIGNATURESWEB IMAGE RE-RANKING USING QUERY-SPECIFIC SEMANTIC SIGNATURES
WEB IMAGE RE-RANKING USING QUERY-SPECIFIC SEMANTIC SIGNATURES
 
JPD1436 Web Image Re-Ranking Using Query-Specific Semantic Signatures
JPD1436   Web Image Re-Ranking Using Query-Specific Semantic SignaturesJPD1436   Web Image Re-Ranking Using Query-Specific Semantic Signatures
JPD1436 Web Image Re-Ranking Using Query-Specific Semantic Signatures
 
An attribute assisted reranking
An attribute assisted rerankingAn attribute assisted reranking
An attribute assisted reranking
 
Image Based Information Retrieval Using Deep Learning and Clustering Techniques
Image Based Information Retrieval Using Deep Learning and Clustering TechniquesImage Based Information Retrieval Using Deep Learning and Clustering Techniques
Image Based Information Retrieval Using Deep Learning and Clustering Techniques
 
Image Based Information Retrieval Using Deep Learning and Clustering Techniques
Image Based Information Retrieval Using Deep Learning and Clustering TechniquesImage Based Information Retrieval Using Deep Learning and Clustering Techniques
Image Based Information Retrieval Using Deep Learning and Clustering Techniques
 

Plus de I3E Technologies

Plus de I3E Technologies (20)

Add
AddAdd
Add
 
Design of a low voltage low-dropout regulator
Design of a low voltage low-dropout regulatorDesign of a low voltage low-dropout regulator
Design of a low voltage low-dropout regulator
 
An efficient constant multiplier architecture based on vertical horizontal bi...
An efficient constant multiplier architecture based on vertical horizontal bi...An efficient constant multiplier architecture based on vertical horizontal bi...
An efficient constant multiplier architecture based on vertical horizontal bi...
 
Aging aware reliable multiplier design with adaptive hold logic
Aging aware reliable multiplier design with adaptive hold logicAging aware reliable multiplier design with adaptive hold logic
Aging aware reliable multiplier design with adaptive hold logic
 
A high performance fir filter architecture for fixed and reconfigurable appli...
A high performance fir filter architecture for fixed and reconfigurable appli...A high performance fir filter architecture for fixed and reconfigurable appli...
A high performance fir filter architecture for fixed and reconfigurable appli...
 
A generalized algorithm and reconfigurable architecture for efficient and sca...
A generalized algorithm and reconfigurable architecture for efficient and sca...A generalized algorithm and reconfigurable architecture for efficient and sca...
A generalized algorithm and reconfigurable architecture for efficient and sca...
 
A combined sdc sdf architecture for normal i o pipelined radix-2 fft
A combined sdc sdf architecture for normal i o pipelined radix-2 fftA combined sdc sdf architecture for normal i o pipelined radix-2 fft
A combined sdc sdf architecture for normal i o pipelined radix-2 fft
 
Reverse converter design via parallel prefix adders novel components, method...
Reverse converter design via parallel prefix adders  novel components, method...Reverse converter design via parallel prefix adders  novel components, method...
Reverse converter design via parallel prefix adders novel components, method...
 
Pre encoded multipliers based on non-redundant radix-4 signed-digit encoding
Pre encoded multipliers based on non-redundant radix-4 signed-digit encodingPre encoded multipliers based on non-redundant radix-4 signed-digit encoding
Pre encoded multipliers based on non-redundant radix-4 signed-digit encoding
 
Energy optimized subthreshold vlsi logic family with unbalanced pull up down ...
Energy optimized subthreshold vlsi logic family with unbalanced pull up down ...Energy optimized subthreshold vlsi logic family with unbalanced pull up down ...
Energy optimized subthreshold vlsi logic family with unbalanced pull up down ...
 
Variable form carrier-based pwm for boost-voltage motor driver with a charge-...
Variable form carrier-based pwm for boost-voltage motor driver with a charge-...Variable form carrier-based pwm for boost-voltage motor driver with a charge-...
Variable form carrier-based pwm for boost-voltage motor driver with a charge-...
 
Ultrasparse ac link converters
Ultrasparse ac link convertersUltrasparse ac link converters
Ultrasparse ac link converters
 
Single inductor dual-output buck–boost power factor correction converter
Single inductor dual-output buck–boost power factor correction converterSingle inductor dual-output buck–boost power factor correction converter
Single inductor dual-output buck–boost power factor correction converter
 
Ripple minimization through harmonic elimination in asymmetric interleaved mu...
Ripple minimization through harmonic elimination in asymmetric interleaved mu...Ripple minimization through harmonic elimination in asymmetric interleaved mu...
Ripple minimization through harmonic elimination in asymmetric interleaved mu...
 
Resonance analysis and soft switching design of isolated boost converter with...
Resonance analysis and soft switching design of isolated boost converter with...Resonance analysis and soft switching design of isolated boost converter with...
Resonance analysis and soft switching design of isolated boost converter with...
 
Reliability evaluation of conventional and interleaved dc–dc boost converters
Reliability evaluation of conventional and interleaved dc–dc boost convertersReliability evaluation of conventional and interleaved dc–dc boost converters
Reliability evaluation of conventional and interleaved dc–dc boost converters
 
Power factor corrected zeta converter based improved power quality switched m...
Power factor corrected zeta converter based improved power quality switched m...Power factor corrected zeta converter based improved power quality switched m...
Power factor corrected zeta converter based improved power quality switched m...
 
Pfc cuk converter fed bldc motor drive
Pfc cuk converter fed bldc motor drivePfc cuk converter fed bldc motor drive
Pfc cuk converter fed bldc motor drive
 
Optimized operation of current fed dual active bridge dc dc converter for pv ...
Optimized operation of current fed dual active bridge dc dc converter for pv ...Optimized operation of current fed dual active bridge dc dc converter for pv ...
Optimized operation of current fed dual active bridge dc dc converter for pv ...
 
Online variable topology type photovoltaic grid-connected inverter
Online variable topology type photovoltaic grid-connected inverterOnline variable topology type photovoltaic grid-connected inverter
Online variable topology type photovoltaic grid-connected inverter
 

Learning to rank using user clicks and visual features for image retrieval

  • 1. LEARNING TO RANK USING USER CLICKS AND VISUAL FEATURES FOR IMAGE RETRIEVAL ABSTRACT The inconsistency between textual features andvisual contents can cause poor image search results. To solvethis problem, click features, which are more reliable than textualinformation in justifying the relevance between a query andclicked images, are adopted in image ranking model. However, theexisting ranking model cannot integrate visual features, which areefficient in refining the click-based search results. In this paper,we propose a novel ranking model based on the learning to rankframework. Visual features and click features are simultaneouslyutilized to obtain the ranking model. Specifically, the proposedapproach is based on large margin structured output learningand the visual consistency is integrated with the click featuresthrough a hypergraphregularizer term. In accordance with thefast alternating linearization method, we design a novel algorithmto optimize the objective function. This algorithm alternately minimizestwo different approximations of the original objective functionby keeping one function unchanged and linear zing the other.We conduct experiments on a large-scale dataset collected fromthe Microsoft Bing image search engine, and the results demonstratethat the proposed learning to rank models based on visualfeatures and user clicks outperforms state- of-the-art algorithms.