SlideShare une entreprise Scribd logo
1  sur  14
Télécharger pour lire hors ligne
Community Detection Resolution Limit Definition of resolution-free Results
Resolution-free community detection
V.A. Traag1, P. Van Dooren1, Y.E. Nesterov2
1ICTEAM
Universit´e Catholique de Louvain
2CORE
Universit´e Catholique de Louvain
8 April 2011
Community Detection Resolution Limit Definition of resolution-free Results
Outline
1 Community Detection
2 Resolution Limit
3 Definition of resolution-free
4 Results
Community Detection Resolution Limit Definition of resolution-free Results
Community Detection
• Detect ‘natural’ communities in network.
• Modularity approach: ‘relatively’ many links inside communities
Community Detection Resolution Limit Definition of resolution-free Results
Community Detection (formal)
• In general, commmunities should have relatively
many present links (benefit),
few missing links (cost)
Minimize H = −
ij
(aij Aij − bij (1 − Aij ))δ(σi , σj ),
• Compare to random null-model pij (RB)
aij = wij − bij and bij = γRBpij
HRB = −
ij
(Aij wij − γRBpij )δ(σi , σj ).
• Modularity (NG): use configuration null model
pij =
ki kj
2m
.
Reichardt and Bornholdt. Phys Rev E (2006) 74:1,016110
Newman and Girvan. Phys Rev E (2004) 69:2,026113
Community Detection Resolution Limit Definition of resolution-free Results
Resolution limit
• Modularity might miss ‘small’ communities.
• Merge two cliques in ring of cliques when
γRB <
q
nc(nc − 1) + 2
.
• Depends on the total size of the graph.
• Number of communities scales as
√
γRBm.
• For general null model, problem remains
since ij pij = 2m.
Fortunato and Barthlemy PNAS (2007) 104:1, pp. 36
Kumpala et al. Eur Phys J B (2007) 56, pp. 41-45
Community Detection Resolution Limit Definition of resolution-free Results
Evading the resolution limit
• New model (RN) suggested
aij = wij
bij = γRN
HRN = −
ij
(Aij (wij + γRN) − γRN)δ(σi , σj ).
• Claim: no resolution limit, as merge depends only on ‘local’
variables
γRN <
1
n2
c − 1
.
• But, take pij = ki kj (rescale γRB by 2m), we obtain
γRB <
1
2(nc(nc − 1) + 2)2
,
also only ‘local’ variables. Hence, also no resolution limit?
Ronhovde and Nussinov. Phys Rev E (2010) 81:4,046114.
Community Detection Resolution Limit Definition of resolution-free Results
Problems remain
Subgraph
• Assume pij = ki kj (rescale γRB by 2m)
• Then separate in large graph when γRB >
1
2(nc(nc − 1) + 2)2
• But merged in subgraph when γRB <
1
2(nc(nc − 1) + 1)2
Community Detection Resolution Limit Definition of resolution-free Results
Resolution limit revisited
Resolution-limit
Resolution-free
• Problem is not merging per s´e.
• Rather, cliques separate in subgraph, but merge in large graph
(or vice versa).
• Suggests following definition.
Community Detection Resolution Limit Definition of resolution-free Results
Resolution limit revisited
Resolution-limit
Resolution-free
Definition (Resolution-free)
Objective function H is called resolution-free if, whenever partition
C optimal for G, then subpartition D ⊂ C also optimal for
subgraph H(D) ⊂ G induced by D.
Community Detection Resolution Limit Definition of resolution-free Results
Defining resolution-free
Definition (Resolution-free)
Objective function H is called resolution-free if, whenever partition
C optimal for G, then subpartition D ⊂ C also optimal for
subgraph H(D) ⊂ G induced by D.
• Implicitly defines resolution limit: method is not resolution-free.
• Some nice properties of resolution-free methods:
Replace optimal subpartitions
Never split cliques (unless in single nodes)
Main questions
• Do such methods exist?
• What conditions to impose?
Community Detection Resolution Limit Definition of resolution-free Results
General framework
General community detection
H = −
ij
(aij Aij − bij (1 − Aij ))δ(σi , σj ),
RB model Set aij = wij − bij , bij = γRBpij .
RN model Set aij = wij , bij = γRN.
Simpler alternative
CPM Set aij = wij − bij and bij = γ. Leads to
H = −
ij
(Aij wij − γ)δ(σi , σj ).
Clear interpretation: γ is minimum density of a community
H = −
c
ec − γn2
c.
Community Detection Resolution Limit Definition of resolution-free Results
Main result
Do resolution-free methods exists?
Yes: Both RN and CPM are resolution-free, results from general
theorem.
What conditions to impose?
Sufficient condition: aij and bij should be ‘local’.
Definition (Local weights)
Weights aij , bij called local whenever for every subgraph H ⊂ G,
weights remain similar, i.e. aij (G) ∼ aij (H) and bij (G) ∼ bij (H).
• Implies local weigths aij and bij can only depend on node i and
node j, nothing further.
• RN and CPM use local weights, hence resolution-free.
• Not necessary condition, but seem to be few exceptions.
• So, RN and CPM (almost) only sensible definitions.
Community Detection Resolution Limit Definition of resolution-free Results
Performance (directed networks)
µ0 0.2 0.4 0.6 0.8 1.0
NMI
0.25
0.5
0.75
1
CPM Infomap Modularity ER
n = 103
n = 104
Community Detection Resolution Limit Definition of resolution-free Results
Conclusions
• Provided definition of resolution-free.
• Methods using local weights are resolution-free.
• Clarifies link between ‘local’ methods and resolution limit.
• Only few resolution-free methods.
• Tested CPM, performs superbly.
Thank you for your attention.
Questions?
Traag, Van Dooren and Nesterov arXiv:1104.3083v1

Contenu connexe

Tendances

Colorization with total variantion regularization
Colorization with total variantion regularizationColorization with total variantion regularization
Colorization with total variantion regularizationJÚLIO PEIXOTO
 
Image restoration
Image restorationImage restoration
Image restorationAzad Singh
 
Frequency Domain Image Enhancement Techniques
Frequency Domain Image Enhancement TechniquesFrequency Domain Image Enhancement Techniques
Frequency Domain Image Enhancement TechniquesDiwaker Pant
 
The Impact of Color Space and Intensity Normalization to Face Detection Perfo...
The Impact of Color Space and Intensity Normalization to Face Detection Perfo...The Impact of Color Space and Intensity Normalization to Face Detection Perfo...
The Impact of Color Space and Intensity Normalization to Face Detection Perfo...TELKOMNIKA JOURNAL
 
The application of image enhancement in color and grayscale images
The application of image enhancement in color and grayscale imagesThe application of image enhancement in color and grayscale images
The application of image enhancement in color and grayscale imagesNisar Ahmed Rana
 
NEIGHBOUR LOCAL VARIABILITY FOR MULTIFOCUS IMAGES FUSION
NEIGHBOUR LOCAL VARIABILITY FOR MULTIFOCUS IMAGES FUSIONNEIGHBOUR LOCAL VARIABILITY FOR MULTIFOCUS IMAGES FUSION
NEIGHBOUR LOCAL VARIABILITY FOR MULTIFOCUS IMAGES FUSIONsipij
 

Tendances (7)

Colorization with total variantion regularization
Colorization with total variantion regularizationColorization with total variantion regularization
Colorization with total variantion regularization
 
Image restoration
Image restorationImage restoration
Image restoration
 
Frequency Domain Image Enhancement Techniques
Frequency Domain Image Enhancement TechniquesFrequency Domain Image Enhancement Techniques
Frequency Domain Image Enhancement Techniques
 
The Impact of Color Space and Intensity Normalization to Face Detection Perfo...
The Impact of Color Space and Intensity Normalization to Face Detection Perfo...The Impact of Color Space and Intensity Normalization to Face Detection Perfo...
The Impact of Color Space and Intensity Normalization to Face Detection Perfo...
 
The application of image enhancement in color and grayscale images
The application of image enhancement in color and grayscale imagesThe application of image enhancement in color and grayscale images
The application of image enhancement in color and grayscale images
 
Canny edge detection
Canny edge detectionCanny edge detection
Canny edge detection
 
NEIGHBOUR LOCAL VARIABILITY FOR MULTIFOCUS IMAGES FUSION
NEIGHBOUR LOCAL VARIABILITY FOR MULTIFOCUS IMAGES FUSIONNEIGHBOUR LOCAL VARIABILITY FOR MULTIFOCUS IMAGES FUSION
NEIGHBOUR LOCAL VARIABILITY FOR MULTIFOCUS IMAGES FUSION
 

Similaire à Resolution-free community detection

Community structure in complex networks
Community structure in complex networksCommunity structure in complex networks
Community structure in complex networksVincent Traag
 
[KHBM] Application of network analysis based on cortical thickness to obsessi...
[KHBM] Application of network analysis based on cortical thickness to obsessi...[KHBM] Application of network analysis based on cortical thickness to obsessi...
[KHBM] Application of network analysis based on cortical thickness to obsessi...Seung-Goo Kim
 
Graph Analysis Beyond Linear Algebra
Graph Analysis Beyond Linear AlgebraGraph Analysis Beyond Linear Algebra
Graph Analysis Beyond Linear AlgebraJason Riedy
 
Collision Detection In 3D Environments
Collision Detection In 3D EnvironmentsCollision Detection In 3D Environments
Collision Detection In 3D EnvironmentsUng-Su Lee
 
columbus15_cattaneo.pdf
columbus15_cattaneo.pdfcolumbus15_cattaneo.pdf
columbus15_cattaneo.pdfAhmadM65
 
icml2004 tutorial on spectral clustering part I
icml2004 tutorial on spectral clustering part Iicml2004 tutorial on spectral clustering part I
icml2004 tutorial on spectral clustering part Izukun
 
optimizedBell.pptx
optimizedBell.pptxoptimizedBell.pptx
optimizedBell.pptxRichard Gill
 
optimizedBell.pptx
optimizedBell.pptxoptimizedBell.pptx
optimizedBell.pptxRichard Gill
 
Constraints and Global Optimization for Gene Prediction Overlap Resolution
Constraints and Global Optimization for Gene Prediction Overlap ResolutionConstraints and Global Optimization for Gene Prediction Overlap Resolution
Constraints and Global Optimization for Gene Prediction Overlap ResolutionChristian Have
 
On clusteredsteinertree slide-ver 1.1
On clusteredsteinertree slide-ver 1.1On clusteredsteinertree slide-ver 1.1
On clusteredsteinertree slide-ver 1.1VitAnhNguyn94
 
Methods of Manifold Learning for Dimension Reduction of Large Data Sets
Methods of Manifold Learning for Dimension Reduction of Large Data SetsMethods of Manifold Learning for Dimension Reduction of Large Data Sets
Methods of Manifold Learning for Dimension Reduction of Large Data SetsRyan B Harvey, CSDP, CSM
 
Seminar_Thoracic EIT_UWO
Seminar_Thoracic EIT_UWOSeminar_Thoracic EIT_UWO
Seminar_Thoracic EIT_UWOPeyman Rahmati
 
Asymmetric multipartite GHZ states and Bell inequalities
Asymmetric multipartite GHZ states and Bell inequalitiesAsymmetric multipartite GHZ states and Bell inequalities
Asymmetric multipartite GHZ states and Bell inequalitiesDarwin Gosal
 

Similaire à Resolution-free community detection (20)

Community structure in complex networks
Community structure in complex networksCommunity structure in complex networks
Community structure in complex networks
 
riken-RBlur-slides.pptx
riken-RBlur-slides.pptxriken-RBlur-slides.pptx
riken-RBlur-slides.pptx
 
[KHBM] Application of network analysis based on cortical thickness to obsessi...
[KHBM] Application of network analysis based on cortical thickness to obsessi...[KHBM] Application of network analysis based on cortical thickness to obsessi...
[KHBM] Application of network analysis based on cortical thickness to obsessi...
 
ilp-nlp-slides.pdf
ilp-nlp-slides.pdfilp-nlp-slides.pdf
ilp-nlp-slides.pdf
 
Graph Analysis Beyond Linear Algebra
Graph Analysis Beyond Linear AlgebraGraph Analysis Beyond Linear Algebra
Graph Analysis Beyond Linear Algebra
 
Collision Detection In 3D Environments
Collision Detection In 3D EnvironmentsCollision Detection In 3D Environments
Collision Detection In 3D Environments
 
columbus15_cattaneo.pdf
columbus15_cattaneo.pdfcolumbus15_cattaneo.pdf
columbus15_cattaneo.pdf
 
icml2004 tutorial on spectral clustering part I
icml2004 tutorial on spectral clustering part Iicml2004 tutorial on spectral clustering part I
icml2004 tutorial on spectral clustering part I
 
optimizedBell.pptx
optimizedBell.pptxoptimizedBell.pptx
optimizedBell.pptx
 
optimizedBell.pptx
optimizedBell.pptxoptimizedBell.pptx
optimizedBell.pptx
 
Constraints and Global Optimization for Gene Prediction Overlap Resolution
Constraints and Global Optimization for Gene Prediction Overlap ResolutionConstraints and Global Optimization for Gene Prediction Overlap Resolution
Constraints and Global Optimization for Gene Prediction Overlap Resolution
 
lec04.pptx
lec04.pptxlec04.pptx
lec04.pptx
 
On clusteredsteinertree slide-ver 1.1
On clusteredsteinertree slide-ver 1.1On clusteredsteinertree slide-ver 1.1
On clusteredsteinertree slide-ver 1.1
 
Methods of Manifold Learning for Dimension Reduction of Large Data Sets
Methods of Manifold Learning for Dimension Reduction of Large Data SetsMethods of Manifold Learning for Dimension Reduction of Large Data Sets
Methods of Manifold Learning for Dimension Reduction of Large Data Sets
 
unit 4 nearest neighbor.ppt
unit 4 nearest neighbor.pptunit 4 nearest neighbor.ppt
unit 4 nearest neighbor.ppt
 
Seminar_Thoracic EIT_UWO
Seminar_Thoracic EIT_UWOSeminar_Thoracic EIT_UWO
Seminar_Thoracic EIT_UWO
 
Asymmetric multipartite GHZ states and Bell inequalities
Asymmetric multipartite GHZ states and Bell inequalitiesAsymmetric multipartite GHZ states and Bell inequalities
Asymmetric multipartite GHZ states and Bell inequalities
 
Gtti 10032021
Gtti 10032021Gtti 10032021
Gtti 10032021
 
Presentation OCIP 2015
Presentation OCIP 2015Presentation OCIP 2015
Presentation OCIP 2015
 
normal distribution
normal distributionnormal distribution
normal distribution
 

Plus de Vincent Traag

Peer review uncertainty at the institutional level
Peer review uncertainty at the institutional levelPeer review uncertainty at the institutional level
Peer review uncertainty at the institutional levelVincent Traag
 
Replacing peer review by metrics in the UK REF?
Replacing peer review by metrics in the UK REF?Replacing peer review by metrics in the UK REF?
Replacing peer review by metrics in the UK REF?Vincent Traag
 
Use of the journal impact factor for assessing individual articles need not b...
Use of the journal impact factor for assessing individual articles need not b...Use of the journal impact factor for assessing individual articles need not b...
Use of the journal impact factor for assessing individual articles need not b...Vincent Traag
 
Uncovering important intermediate publications
Uncovering important intermediate publicationsUncovering important intermediate publications
Uncovering important intermediate publicationsVincent Traag
 
Complex contagion of campaign donations
Complex contagion of campaign donationsComplex contagion of campaign donations
Complex contagion of campaign donationsVincent Traag
 
Polarization and consensus in citation networks
Polarization and consensus in citation networksPolarization and consensus in citation networks
Polarization and consensus in citation networksVincent Traag
 
Introduction to complex networks
Introduction to complex networksIntroduction to complex networks
Introduction to complex networksVincent Traag
 
Public thesis defence: groups and reputation in social networks
Public thesis defence: groups and reputation in social networksPublic thesis defence: groups and reputation in social networks
Public thesis defence: groups and reputation in social networksVincent Traag
 
Structure of media attention
Structure of media attentionStructure of media attention
Structure of media attentionVincent Traag
 
Dynamics of Media Attention
Dynamics of Media AttentionDynamics of Media Attention
Dynamics of Media AttentionVincent Traag
 
Dynamical Models Explaining Social Balance
Dynamical Models Explaining Social BalanceDynamical Models Explaining Social Balance
Dynamical Models Explaining Social BalanceVincent Traag
 
Significant scales in community structure
Significant scales in community structureSignificant scales in community structure
Significant scales in community structureVincent Traag
 
Reconstructing Third World Elite Rotation Events from Newspapers
Reconstructing Third World Elite Rotation Events from NewspapersReconstructing Third World Elite Rotation Events from Newspapers
Reconstructing Third World Elite Rotation Events from NewspapersVincent Traag
 
Reputation Dynamics Through Gossiping
Reputation Dynamics Through GossipingReputation Dynamics Through Gossiping
Reputation Dynamics Through GossipingVincent Traag
 
Limits of community detection
Limits of community detectionLimits of community detection
Limits of community detectionVincent Traag
 
Cooperation, Reputation & Gossiping
Cooperation, Reputation & GossipingCooperation, Reputation & Gossiping
Cooperation, Reputation & GossipingVincent Traag
 
Cooperation, Reputation & Gossiping
Cooperation, Reputation & GossipingCooperation, Reputation & Gossiping
Cooperation, Reputation & GossipingVincent Traag
 
Exponential Ranking: Taking into account negative links.
Exponential Ranking: Taking into account negative links.Exponential Ranking: Taking into account negative links.
Exponential Ranking: Taking into account negative links.Vincent Traag
 
Social Event Detection
Social Event DetectionSocial Event Detection
Social Event DetectionVincent Traag
 
Cooperation, Reputation & Gossiping
Cooperation, Reputation & GossipingCooperation, Reputation & Gossiping
Cooperation, Reputation & GossipingVincent Traag
 

Plus de Vincent Traag (20)

Peer review uncertainty at the institutional level
Peer review uncertainty at the institutional levelPeer review uncertainty at the institutional level
Peer review uncertainty at the institutional level
 
Replacing peer review by metrics in the UK REF?
Replacing peer review by metrics in the UK REF?Replacing peer review by metrics in the UK REF?
Replacing peer review by metrics in the UK REF?
 
Use of the journal impact factor for assessing individual articles need not b...
Use of the journal impact factor for assessing individual articles need not b...Use of the journal impact factor for assessing individual articles need not b...
Use of the journal impact factor for assessing individual articles need not b...
 
Uncovering important intermediate publications
Uncovering important intermediate publicationsUncovering important intermediate publications
Uncovering important intermediate publications
 
Complex contagion of campaign donations
Complex contagion of campaign donationsComplex contagion of campaign donations
Complex contagion of campaign donations
 
Polarization and consensus in citation networks
Polarization and consensus in citation networksPolarization and consensus in citation networks
Polarization and consensus in citation networks
 
Introduction to complex networks
Introduction to complex networksIntroduction to complex networks
Introduction to complex networks
 
Public thesis defence: groups and reputation in social networks
Public thesis defence: groups and reputation in social networksPublic thesis defence: groups and reputation in social networks
Public thesis defence: groups and reputation in social networks
 
Structure of media attention
Structure of media attentionStructure of media attention
Structure of media attention
 
Dynamics of Media Attention
Dynamics of Media AttentionDynamics of Media Attention
Dynamics of Media Attention
 
Dynamical Models Explaining Social Balance
Dynamical Models Explaining Social BalanceDynamical Models Explaining Social Balance
Dynamical Models Explaining Social Balance
 
Significant scales in community structure
Significant scales in community structureSignificant scales in community structure
Significant scales in community structure
 
Reconstructing Third World Elite Rotation Events from Newspapers
Reconstructing Third World Elite Rotation Events from NewspapersReconstructing Third World Elite Rotation Events from Newspapers
Reconstructing Third World Elite Rotation Events from Newspapers
 
Reputation Dynamics Through Gossiping
Reputation Dynamics Through GossipingReputation Dynamics Through Gossiping
Reputation Dynamics Through Gossiping
 
Limits of community detection
Limits of community detectionLimits of community detection
Limits of community detection
 
Cooperation, Reputation & Gossiping
Cooperation, Reputation & GossipingCooperation, Reputation & Gossiping
Cooperation, Reputation & Gossiping
 
Cooperation, Reputation & Gossiping
Cooperation, Reputation & GossipingCooperation, Reputation & Gossiping
Cooperation, Reputation & Gossiping
 
Exponential Ranking: Taking into account negative links.
Exponential Ranking: Taking into account negative links.Exponential Ranking: Taking into account negative links.
Exponential Ranking: Taking into account negative links.
 
Social Event Detection
Social Event DetectionSocial Event Detection
Social Event Detection
 
Cooperation, Reputation & Gossiping
Cooperation, Reputation & GossipingCooperation, Reputation & Gossiping
Cooperation, Reputation & Gossiping
 

Dernier

Dr. E. Muralinath_ Blood indices_clinical aspects
Dr. E. Muralinath_ Blood indices_clinical  aspectsDr. E. Muralinath_ Blood indices_clinical  aspects
Dr. E. Muralinath_ Blood indices_clinical aspectsmuralinath2
 
Human & Veterinary Respiratory Physilogy_DR.E.Muralinath_Associate Professor....
Human & Veterinary Respiratory Physilogy_DR.E.Muralinath_Associate Professor....Human & Veterinary Respiratory Physilogy_DR.E.Muralinath_Associate Professor....
Human & Veterinary Respiratory Physilogy_DR.E.Muralinath_Associate Professor....muralinath2
 
Porella : features, morphology, anatomy, reproduction etc.
Porella : features, morphology, anatomy, reproduction etc.Porella : features, morphology, anatomy, reproduction etc.
Porella : features, morphology, anatomy, reproduction etc.Silpa
 
Thyroid Physiology_Dr.E. Muralinath_ Associate Professor
Thyroid Physiology_Dr.E. Muralinath_ Associate ProfessorThyroid Physiology_Dr.E. Muralinath_ Associate Professor
Thyroid Physiology_Dr.E. Muralinath_ Associate Professormuralinath2
 
Grade 7 - Lesson 1 - Microscope and Its Functions
Grade 7 - Lesson 1 - Microscope and Its FunctionsGrade 7 - Lesson 1 - Microscope and Its Functions
Grade 7 - Lesson 1 - Microscope and Its FunctionsOrtegaSyrineMay
 
module for grade 9 for distance learning
module for grade 9 for distance learningmodule for grade 9 for distance learning
module for grade 9 for distance learninglevieagacer
 
Cyathodium bryophyte: morphology, anatomy, reproduction etc.
Cyathodium bryophyte: morphology, anatomy, reproduction etc.Cyathodium bryophyte: morphology, anatomy, reproduction etc.
Cyathodium bryophyte: morphology, anatomy, reproduction etc.Silpa
 
Genetics and epigenetics of ADHD and comorbid conditions
Genetics and epigenetics of ADHD and comorbid conditionsGenetics and epigenetics of ADHD and comorbid conditions
Genetics and epigenetics of ADHD and comorbid conditionsbassianu17
 
THE ROLE OF BIOTECHNOLOGY IN THE ECONOMIC UPLIFT.pptx
THE ROLE OF BIOTECHNOLOGY IN THE ECONOMIC UPLIFT.pptxTHE ROLE OF BIOTECHNOLOGY IN THE ECONOMIC UPLIFT.pptx
THE ROLE OF BIOTECHNOLOGY IN THE ECONOMIC UPLIFT.pptxANSARKHAN96
 
Gwalior ❤CALL GIRL 84099*07087 ❤CALL GIRLS IN Gwalior ESCORT SERVICE❤CALL GIRL
Gwalior ❤CALL GIRL 84099*07087 ❤CALL GIRLS IN Gwalior ESCORT SERVICE❤CALL GIRLGwalior ❤CALL GIRL 84099*07087 ❤CALL GIRLS IN Gwalior ESCORT SERVICE❤CALL GIRL
Gwalior ❤CALL GIRL 84099*07087 ❤CALL GIRLS IN Gwalior ESCORT SERVICE❤CALL GIRLkantirani197
 
Cyanide resistant respiration pathway.pptx
Cyanide resistant respiration pathway.pptxCyanide resistant respiration pathway.pptx
Cyanide resistant respiration pathway.pptxSilpa
 
Bhiwandi Bhiwandi ❤CALL GIRL 7870993772 ❤CALL GIRLS ESCORT SERVICE In Bhiwan...
Bhiwandi Bhiwandi ❤CALL GIRL 7870993772 ❤CALL GIRLS  ESCORT SERVICE In Bhiwan...Bhiwandi Bhiwandi ❤CALL GIRL 7870993772 ❤CALL GIRLS  ESCORT SERVICE In Bhiwan...
Bhiwandi Bhiwandi ❤CALL GIRL 7870993772 ❤CALL GIRLS ESCORT SERVICE In Bhiwan...Monika Rani
 
Zoology 5th semester notes( Sumit_yadav).pdf
Zoology 5th semester notes( Sumit_yadav).pdfZoology 5th semester notes( Sumit_yadav).pdf
Zoology 5th semester notes( Sumit_yadav).pdfSumit Kumar yadav
 
biology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGYbiology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGY1301aanya
 
Human genetics..........................pptx
Human genetics..........................pptxHuman genetics..........................pptx
Human genetics..........................pptxSilpa
 
LUNULARIA -features, morphology, anatomy ,reproduction etc.
LUNULARIA -features, morphology, anatomy ,reproduction etc.LUNULARIA -features, morphology, anatomy ,reproduction etc.
LUNULARIA -features, morphology, anatomy ,reproduction etc.Silpa
 
Call Girls Ahmedabad +917728919243 call me Independent Escort Service
Call Girls Ahmedabad +917728919243 call me Independent Escort ServiceCall Girls Ahmedabad +917728919243 call me Independent Escort Service
Call Girls Ahmedabad +917728919243 call me Independent Escort Serviceshivanisharma5244
 
Climate Change Impacts on Terrestrial and Aquatic Ecosystems.pptx
Climate Change Impacts on Terrestrial and Aquatic Ecosystems.pptxClimate Change Impacts on Terrestrial and Aquatic Ecosystems.pptx
Climate Change Impacts on Terrestrial and Aquatic Ecosystems.pptxDiariAli
 
Chemistry 5th semester paper 1st Notes.pdf
Chemistry 5th semester paper 1st Notes.pdfChemistry 5th semester paper 1st Notes.pdf
Chemistry 5th semester paper 1st Notes.pdfSumit Kumar yadav
 

Dernier (20)

Dr. E. Muralinath_ Blood indices_clinical aspects
Dr. E. Muralinath_ Blood indices_clinical  aspectsDr. E. Muralinath_ Blood indices_clinical  aspects
Dr. E. Muralinath_ Blood indices_clinical aspects
 
Human & Veterinary Respiratory Physilogy_DR.E.Muralinath_Associate Professor....
Human & Veterinary Respiratory Physilogy_DR.E.Muralinath_Associate Professor....Human & Veterinary Respiratory Physilogy_DR.E.Muralinath_Associate Professor....
Human & Veterinary Respiratory Physilogy_DR.E.Muralinath_Associate Professor....
 
Porella : features, morphology, anatomy, reproduction etc.
Porella : features, morphology, anatomy, reproduction etc.Porella : features, morphology, anatomy, reproduction etc.
Porella : features, morphology, anatomy, reproduction etc.
 
Thyroid Physiology_Dr.E. Muralinath_ Associate Professor
Thyroid Physiology_Dr.E. Muralinath_ Associate ProfessorThyroid Physiology_Dr.E. Muralinath_ Associate Professor
Thyroid Physiology_Dr.E. Muralinath_ Associate Professor
 
Grade 7 - Lesson 1 - Microscope and Its Functions
Grade 7 - Lesson 1 - Microscope and Its FunctionsGrade 7 - Lesson 1 - Microscope and Its Functions
Grade 7 - Lesson 1 - Microscope and Its Functions
 
module for grade 9 for distance learning
module for grade 9 for distance learningmodule for grade 9 for distance learning
module for grade 9 for distance learning
 
Cyathodium bryophyte: morphology, anatomy, reproduction etc.
Cyathodium bryophyte: morphology, anatomy, reproduction etc.Cyathodium bryophyte: morphology, anatomy, reproduction etc.
Cyathodium bryophyte: morphology, anatomy, reproduction etc.
 
Genetics and epigenetics of ADHD and comorbid conditions
Genetics and epigenetics of ADHD and comorbid conditionsGenetics and epigenetics of ADHD and comorbid conditions
Genetics and epigenetics of ADHD and comorbid conditions
 
THE ROLE OF BIOTECHNOLOGY IN THE ECONOMIC UPLIFT.pptx
THE ROLE OF BIOTECHNOLOGY IN THE ECONOMIC UPLIFT.pptxTHE ROLE OF BIOTECHNOLOGY IN THE ECONOMIC UPLIFT.pptx
THE ROLE OF BIOTECHNOLOGY IN THE ECONOMIC UPLIFT.pptx
 
Gwalior ❤CALL GIRL 84099*07087 ❤CALL GIRLS IN Gwalior ESCORT SERVICE❤CALL GIRL
Gwalior ❤CALL GIRL 84099*07087 ❤CALL GIRLS IN Gwalior ESCORT SERVICE❤CALL GIRLGwalior ❤CALL GIRL 84099*07087 ❤CALL GIRLS IN Gwalior ESCORT SERVICE❤CALL GIRL
Gwalior ❤CALL GIRL 84099*07087 ❤CALL GIRLS IN Gwalior ESCORT SERVICE❤CALL GIRL
 
Cyanide resistant respiration pathway.pptx
Cyanide resistant respiration pathway.pptxCyanide resistant respiration pathway.pptx
Cyanide resistant respiration pathway.pptx
 
Bhiwandi Bhiwandi ❤CALL GIRL 7870993772 ❤CALL GIRLS ESCORT SERVICE In Bhiwan...
Bhiwandi Bhiwandi ❤CALL GIRL 7870993772 ❤CALL GIRLS  ESCORT SERVICE In Bhiwan...Bhiwandi Bhiwandi ❤CALL GIRL 7870993772 ❤CALL GIRLS  ESCORT SERVICE In Bhiwan...
Bhiwandi Bhiwandi ❤CALL GIRL 7870993772 ❤CALL GIRLS ESCORT SERVICE In Bhiwan...
 
Zoology 5th semester notes( Sumit_yadav).pdf
Zoology 5th semester notes( Sumit_yadav).pdfZoology 5th semester notes( Sumit_yadav).pdf
Zoology 5th semester notes( Sumit_yadav).pdf
 
PATNA CALL GIRLS 8617370543 LOW PRICE ESCORT SERVICE
PATNA CALL GIRLS 8617370543 LOW PRICE ESCORT SERVICEPATNA CALL GIRLS 8617370543 LOW PRICE ESCORT SERVICE
PATNA CALL GIRLS 8617370543 LOW PRICE ESCORT SERVICE
 
biology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGYbiology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGY
 
Human genetics..........................pptx
Human genetics..........................pptxHuman genetics..........................pptx
Human genetics..........................pptx
 
LUNULARIA -features, morphology, anatomy ,reproduction etc.
LUNULARIA -features, morphology, anatomy ,reproduction etc.LUNULARIA -features, morphology, anatomy ,reproduction etc.
LUNULARIA -features, morphology, anatomy ,reproduction etc.
 
Call Girls Ahmedabad +917728919243 call me Independent Escort Service
Call Girls Ahmedabad +917728919243 call me Independent Escort ServiceCall Girls Ahmedabad +917728919243 call me Independent Escort Service
Call Girls Ahmedabad +917728919243 call me Independent Escort Service
 
Climate Change Impacts on Terrestrial and Aquatic Ecosystems.pptx
Climate Change Impacts on Terrestrial and Aquatic Ecosystems.pptxClimate Change Impacts on Terrestrial and Aquatic Ecosystems.pptx
Climate Change Impacts on Terrestrial and Aquatic Ecosystems.pptx
 
Chemistry 5th semester paper 1st Notes.pdf
Chemistry 5th semester paper 1st Notes.pdfChemistry 5th semester paper 1st Notes.pdf
Chemistry 5th semester paper 1st Notes.pdf
 

Resolution-free community detection

  • 1. Community Detection Resolution Limit Definition of resolution-free Results Resolution-free community detection V.A. Traag1, P. Van Dooren1, Y.E. Nesterov2 1ICTEAM Universit´e Catholique de Louvain 2CORE Universit´e Catholique de Louvain 8 April 2011
  • 2. Community Detection Resolution Limit Definition of resolution-free Results Outline 1 Community Detection 2 Resolution Limit 3 Definition of resolution-free 4 Results
  • 3. Community Detection Resolution Limit Definition of resolution-free Results Community Detection • Detect ‘natural’ communities in network. • Modularity approach: ‘relatively’ many links inside communities
  • 4. Community Detection Resolution Limit Definition of resolution-free Results Community Detection (formal) • In general, commmunities should have relatively many present links (benefit), few missing links (cost) Minimize H = − ij (aij Aij − bij (1 − Aij ))δ(σi , σj ), • Compare to random null-model pij (RB) aij = wij − bij and bij = γRBpij HRB = − ij (Aij wij − γRBpij )δ(σi , σj ). • Modularity (NG): use configuration null model pij = ki kj 2m . Reichardt and Bornholdt. Phys Rev E (2006) 74:1,016110 Newman and Girvan. Phys Rev E (2004) 69:2,026113
  • 5. Community Detection Resolution Limit Definition of resolution-free Results Resolution limit • Modularity might miss ‘small’ communities. • Merge two cliques in ring of cliques when γRB < q nc(nc − 1) + 2 . • Depends on the total size of the graph. • Number of communities scales as √ γRBm. • For general null model, problem remains since ij pij = 2m. Fortunato and Barthlemy PNAS (2007) 104:1, pp. 36 Kumpala et al. Eur Phys J B (2007) 56, pp. 41-45
  • 6. Community Detection Resolution Limit Definition of resolution-free Results Evading the resolution limit • New model (RN) suggested aij = wij bij = γRN HRN = − ij (Aij (wij + γRN) − γRN)δ(σi , σj ). • Claim: no resolution limit, as merge depends only on ‘local’ variables γRN < 1 n2 c − 1 . • But, take pij = ki kj (rescale γRB by 2m), we obtain γRB < 1 2(nc(nc − 1) + 2)2 , also only ‘local’ variables. Hence, also no resolution limit? Ronhovde and Nussinov. Phys Rev E (2010) 81:4,046114.
  • 7. Community Detection Resolution Limit Definition of resolution-free Results Problems remain Subgraph • Assume pij = ki kj (rescale γRB by 2m) • Then separate in large graph when γRB > 1 2(nc(nc − 1) + 2)2 • But merged in subgraph when γRB < 1 2(nc(nc − 1) + 1)2
  • 8. Community Detection Resolution Limit Definition of resolution-free Results Resolution limit revisited Resolution-limit Resolution-free • Problem is not merging per s´e. • Rather, cliques separate in subgraph, but merge in large graph (or vice versa). • Suggests following definition.
  • 9. Community Detection Resolution Limit Definition of resolution-free Results Resolution limit revisited Resolution-limit Resolution-free Definition (Resolution-free) Objective function H is called resolution-free if, whenever partition C optimal for G, then subpartition D ⊂ C also optimal for subgraph H(D) ⊂ G induced by D.
  • 10. Community Detection Resolution Limit Definition of resolution-free Results Defining resolution-free Definition (Resolution-free) Objective function H is called resolution-free if, whenever partition C optimal for G, then subpartition D ⊂ C also optimal for subgraph H(D) ⊂ G induced by D. • Implicitly defines resolution limit: method is not resolution-free. • Some nice properties of resolution-free methods: Replace optimal subpartitions Never split cliques (unless in single nodes) Main questions • Do such methods exist? • What conditions to impose?
  • 11. Community Detection Resolution Limit Definition of resolution-free Results General framework General community detection H = − ij (aij Aij − bij (1 − Aij ))δ(σi , σj ), RB model Set aij = wij − bij , bij = γRBpij . RN model Set aij = wij , bij = γRN. Simpler alternative CPM Set aij = wij − bij and bij = γ. Leads to H = − ij (Aij wij − γ)δ(σi , σj ). Clear interpretation: γ is minimum density of a community H = − c ec − γn2 c.
  • 12. Community Detection Resolution Limit Definition of resolution-free Results Main result Do resolution-free methods exists? Yes: Both RN and CPM are resolution-free, results from general theorem. What conditions to impose? Sufficient condition: aij and bij should be ‘local’. Definition (Local weights) Weights aij , bij called local whenever for every subgraph H ⊂ G, weights remain similar, i.e. aij (G) ∼ aij (H) and bij (G) ∼ bij (H). • Implies local weigths aij and bij can only depend on node i and node j, nothing further. • RN and CPM use local weights, hence resolution-free. • Not necessary condition, but seem to be few exceptions. • So, RN and CPM (almost) only sensible definitions.
  • 13. Community Detection Resolution Limit Definition of resolution-free Results Performance (directed networks) µ0 0.2 0.4 0.6 0.8 1.0 NMI 0.25 0.5 0.75 1 CPM Infomap Modularity ER n = 103 n = 104
  • 14. Community Detection Resolution Limit Definition of resolution-free Results Conclusions • Provided definition of resolution-free. • Methods using local weights are resolution-free. • Clarifies link between ‘local’ methods and resolution limit. • Only few resolution-free methods. • Tested CPM, performs superbly. Thank you for your attention. Questions? Traag, Van Dooren and Nesterov arXiv:1104.3083v1