SlideShare une entreprise Scribd logo
1  sur  16
Télécharger pour lire hors ligne
Community Detection with Negative Links
Vincent Traag1 Jeroen Bruggeman2
1Catholic University of Louvain, Belgium
2University of Amsterdam, Netherlands
June 9, 2009
Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 1 / 15
Outline
1 Introduction
2 Social Balance Theory
3 Modularity
4 Including negative links
5 Empirical example
Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 2 / 15
Introduction
• Community detection is succesfully applied in a number of fields.
• Whether a link is positive or negative usually ignored.
• It is highly relevant for
• Hyperlinks on webpages (“good” sites, instead of “important” sites)
• References in blogs (opinion clustering, not thematical)
• Trust relationships (e.g. P2P systems)
• International relationships (conflict and cooperation)
• . . .
Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 3 / 15
Social Balance Theory
C1
C2
AB
C
D
• Triads (sets of three nodes) are balanced if
their relationships are “symmetric”.
• Triad i, j, k is balanced if AijAikAjk = 1.
• If network is balanced, is can be split in two
clusters. (Harary, 1953)
• A network is said to be k-balanced if it can be
split into k clusters.
• For unbalanced networks, how can the nodes
be clustered?
Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 4 / 15
Social Balance Theory
C1
C2 C3
AB
D E
C
• Triads (sets of three nodes) are balanced if
their relationships are “symmetric”.
• Triad i, j, k is balanced if AijAikAjk = 1.
• If network is balanced, is can be split in two
clusters. (Harary, 1953)
• A network is said to be k-balanced if it can be
split into k clusters.
• For unbalanced networks, how can the nodes
be clustered?
Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 4 / 15
Frustration
• Try to come close to the ideal ’balanced’ network.
• Minimize links that violate the conditions of k-balance:
• Negative links within clusters,
• Positive links between clusters.
Definition
Frustration
F =
ij
αA−
ij δ(σi , σj ) + (1 − α)A+
ij (1 − δ(σi , σj )).
• If α = 1
2 this is equivalent to minimizing
F =
ij
(A+
ij − A−
ij )δ(σi , σj ) =
ij
Aij δ(σi , σj ).
Approach by Doreian and Mrvar, Social Networks, Vol. 18, (1996).
Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 5 / 15
Problems with frustration
• If there are no negative links,
there is only one cluster.
• Even minimally postive
connected group is in one
cluster.
• Absent links do not join or
seperate a cluster.
• Defines unclearly a community.
Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 6 / 15
Modularity
Modularity has been succesfully applied in community detection.
Definition (Modularity)
Q =
1
m
ij
(Aij − pij )δ(σi , σj )
=
1
m c
ac − ec.
Newman & Girvan, Phys Rev E 69, (2004).
Maximizing modularity yields a ”good” community assignment.
Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 7 / 15
Potts approach
• Potts approach by Reichardt and Bornholdt (2006): reward “allowed”
links, penalise “forbidden” links.
Allowed • Links within communities
(reward aij = 1 − γpij).
Forbidden • Absent links within communities
(penalty bij = γpij).
• Formulated as an “energy/cost” function (Hamiltonian):
H =
ij
−aijAijδ(σi , σj ) + bij (1 − Aij)δ(σi , σj )
• Reformulated equals modularity (if γ = 1)
Q = −
1
m
H =
1
m
ij
(Aij − γpij )δ(σi , σj )
• Results in a tuneable (γ) version of modularity.
Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 8 / 15
Problem with negative links
ak = 1 b k = 1
c k = −1
Negative links poses problem for modularity.
Expected values pij not well defined.
A =


+ + −
+ + −
− − +


Q =
1
m
ij
Aij −
ki kj
m
δ(σi , σj )
= 0
Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 9 / 15
Allowing negative links
• Solution is to separate the positive and negative part.
• Then change “allowed” and “forbidden” links:
Allowed • Positive links within communities
(reward aij = γp+
ij ).
• Absent negative links within communities
(reward dij = λp−
ij ).
Forbidden • Absent positive links within communities
(penalty bij = 1 − γp+
ij ).
• Negative links within communities
(penalty cij = 1 − λp−
ij ).
• Results in two separate Hamiltonians
H+ = − ij (A+
ij − γp+
ij )δ(σi , σj ) and
H− = ij (A−
ij − λp−
ij )δ(σi , σj ).
Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 10 / 15
Hamiltonian
• When both Hamiltonians are weighted equally this equals minimizing
H = H+
+ H−
=
ij
(Aij − (γp+
ij − λp−
ij ))δ(σi , σj )
• This is similar to modularity, but with different expected values.
• If there are no negative links, (and γ = 1) this equals modularity.
• Equivalent to choosing the appropriate null-model.
• If γ = λ = 0, or if graph is complete and balanced this is equal to
minimizing frustration.
• Implemented in the simulated annealing scheme used by Reichardt &
Bornholdt (2006).
Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 11 / 15
Empirical example
γ = 1, λ = 1
Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 12 / 15
Empirical example
γ = 0.3, λ = 1
Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 13 / 15
Empirical example
γ = 1, λ = 2
Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 14 / 15
Conclusions
• Proposed a solution for finding communities with negative links.
• Is in agreement with techniques for community detection with
positive links only.
• Results similar for ”social balance” clustering if network is (almost
complete) and balanced.
• Yields good community assignments.
• Can be readily implemented in existing modularity optimization
techniques.
Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 15 / 15

Contenu connexe

Similaire à Community Detection with Negative Links

Cooperation, Reputation & Gossiping
Cooperation, Reputation & GossipingCooperation, Reputation & Gossiping
Cooperation, Reputation & GossipingVincent Traag
 
Kdd12 tutorial-inf-part-iv
Kdd12 tutorial-inf-part-ivKdd12 tutorial-inf-part-iv
Kdd12 tutorial-inf-part-ivLaks Lakshmanan
 
Reputation Dynamics Through Gossiping
Reputation Dynamics Through GossipingReputation Dynamics Through Gossiping
Reputation Dynamics Through GossipingVincent Traag
 
Cooperation, Reputation & Gossiping
Cooperation, Reputation & GossipingCooperation, Reputation & Gossiping
Cooperation, Reputation & GossipingVincent Traag
 
Action and content based Community Detection in Social Networks
Action and content based Community Detection in Social NetworksAction and content based Community Detection in Social Networks
Action and content based Community Detection in Social Networksritesh_11
 
08 Inference for Networks – DYAD Model Overview (2017)
08 Inference for Networks – DYAD Model Overview (2017)08 Inference for Networks – DYAD Model Overview (2017)
08 Inference for Networks – DYAD Model Overview (2017)Duke Network Analysis Center
 
Introduction to Directed Acyclic Graphs.pptx
Introduction to Directed Acyclic Graphs.pptxIntroduction to Directed Acyclic Graphs.pptx
Introduction to Directed Acyclic Graphs.pptxDivyanshGupta922023
 
Consensual gene co-expression network inference with multiple samples
Consensual gene co-expression network inference with multiple samplesConsensual gene co-expression network inference with multiple samples
Consensual gene co-expression network inference with multiple samplestuxette
 
Positive and Negative Relationship
Positive and Negative RelationshipPositive and Negative Relationship
Positive and Negative RelationshipSaeidGhasemshirazi
 
Relational machine-learning
Relational machine-learningRelational machine-learning
Relational machine-learningBhushan Kotnis
 

Similaire à Community Detection with Negative Links (11)

Cooperation, Reputation & Gossiping
Cooperation, Reputation & GossipingCooperation, Reputation & Gossiping
Cooperation, Reputation & Gossiping
 
Kdd12 tutorial-inf-part-iv
Kdd12 tutorial-inf-part-ivKdd12 tutorial-inf-part-iv
Kdd12 tutorial-inf-part-iv
 
Reputation Dynamics Through Gossiping
Reputation Dynamics Through GossipingReputation Dynamics Through Gossiping
Reputation Dynamics Through Gossiping
 
Cooperation, Reputation & Gossiping
Cooperation, Reputation & GossipingCooperation, Reputation & Gossiping
Cooperation, Reputation & Gossiping
 
Prasanta Bhattacharya - WESST - Social Networks and Causal Inference
Prasanta Bhattacharya - WESST - Social Networks and Causal InferencePrasanta Bhattacharya - WESST - Social Networks and Causal Inference
Prasanta Bhattacharya - WESST - Social Networks and Causal Inference
 
Action and content based Community Detection in Social Networks
Action and content based Community Detection in Social NetworksAction and content based Community Detection in Social Networks
Action and content based Community Detection in Social Networks
 
08 Inference for Networks – DYAD Model Overview (2017)
08 Inference for Networks – DYAD Model Overview (2017)08 Inference for Networks – DYAD Model Overview (2017)
08 Inference for Networks – DYAD Model Overview (2017)
 
Introduction to Directed Acyclic Graphs.pptx
Introduction to Directed Acyclic Graphs.pptxIntroduction to Directed Acyclic Graphs.pptx
Introduction to Directed Acyclic Graphs.pptx
 
Consensual gene co-expression network inference with multiple samples
Consensual gene co-expression network inference with multiple samplesConsensual gene co-expression network inference with multiple samples
Consensual gene co-expression network inference with multiple samples
 
Positive and Negative Relationship
Positive and Negative RelationshipPositive and Negative Relationship
Positive and Negative Relationship
 
Relational machine-learning
Relational machine-learningRelational machine-learning
Relational machine-learning
 

Plus de Vincent Traag

Peer review uncertainty at the institutional level
Peer review uncertainty at the institutional levelPeer review uncertainty at the institutional level
Peer review uncertainty at the institutional levelVincent Traag
 
Replacing peer review by metrics in the UK REF?
Replacing peer review by metrics in the UK REF?Replacing peer review by metrics in the UK REF?
Replacing peer review by metrics in the UK REF?Vincent Traag
 
Use of the journal impact factor for assessing individual articles need not b...
Use of the journal impact factor for assessing individual articles need not b...Use of the journal impact factor for assessing individual articles need not b...
Use of the journal impact factor for assessing individual articles need not b...Vincent Traag
 
Uncovering important intermediate publications
Uncovering important intermediate publicationsUncovering important intermediate publications
Uncovering important intermediate publicationsVincent Traag
 
Complex contagion of campaign donations
Complex contagion of campaign donationsComplex contagion of campaign donations
Complex contagion of campaign donationsVincent Traag
 
Polarization and consensus in citation networks
Polarization and consensus in citation networksPolarization and consensus in citation networks
Polarization and consensus in citation networksVincent Traag
 
Community structure in complex networks
Community structure in complex networksCommunity structure in complex networks
Community structure in complex networksVincent Traag
 
Introduction to complex networks
Introduction to complex networksIntroduction to complex networks
Introduction to complex networksVincent Traag
 
Public thesis defence: groups and reputation in social networks
Public thesis defence: groups and reputation in social networksPublic thesis defence: groups and reputation in social networks
Public thesis defence: groups and reputation in social networksVincent Traag
 
Structure of media attention
Structure of media attentionStructure of media attention
Structure of media attentionVincent Traag
 
Dynamics of Media Attention
Dynamics of Media AttentionDynamics of Media Attention
Dynamics of Media AttentionVincent Traag
 
Dynamical Models Explaining Social Balance
Dynamical Models Explaining Social BalanceDynamical Models Explaining Social Balance
Dynamical Models Explaining Social BalanceVincent Traag
 
Significant scales in community structure
Significant scales in community structureSignificant scales in community structure
Significant scales in community structureVincent Traag
 
Reconstructing Third World Elite Rotation Events from Newspapers
Reconstructing Third World Elite Rotation Events from NewspapersReconstructing Third World Elite Rotation Events from Newspapers
Reconstructing Third World Elite Rotation Events from NewspapersVincent Traag
 
Limits of community detection
Limits of community detectionLimits of community detection
Limits of community detectionVincent Traag
 
Resolution-free community detection
Resolution-free community detectionResolution-free community detection
Resolution-free community detectionVincent Traag
 
Exponential Ranking: Taking into account negative links.
Exponential Ranking: Taking into account negative links.Exponential Ranking: Taking into account negative links.
Exponential Ranking: Taking into account negative links.Vincent Traag
 
Social Event Detection
Social Event DetectionSocial Event Detection
Social Event DetectionVincent Traag
 
Exponential Ranking: Taking into account negative links.
Exponential Ranking: Taking into account negative links.Exponential Ranking: Taking into account negative links.
Exponential Ranking: Taking into account negative links.Vincent Traag
 
Cooperation and Reputation
Cooperation and ReputationCooperation and Reputation
Cooperation and ReputationVincent Traag
 

Plus de Vincent Traag (20)

Peer review uncertainty at the institutional level
Peer review uncertainty at the institutional levelPeer review uncertainty at the institutional level
Peer review uncertainty at the institutional level
 
Replacing peer review by metrics in the UK REF?
Replacing peer review by metrics in the UK REF?Replacing peer review by metrics in the UK REF?
Replacing peer review by metrics in the UK REF?
 
Use of the journal impact factor for assessing individual articles need not b...
Use of the journal impact factor for assessing individual articles need not b...Use of the journal impact factor for assessing individual articles need not b...
Use of the journal impact factor for assessing individual articles need not b...
 
Uncovering important intermediate publications
Uncovering important intermediate publicationsUncovering important intermediate publications
Uncovering important intermediate publications
 
Complex contagion of campaign donations
Complex contagion of campaign donationsComplex contagion of campaign donations
Complex contagion of campaign donations
 
Polarization and consensus in citation networks
Polarization and consensus in citation networksPolarization and consensus in citation networks
Polarization and consensus in citation networks
 
Community structure in complex networks
Community structure in complex networksCommunity structure in complex networks
Community structure in complex networks
 
Introduction to complex networks
Introduction to complex networksIntroduction to complex networks
Introduction to complex networks
 
Public thesis defence: groups and reputation in social networks
Public thesis defence: groups and reputation in social networksPublic thesis defence: groups and reputation in social networks
Public thesis defence: groups and reputation in social networks
 
Structure of media attention
Structure of media attentionStructure of media attention
Structure of media attention
 
Dynamics of Media Attention
Dynamics of Media AttentionDynamics of Media Attention
Dynamics of Media Attention
 
Dynamical Models Explaining Social Balance
Dynamical Models Explaining Social BalanceDynamical Models Explaining Social Balance
Dynamical Models Explaining Social Balance
 
Significant scales in community structure
Significant scales in community structureSignificant scales in community structure
Significant scales in community structure
 
Reconstructing Third World Elite Rotation Events from Newspapers
Reconstructing Third World Elite Rotation Events from NewspapersReconstructing Third World Elite Rotation Events from Newspapers
Reconstructing Third World Elite Rotation Events from Newspapers
 
Limits of community detection
Limits of community detectionLimits of community detection
Limits of community detection
 
Resolution-free community detection
Resolution-free community detectionResolution-free community detection
Resolution-free community detection
 
Exponential Ranking: Taking into account negative links.
Exponential Ranking: Taking into account negative links.Exponential Ranking: Taking into account negative links.
Exponential Ranking: Taking into account negative links.
 
Social Event Detection
Social Event DetectionSocial Event Detection
Social Event Detection
 
Exponential Ranking: Taking into account negative links.
Exponential Ranking: Taking into account negative links.Exponential Ranking: Taking into account negative links.
Exponential Ranking: Taking into account negative links.
 
Cooperation and Reputation
Cooperation and ReputationCooperation and Reputation
Cooperation and Reputation
 

Dernier

Thyroid Physiology_Dr.E. Muralinath_ Associate Professor
Thyroid Physiology_Dr.E. Muralinath_ Associate ProfessorThyroid Physiology_Dr.E. Muralinath_ Associate Professor
Thyroid Physiology_Dr.E. Muralinath_ Associate Professormuralinath2
 
Reboulia: features, anatomy, morphology etc.
Reboulia: features, anatomy, morphology etc.Reboulia: features, anatomy, morphology etc.
Reboulia: features, anatomy, morphology etc.Silpa
 
Factory Acceptance Test( FAT).pptx .
Factory Acceptance Test( FAT).pptx       .Factory Acceptance Test( FAT).pptx       .
Factory Acceptance Test( FAT).pptx .Poonam Aher Patil
 
Bhiwandi Bhiwandi ❤CALL GIRL 7870993772 ❤CALL GIRLS ESCORT SERVICE In Bhiwan...
Bhiwandi Bhiwandi ❤CALL GIRL 7870993772 ❤CALL GIRLS  ESCORT SERVICE In Bhiwan...Bhiwandi Bhiwandi ❤CALL GIRL 7870993772 ❤CALL GIRLS  ESCORT SERVICE In Bhiwan...
Bhiwandi Bhiwandi ❤CALL GIRL 7870993772 ❤CALL GIRLS ESCORT SERVICE In Bhiwan...Monika Rani
 
Climate Change Impacts on Terrestrial and Aquatic Ecosystems.pptx
Climate Change Impacts on Terrestrial and Aquatic Ecosystems.pptxClimate Change Impacts on Terrestrial and Aquatic Ecosystems.pptx
Climate Change Impacts on Terrestrial and Aquatic Ecosystems.pptxDiariAli
 
Gwalior ❤CALL GIRL 84099*07087 ❤CALL GIRLS IN Gwalior ESCORT SERVICE❤CALL GIRL
Gwalior ❤CALL GIRL 84099*07087 ❤CALL GIRLS IN Gwalior ESCORT SERVICE❤CALL GIRLGwalior ❤CALL GIRL 84099*07087 ❤CALL GIRLS IN Gwalior ESCORT SERVICE❤CALL GIRL
Gwalior ❤CALL GIRL 84099*07087 ❤CALL GIRLS IN Gwalior ESCORT SERVICE❤CALL GIRLkantirani197
 
GBSN - Biochemistry (Unit 2) Basic concept of organic chemistry
GBSN - Biochemistry (Unit 2) Basic concept of organic chemistry GBSN - Biochemistry (Unit 2) Basic concept of organic chemistry
GBSN - Biochemistry (Unit 2) Basic concept of organic chemistry Areesha Ahmad
 
Phenolics: types, biosynthesis and functions.
Phenolics: types, biosynthesis and functions.Phenolics: types, biosynthesis and functions.
Phenolics: types, biosynthesis and functions.Silpa
 
Role of AI in seed science Predictive modelling and Beyond.pptx
Role of AI in seed science  Predictive modelling and  Beyond.pptxRole of AI in seed science  Predictive modelling and  Beyond.pptx
Role of AI in seed science Predictive modelling and Beyond.pptxArvind Kumar
 
Genome sequencing,shotgun sequencing.pptx
Genome sequencing,shotgun sequencing.pptxGenome sequencing,shotgun sequencing.pptx
Genome sequencing,shotgun sequencing.pptxSilpa
 
Cyanide resistant respiration pathway.pptx
Cyanide resistant respiration pathway.pptxCyanide resistant respiration pathway.pptx
Cyanide resistant respiration pathway.pptxSilpa
 
FAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
FAIRSpectra - Enabling the FAIRification of Spectroscopy and SpectrometryFAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
FAIRSpectra - Enabling the FAIRification of Spectroscopy and SpectrometryAlex Henderson
 
FAIRSpectra - Enabling the FAIRification of Analytical Science
FAIRSpectra - Enabling the FAIRification of Analytical ScienceFAIRSpectra - Enabling the FAIRification of Analytical Science
FAIRSpectra - Enabling the FAIRification of Analytical ScienceAlex Henderson
 
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 bAsymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 bSérgio Sacani
 
CYTOGENETIC MAP................ ppt.pptx
CYTOGENETIC MAP................ ppt.pptxCYTOGENETIC MAP................ ppt.pptx
CYTOGENETIC MAP................ ppt.pptxSilpa
 
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune WaterworldsBiogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune WaterworldsSérgio Sacani
 
Use of mutants in understanding seedling development.pptx
Use of mutants in understanding seedling development.pptxUse of mutants in understanding seedling development.pptx
Use of mutants in understanding seedling development.pptxRenuJangid3
 
Cyathodium bryophyte: morphology, anatomy, reproduction etc.
Cyathodium bryophyte: morphology, anatomy, reproduction etc.Cyathodium bryophyte: morphology, anatomy, reproduction etc.
Cyathodium bryophyte: morphology, anatomy, reproduction etc.Silpa
 
Chemistry 5th semester paper 1st Notes.pdf
Chemistry 5th semester paper 1st Notes.pdfChemistry 5th semester paper 1st Notes.pdf
Chemistry 5th semester paper 1st Notes.pdfSumit Kumar yadav
 

Dernier (20)

Thyroid Physiology_Dr.E. Muralinath_ Associate Professor
Thyroid Physiology_Dr.E. Muralinath_ Associate ProfessorThyroid Physiology_Dr.E. Muralinath_ Associate Professor
Thyroid Physiology_Dr.E. Muralinath_ Associate Professor
 
Reboulia: features, anatomy, morphology etc.
Reboulia: features, anatomy, morphology etc.Reboulia: features, anatomy, morphology etc.
Reboulia: features, anatomy, morphology etc.
 
Factory Acceptance Test( FAT).pptx .
Factory Acceptance Test( FAT).pptx       .Factory Acceptance Test( FAT).pptx       .
Factory Acceptance Test( FAT).pptx .
 
Bhiwandi Bhiwandi ❤CALL GIRL 7870993772 ❤CALL GIRLS ESCORT SERVICE In Bhiwan...
Bhiwandi Bhiwandi ❤CALL GIRL 7870993772 ❤CALL GIRLS  ESCORT SERVICE In Bhiwan...Bhiwandi Bhiwandi ❤CALL GIRL 7870993772 ❤CALL GIRLS  ESCORT SERVICE In Bhiwan...
Bhiwandi Bhiwandi ❤CALL GIRL 7870993772 ❤CALL GIRLS ESCORT SERVICE In Bhiwan...
 
Climate Change Impacts on Terrestrial and Aquatic Ecosystems.pptx
Climate Change Impacts on Terrestrial and Aquatic Ecosystems.pptxClimate Change Impacts on Terrestrial and Aquatic Ecosystems.pptx
Climate Change Impacts on Terrestrial and Aquatic Ecosystems.pptx
 
Gwalior ❤CALL GIRL 84099*07087 ❤CALL GIRLS IN Gwalior ESCORT SERVICE❤CALL GIRL
Gwalior ❤CALL GIRL 84099*07087 ❤CALL GIRLS IN Gwalior ESCORT SERVICE❤CALL GIRLGwalior ❤CALL GIRL 84099*07087 ❤CALL GIRLS IN Gwalior ESCORT SERVICE❤CALL GIRL
Gwalior ❤CALL GIRL 84099*07087 ❤CALL GIRLS IN Gwalior ESCORT SERVICE❤CALL GIRL
 
GBSN - Biochemistry (Unit 2) Basic concept of organic chemistry
GBSN - Biochemistry (Unit 2) Basic concept of organic chemistry GBSN - Biochemistry (Unit 2) Basic concept of organic chemistry
GBSN - Biochemistry (Unit 2) Basic concept of organic chemistry
 
Phenolics: types, biosynthesis and functions.
Phenolics: types, biosynthesis and functions.Phenolics: types, biosynthesis and functions.
Phenolics: types, biosynthesis and functions.
 
Role of AI in seed science Predictive modelling and Beyond.pptx
Role of AI in seed science  Predictive modelling and  Beyond.pptxRole of AI in seed science  Predictive modelling and  Beyond.pptx
Role of AI in seed science Predictive modelling and Beyond.pptx
 
Genome sequencing,shotgun sequencing.pptx
Genome sequencing,shotgun sequencing.pptxGenome sequencing,shotgun sequencing.pptx
Genome sequencing,shotgun sequencing.pptx
 
Cyanide resistant respiration pathway.pptx
Cyanide resistant respiration pathway.pptxCyanide resistant respiration pathway.pptx
Cyanide resistant respiration pathway.pptx
 
FAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
FAIRSpectra - Enabling the FAIRification of Spectroscopy and SpectrometryFAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
FAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
 
FAIRSpectra - Enabling the FAIRification of Analytical Science
FAIRSpectra - Enabling the FAIRification of Analytical ScienceFAIRSpectra - Enabling the FAIRification of Analytical Science
FAIRSpectra - Enabling the FAIRification of Analytical Science
 
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 bAsymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
 
CYTOGENETIC MAP................ ppt.pptx
CYTOGENETIC MAP................ ppt.pptxCYTOGENETIC MAP................ ppt.pptx
CYTOGENETIC MAP................ ppt.pptx
 
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune WaterworldsBiogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
 
Use of mutants in understanding seedling development.pptx
Use of mutants in understanding seedling development.pptxUse of mutants in understanding seedling development.pptx
Use of mutants in understanding seedling development.pptx
 
Clean In Place(CIP).pptx .
Clean In Place(CIP).pptx                 .Clean In Place(CIP).pptx                 .
Clean In Place(CIP).pptx .
 
Cyathodium bryophyte: morphology, anatomy, reproduction etc.
Cyathodium bryophyte: morphology, anatomy, reproduction etc.Cyathodium bryophyte: morphology, anatomy, reproduction etc.
Cyathodium bryophyte: morphology, anatomy, reproduction etc.
 
Chemistry 5th semester paper 1st Notes.pdf
Chemistry 5th semester paper 1st Notes.pdfChemistry 5th semester paper 1st Notes.pdf
Chemistry 5th semester paper 1st Notes.pdf
 

Community Detection with Negative Links

  • 1. Community Detection with Negative Links Vincent Traag1 Jeroen Bruggeman2 1Catholic University of Louvain, Belgium 2University of Amsterdam, Netherlands June 9, 2009 Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 1 / 15
  • 2. Outline 1 Introduction 2 Social Balance Theory 3 Modularity 4 Including negative links 5 Empirical example Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 2 / 15
  • 3. Introduction • Community detection is succesfully applied in a number of fields. • Whether a link is positive or negative usually ignored. • It is highly relevant for • Hyperlinks on webpages (“good” sites, instead of “important” sites) • References in blogs (opinion clustering, not thematical) • Trust relationships (e.g. P2P systems) • International relationships (conflict and cooperation) • . . . Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 3 / 15
  • 4. Social Balance Theory C1 C2 AB C D • Triads (sets of three nodes) are balanced if their relationships are “symmetric”. • Triad i, j, k is balanced if AijAikAjk = 1. • If network is balanced, is can be split in two clusters. (Harary, 1953) • A network is said to be k-balanced if it can be split into k clusters. • For unbalanced networks, how can the nodes be clustered? Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 4 / 15
  • 5. Social Balance Theory C1 C2 C3 AB D E C • Triads (sets of three nodes) are balanced if their relationships are “symmetric”. • Triad i, j, k is balanced if AijAikAjk = 1. • If network is balanced, is can be split in two clusters. (Harary, 1953) • A network is said to be k-balanced if it can be split into k clusters. • For unbalanced networks, how can the nodes be clustered? Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 4 / 15
  • 6. Frustration • Try to come close to the ideal ’balanced’ network. • Minimize links that violate the conditions of k-balance: • Negative links within clusters, • Positive links between clusters. Definition Frustration F = ij αA− ij δ(σi , σj ) + (1 − α)A+ ij (1 − δ(σi , σj )). • If α = 1 2 this is equivalent to minimizing F = ij (A+ ij − A− ij )δ(σi , σj ) = ij Aij δ(σi , σj ). Approach by Doreian and Mrvar, Social Networks, Vol. 18, (1996). Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 5 / 15
  • 7. Problems with frustration • If there are no negative links, there is only one cluster. • Even minimally postive connected group is in one cluster. • Absent links do not join or seperate a cluster. • Defines unclearly a community. Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 6 / 15
  • 8. Modularity Modularity has been succesfully applied in community detection. Definition (Modularity) Q = 1 m ij (Aij − pij )δ(σi , σj ) = 1 m c ac − ec. Newman & Girvan, Phys Rev E 69, (2004). Maximizing modularity yields a ”good” community assignment. Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 7 / 15
  • 9. Potts approach • Potts approach by Reichardt and Bornholdt (2006): reward “allowed” links, penalise “forbidden” links. Allowed • Links within communities (reward aij = 1 − γpij). Forbidden • Absent links within communities (penalty bij = γpij). • Formulated as an “energy/cost” function (Hamiltonian): H = ij −aijAijδ(σi , σj ) + bij (1 − Aij)δ(σi , σj ) • Reformulated equals modularity (if γ = 1) Q = − 1 m H = 1 m ij (Aij − γpij )δ(σi , σj ) • Results in a tuneable (γ) version of modularity. Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 8 / 15
  • 10. Problem with negative links ak = 1 b k = 1 c k = −1 Negative links poses problem for modularity. Expected values pij not well defined. A =   + + − + + − − − +   Q = 1 m ij Aij − ki kj m δ(σi , σj ) = 0 Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 9 / 15
  • 11. Allowing negative links • Solution is to separate the positive and negative part. • Then change “allowed” and “forbidden” links: Allowed • Positive links within communities (reward aij = γp+ ij ). • Absent negative links within communities (reward dij = λp− ij ). Forbidden • Absent positive links within communities (penalty bij = 1 − γp+ ij ). • Negative links within communities (penalty cij = 1 − λp− ij ). • Results in two separate Hamiltonians H+ = − ij (A+ ij − γp+ ij )δ(σi , σj ) and H− = ij (A− ij − λp− ij )δ(σi , σj ). Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 10 / 15
  • 12. Hamiltonian • When both Hamiltonians are weighted equally this equals minimizing H = H+ + H− = ij (Aij − (γp+ ij − λp− ij ))δ(σi , σj ) • This is similar to modularity, but with different expected values. • If there are no negative links, (and γ = 1) this equals modularity. • Equivalent to choosing the appropriate null-model. • If γ = λ = 0, or if graph is complete and balanced this is equal to minimizing frustration. • Implemented in the simulated annealing scheme used by Reichardt & Bornholdt (2006). Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 11 / 15
  • 13. Empirical example γ = 1, λ = 1 Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 12 / 15
  • 14. Empirical example γ = 0.3, λ = 1 Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 13 / 15
  • 15. Empirical example γ = 1, λ = 2 Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 14 / 15
  • 16. Conclusions • Proposed a solution for finding communities with negative links. • Is in agreement with techniques for community detection with positive links only. • Results similar for ”social balance” clustering if network is (almost complete) and balanced. • Yields good community assignments. • Can be readily implemented in existing modularity optimization techniques. Vincent Traag (UC Louvain) Community Detection with Negative Links June 9, 2009 15 / 15