Publicité
Publicité

Contenu connexe

Plus de Network Science Lab, The Catholic University of Korea(16)

Publicité

NS-CUK Seminar: V.T.Hoang, Review on "Graph Neural Networks Go Forward-Forward," arXiv, Feb 27th, 2023

  1. Hoang Van Thuy Network Science Lab E-mail: hoangvanthuy90@gmail.com
  2. 1 • GFF, graph neural networks are trained greedily layer by layer, using both positive and negative samples • Solve the noise from neighbours
  3. 2 How GNNs work
  4. 3 Graphs have many noises ➢ Wrong labels in neighbouring nodes when using GNNs
  5. 4 FF algorithm ➢ Wrong labels in neighbouring nodes
  6. 5 Adding label information in node features ➢ 2 ways: ➢ One consists in appending the one-hot encoded label to each node representation in the input graphs ➢ Virtual node
  7. 6 Goodness of a Graph ➢ 1. Normalized activity vectors of all the nodes and the adjacency matrix are fed to the message-passing algorithm. This produces updated activity vectors. A nonlinear activation function is applied. ➢ 2. The activity vectors are squared. ➢ 3. The squared activity vectors are aggregated with a pooling function. This produces an aggregated vector. ➢ 4. The mean of the aggregated activity vector is computed and represents the goodness of the graph.
  8. 7 Adding label information in node features 1
  9. 8 Adding label information in node features 2
  10. 9 Goodness of a Graph ➢ Intuitively, the network is trained so that the goodness for positive samples is high (or higher than a threshold), while the goodness for negative samples is minimized.
  11. 10 Architecture
  12. 11 Datasets
  13. 12 Comparison of the GCN (BP) and the FF-GCN (GFF)
  14. 13
Publicité