Topic Models - LDA and Correlated Topic Models
•Télécharger en tant que PPT, PDF•
26 j'aime•11,903 vues
Seminar Talk at Computational Intelligence Seminar F, Technical University Graz
![Motivation ,[object Object],[object Object],[object Object],[object Object]](data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)
Recommandé
Contenu connexe
Tendances
Tendances (20)
Similaire à Topic Models - LDA and Correlated Topic Models
Similaire à Topic Models - LDA and Correlated Topic Models (20)
Plus de Claudia Wagner
Plus de Claudia Wagner (17)
Dernier
Dernier (20)
Topic Models - LDA and Correlated Topic Models
- 1. Computational Intelligence Seminar F Topic Models LDA and the Correlated Topic Models Claudia Wagner Graz, 21.1.2011
- 3. Topic Models Generative Models http://www.cs.umass.edu/~wallach/talks/priors.pdf
- 5. Latent Dirichlet Allocation (LDA) (Blei et al, 2003)
- 7. Matrix Representation of LDA observed latent latent θ φ
- 9. Dirichlet Distribution The larger the value of the concentration parameter alpha, the more evenly distributed is the resulting distribution! Low α Topic1 Topic 2 Topic 3 Examples with K=3 http://www.cs.umass.edu/~wallach/talks/priors.pdf θ i = (1, 0, 0) High α High α θ i = (1/3, 1/3, 1/3) More smoothing Less smoothing Topic1 Topic 2 Topic 3 ?
- 16. Correlated Topic Models (CTM) (Blei et al, 2007)
- 20. Dirichlet versus L ogistic Normal http://www.cs.princeton.edu/~blei/modeling-science.pdf Dirichlet distribution (Paramter: postive K-dim vector α) Logistic Normal distribution (Paramter: postive K-dim vector μ , K x K co-variance Matrix Ʃ ) High α Low α High α unsymmetric symmetric symmetric diagonal covariance negative correlation between topics 1 and 2 positive correlation between topics 1 and 2 Topic1 Topic2 Topic3
- 24. Empirical Results Comparing CTM and LDA (Blei et al, 2007)