On finding the natural number of topics with Latent Dirichlet Allocation: Some observations

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 6118 LNAI, Issue PART 1, 2010, Pages 391-402

  Arun, R ^a   Suresh, V ^a   Madhavan, C E Veni ^a   Murty, M Narasimha ^a  

^a INDIAN INSTITUTE OF SCIENCE   (India)

Author keywords

LDA Topic SVD KL Divergence

Indexed keywords

CLASSIFICATION ACCURACY; EMPIRICAL EVIDENCE; KL-DIVERGENCE; LATENT DIRICHLET ALLOCATION; LATENT DIRICHLET ALLOCATIONS; MATRIX; MATRIX FACTORIZATIONS; NATURAL NUMBER; SYNTHETIC DATASETS;

DATA MINING;

MATRIX ALGEBRA;

EID: 79956316230     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-13657-3_43     Document Type: Conference Paper

References (15)

1. Deerwester, S.C., Dumais, S.T., Landauer, T.K., Furnas, G.W., Harshman, R.A.: Indexing by Latent Semantic Analysis. JASIS 41(6), 391-407 (1990)
2. Hofmann, T.: Probabilistic Latent Semantic Indexing. In: SIGIR 1999, pp. 50-57 (1999)
3. Blei, D.M., Ng, A.Y., Jordan, M.I.: Jordan: Latent Dirichlet Allocation. Journal of Machine Learning Research 3, 993-1022 (2003)
4. Lee, D.D., Sebastian Seung, H.: Learning the parts of objects by non-negative matrix factorization. Nature 401(6755), 788-791 (1999)
5. Cao, J., Xia, T., Li, J., Zhang, Y., Tang, S.: A density-based method for adaptive LDA model selection. Neurocomputing 72(7-9), 1775-1781 (2009)
6. Aggarwal, C.C., Hinneburg, A., Keim, D.A.: On the Surprising Behavior of Distance Metrics in High Dimensional Spaces. In: Van den Bussche, J., Vianu, V. (eds.) ICDT 2001. LNCS, vol. 1973, pp. 420-434. Springer, Heidelberg (2000) (Pubitemid 33213340)
7. Gaussier, E., Goutte, C.: Relation between PLSA and NMF and Implications. In: Proc. 28th international ACM SIGIR conference on Research and development in information retrieval (SIGIR 2005), pp. 601-602 (2005)
8. Eckart, C., Young, G.: The approximation of one matrix by another of lower rank. Psychometrika 1(3), 211-218 (1936)
9. Kullback, S., Leibler, R.A.: On Information and Sufficiency. Annals of Mathematical Statistics 22(1), 79-86 (1951)
10. Zavitsanos, E., Petridis, S., Paliouras, G., Vouros, G.A.: Determining Automatically the Size of Learned Ontologies. In: ECAI 2008, pp. 775-776 (2008)
11. Teh, Y.W., Jordan, M.I., Beal, M.J., Blei, D.M.: Sharing Clusters among Related Groups: Hierarchical Dirichlet Processes. In: NIPS 2004 (2004)
12. Blei, D.M., Lafferty, J.D.: Correlated Topic Models. In: NIPS 2005 (2005)
13. Smyth, P., Welling, M.: Asynchronous Distributed Learning of Topic Models. In: NIPS 2008, pp. 81-88 (2008) (bibliographical record in XML Arthur Asuncion)
14. Li, W., McCallum, A.: Pachinko allocation: DAG-structured mixture models of topic correlations. In: ICML 2006, pp. 577-584 (2007)
15. http://archive.ics.uci.edu/ml/datasets/Bag+of+Words,http://www.cs. princeton.edu/~blei/lda-c/