Adaptive Bayesian latent semantic analysis

IEEE Transactions on Audio, Speech and Language Processing

Volumn 16, Issue 1, 2008, Pages 198-207

  Chien, Jen Tzung ^a   Wu, Meng Sung ^a  

^a NATIONAL CHENG KUNG UNIVERSITY   (Taiwan)

Author keywords

Bayesian theory; Conjugate prior; Dirichlet distribution; Incremental learning; Natural language processing; Probabilistic latent semantic analysis; Statistical document modeling

Indexed keywords

BAYESIAN THEORY; CONJUGATE PRIOR; DIRICHLET DISTRIBUTION; INCREMENTAL LEARNING; NATURAL LANGUAGE PROCESSING; PROBABILISTIC LATENT SEMANTIC ANALYSIS; STATISTICAL DOCUMENT MODELING;

BAYESIAN NETWORKS; COMPUTATIONAL LINGUISTICS; EDUCATION; IMAGE RETRIEVAL; INFORMATION SERVICES; INFORMATION THEORY; LEARNING SYSTEMS; MAXIMUM LIKELIHOOD ESTIMATION; NATURAL LANGUAGE PROCESSING SYSTEMS; PARAMETER ESTIMATION; PROBABILITY DISTRIBUTIONS; QUERY LANGUAGES; SEMANTICS;

LEARNING ALGORITHMS;

EID: 60549085346     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2007.909452     Document Type: Article

References (28)

1. Y. Akita and T. Kawahara, "Language modeling adaptation based on PLSA of topics and speakers," in Proc. Int. Conf. Spoken Lang. Process., 2004, pp. 1045-1048.
2. J. R. Bellegarda, "Exploiting latent semantic information in statistical language modeling," Proc. IEEE, vol. 88, no. 8, pp. 1279-1296, Aug. 2000.
3. J. R. Bellegarda, "Fast update of latent semantic spaces using a linear transform framework," in Pwc. Int. Conf. Acoust., Speech, Lang. Process., 2002, vol. 1, pp. 769-772.
4. M. W. Berry, S. T. Dumais, and G. W. O'Brien, "Using linear algebra for intelligent information retrieval," SIAM Rev., vol. 37, no. 4, pp. 573-595, 1995.
5. D. M. Blei, A. Y. Ng, and M. I. Jordan, "Latent Dirichlet allocation," J. Mach. Learn. Res., vol. 3, no. 5, pp. 993-1022, 2003.
6. E. Brochu, N. Freitas, and K. Bao, "The sound of an album cover: Probabilistic multimedia and IR," in Proc. 9th Int. Workshop Artif. Intell. Statist., 2003.
7. L. Cai and T. Hofmann, "Text categorization by boosting automatically extracted concepts," in Proc. 26th Anna. Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 2003, pp. 182-189.
8. J.-T. Chien, "Online hierarchical transformation of hidden Markov models for speech recognition," IEEE Trans, on Speech and Audio Processing, vol. 7, no. 6, pp. 656-667, 1999.
9. J.-T. Chien, "Association pattern language modeling," IEEE Trans. Audio, Speech, Lang. Process., vol. 14, no. 5, pp. 1719-1728, Sep. 2006.
10. J.-T. Chien, M.-S. Wu, and C.-S. Wu, "Bayesian learning for latent semantic analysis," in Proc. Eur. Conf. Speech Commun. Technol., 2005, pp. 25-28.
11. S. Deerwester, S. T. Dumais, G. W. Furnas, T. K. Landauer, and R. Harshman, "Indexing by latent semantic analysis," J. Amer. Soc. Inf. Sci., vol. 41, no. 6, pp. 391-407, 1990.
12. M. H. DeGroot, Optimal Statistical Decisions. New York: McGraw-Hill, 1970.
13. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. R. Statist. Soc. (B), vol. 39, no. 1, pp. 1-38, 1977.
14. N. Freitas and K. Barnard, "Bayesian latent semantic analysis of multimedia databases", Tech. Rep. Univ. British Columbia, Vancouver, BC, Canada, 2001, TR-2001-15.
15. M. Girolami and A. Kaban, "On an equivalence between PLSI and LDA," in Proc. 26th Anna. Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 2003, pp. 433-434.
16. T. Hofmann, "Probabilistic latent semantic indexing," in Proc. 22nd Annu. Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval. 1999. pp. 50-57.
17. T. Hofmann, "Unsupervised learning by probabilistic latent semantic analysis," Mach. Learn., vol. 42, no. 1-2, pp. 177-196, 2001.
18. D. Hull, "Using statistical testing in the evaluation of retrieval experiments," in Proc. 16th Annu. Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 1993, pp. 329-338.
19. Q. Huo and C.-H. Lee, "On-line adaptive learning of the continuous density hidden Markov model based on approximate recursive Bayes estimate," IEEE Trans. Speech Audio Process., vol. 5, no. 2, pp. 161-172, Mar. 1997.
20. T. G. Kolda and D. P. O'Leary, "A semidiscrete matrix decomposition for latent semantic indexing in information retrieval," ACM Trans. Inf. Syst., vol. 16, no. 4, pp. 322-346, 1998.
21. V. Lavrenko and W. B. Croft, "Relevance-based language models," in Proc. 24th Annu. Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 2001, pp. 120-127.
22. H. Masataki, Y. Sagisaka, K. Hisaki, and T. Kawahara, "Task adaptation using MAP estimation in n -gram language modeling," in Proc. Int. Conf. Acoust., Speech, Lang. Process., 1997, vol. 2, pp. 783-786.
23. J. M. Ponte and W. B. Croft, "A language modeling approach to information retrieval," in Proc. 21st Annu. Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 1998, pp. 275-281.
24. G. Salton and M. J. McGill, Introduction to Modem Information Retrieval. New York: McGraw-Hill, 1983.
25. A. F. M. Smith and U. E. Makov, "A quasi-Bayes sequential procedure for mixtures," J. R. Statist. Soc. (B), vol. 40, no. 1, pp. 106-112, 1978.
26. D. I. Witter and M. W. Berry, "Downdating the latent semantic indexing model for conceptual information retrieval," Comput. J., vol. 41, no. 8, pp. 589-601, 1998.
27. Y. Yang and X. Liu, "A re-examination of text categorization methods," in Proc. 22nd Annu. Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval, 1999, pp. 42-49.
28. H. Zha and H. D. Simon, "On updating problems in latent semantic indexing," SIAM J. Sci. Comput., vol. 21, no. 2, pp. 782-791, 1999.