Text segmentation via topic modeling: An analytical study

International Conference on Information and Knowledge Management, Proceedings

Volumn , Issue , 2009, Pages 1553-1556

  Misra, Hemant ^a   Yvon, François ^b   Jose, Joemon M ^a   Cappé, Olivier ^c  

^a UNIVERSITY OF GLASGOW   (United Kingdom)

^b UNIVERSITÉ PARIS SACLAY   (France)

^c INSTITUT TELECOM   (France)

Author keywords

Dynamic programming; Latent dirichlet allocation; Text segmentation; Unsupervised topic modeling

Indexed keywords

BENCHMARK DATASETS; DISCOURSE ANALYSIS; LATENT DIRICHLET ALLOCATION; LATENT DIRICHLET ALLOCATIONS; NEW APPROACHES; STANDARD BASELINE METHODS; TEXT SEGMENTATION; TOPIC MODEL; UNSUPERVISED METHOD;

KNOWLEDGE MANAGEMENT;

DYNAMIC PROGRAMMING;

EID: 74549168970     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1645953.1646170     Document Type: Conference Paper

References (15)

1. D. Beeferman, A. Berger, and J. Lafferty. Statistical models for text segmentation. Machine Learning, 34(1-3):177-210, 1999.
2. Y. Bestgen. Improving text segmentation using latent semantic analysis: A reanalysis of Choi, Wiemer-Hastings, and Moore (2001). Computational Linguistics, 32(1):5-12, 2006.
3. D. M. Blei, A. Y. Ng, and M. I. Jordan. Latent Dirichlet allocation. In T. G. Dietterich, S. Becker, and Z. Ghahramani, editors, Advances in Neural Information Processing Systems (NIPS), volume 14, pages 601-608, Cambridge, MA, 2002. MIT Press.
4. T. Brants, F. Chen, and I. Tsochantaridis. Topic-based document segmentation with probabilistic latent semantic analysis. In Proceedings of the International Conference on Information and Knowledge Management, pages 211-218, McLean, Virginia, U.S.A., 2002. ACM.
5. F. Choi, P. Wiemer-Hastings, and J. Moore. Latent semantic analysis for text segmentation. In Proceedings of EMNLP, pages 109-117, Pittsburgh, PA, U.S.A., 2001.
6. F. Y. Y. Choi. Advances in domain independant linear text segmentation. In Proceedings of the Conference of North American Chapter of the ACL, pages 26-33, Seattle, WA, U.S.A., 2000.
7. P. Fragkou, V. Petridis, and A. Kehagias. A dynamic programming algorithm for linear text segmentation. Journal of Intelligent Information System, 23(2):179-197, 2004.
8. T. L. Griffiths and M. Steyvers. Finding scientific topics. Proceedings of the National Academy of Sciences, 101 (supl 1):5228-5235, 2004.
9. M. Hearst. TextTiling: Segmenting texts into multi-paragraph subtopic passages. Computational Linguistics, 23(1):33-64, 1997.
10. A. Heidel, H. an Chang, and L. shan Lee. Language model adaptation using latent Dirichlet allocation and an efficient topic inference algorithm. In Proceedings of EuroSpeech, Antwerp, Belgium, 2007.
11. D. D. Lewis, Y. Yang, T. Rose, and F. Li. RCV1: A new benchmark collection for text categorization research. Machine Learning Research, 5:361-397, 2004.
12. H. Misra, O. Cappé, and F. Yvon. Using LDA to detect semantically incoherent documents. In Proceedings of CoNLL, pages 41-48, Manchester, U.K., 2008.
13. J. C. Reynar. Topic Segmentation: Algorithms and Applications. PhD thesis, University of Pennsylvania, 1998.
14. Q. Sun, R. Li, D. Luo, and S. Wu. Text segmentation with LDA-based Fisher kernel. In Proceedings of ACL-08: HLT, Short Papers, pages 269-272, Columbus, Ohio, June 2008.
15. M. Utiyama and H. Isahara. A statistical model for domain-independent text segmentation. In Meeting of the Association for Computational Linguistics, pages 491-498, Bergen, Norway, 2001.