Text segmentation: A topic modeling perspective

Information Processing and Management

Volumn 47, Issue 4, 2011, Pages 528-544

  Misra, Hemant ^a,b   Yvon, Franois ^c   Cappé, Olivier ^d   Jose, Joemon ^a  

^a UNIVERSITY OF GLASGOW   (United Kingdom)

^b XEROX RESEARCH CENTRE EUROPE   (France)

^c UNIVERSITÉ PARIS SACLAY   (France)

^d INSTITUT TELECOM   (France)

Author keywords

Dynamic programming; Latent Dirichlet allocation; Semantic information; Text segmentation; Topic modeling

Indexed keywords

COMPUTATIONAL REQUIREMENTS; DATA SETS; DISCOURSE ANALYSIS; DYNAMIC PROGRAMMING ALGORITHM; LATENT DIRICHLET ALLOCATION; LATENT DIRICHLET ALLOCATIONS; MULTINOMIALS; SEMANTIC INFORMATION; STANDARD BASELINE METHODS; TEXT SEGMENTATION; TOPIC MODEL; TOPIC MODELING;

ALGORITHMS; SEMANTICS;

DYNAMIC PROGRAMMING;

EID: 79957621525     PISSN: 03064573     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ipm.2010.11.008     Document Type: Article

References (36)

1. Allan, J.; Carbonell, J.; Doddington, G.; Yamron, J.; & Yang, Y. (1998). Topic detection and tracking pilot study: Final report. In Proceedings of the DARPA broadcast news transcription and understanding workshop, Lansdowne, VA, USA (pp. 194-218).
2. D. Beeferman, A. Berger, and J. Lafferty Statistical models for text segmentation Machine Learning 34 1-3 1999 177 210
3. Y. Bestgen Improving text segmentation using latent semantic analysis: A reanalysis of Choi, Wiemer-Hastings, and Moore (2001) Computational Linguistics 0891-2017 32 1 2006 5 12 (Pubitemid 43764023)
4. Blei, D. M.; & Moreno, P. J. (2001). Topic segmentation with an aspect hidden Markov model. In Proceedings of ACM special interest group on information retrieval, New Orleans, Louisiana, USA (pp. 343-348). (Pubitemid 32951088)
5. D.M. Blei, A.Y. Ng, and M.I. Jordan Latent Dirichlet allocation T.G. Dietterich, S. Becker, Z. Ghahramani, Advances in neural information processing systems (NIPS) Vol. 14 2002 MIT Press Cambridge, MA 601 608
6. T. Brants, F. Chen, and I. Tsochantaridis Topic-based document segmentation with probabilistic latent semantic analysis Proceedings of the international conference on information and knowledge management 2002 ACM McLean, Virginia, USA 211 218
7. Choi, F. Y. Y. (2000). Advances in domain independent linear text segmentation. In Proceedings of the conference of north american chapter of the ACL, Seattle, WA, USA (pp. 26-33).
8. Choi, F.; Wiemer-Hastings, P.; & Moore, J. (2001). Latent semantic analysis for text segmentation. In Proceedings of EMNLP, Pittsburgh, PA, USA (pp. 109-117).
9. T.-S. Chua, S.-F. Chang, L. Chaisorn, and W. Hsu Story boundary detection in large broadcast news video archives: Techniques, experience and trends MM 2004 ACM New York, NY, USA 1-58113-893-8 656 659 (Pubitemid 40211842)
10. Eisenstein, J.; Barzilay, R.; & Davis, R. (2008). Gestural cohesion for topic segmentation. In Proceedings of ACL-08: HLT, Columbus, Ohio, USA (pp. 852-860).
11. P. Fragkou, V. Petridis, and A. Kehagias A dynamic programming algorithm for linear text segmentation Journal of Intelligent Information System 0925-9902 23 2 2004 179 197
12. T.L. Griffiths, and M. Steyvers Finding scientific topics Proceedings of the National Academy of Sciences 101 supl. 1 2004 5228 5235 (Pubitemid 38469131)
13. M.A.K. Halliday, and R. Hasan Cohesion in English 1976 Longman London
14. M. Hearst TextTiling: Segmenting texts into multi-paragraph subtopic passages Computational Linguistics 23 1 1997 33 64 (Pubitemid 127458657)
15. Heidel, A.; an Chang, H.; & shan Lee, L. (2007). Language model adaptation using latent Dirichlet allocation and an efficient topic inference algorithm. In Proceedings of EuroSpeech, Antwerp, Belgium.
16. T. Hofmann Unsupervised learning by probabilistic latent semantic analysis Machine Learning Journal 42 1 2001 177 196 (Pubitemid 32872403)
17. Kehagias, A.; Pavlina, F.; & Petridis, V. (2003). Linear text segmentation using a dynamic programming algorithm. In Proceedings of the tenth conference on European chapter of the association for computational linguistics, Budapest, Hungary (pp. 171-178).
18. Kozima, H. (1993). Text segmentation based on similarity between words. In Meeting of the association for computational linguistics, Ohio, USA (pp. 286-288).
19. D.D. Lewis, Y. Yang, T. Rose, and F. Li RCV1: A new benchmark collection for text categorization research Machine Learning Research 5 2004 361 397
20. Malioutov, I.; & Barzilay, R. (2006). Minimum cut model for spoken lecture segmentation. In Proceedings of the 21st international conference on computational linguistics and 44th annual meeting of the association for computational linguistics, Sydney, Australia (pp. 25-32).
21. Minka, T.; & Lafferty, J. (2002). Expectation-propagation for the generative aspect model. In Proceedings of the conference on uncertainty in artificial intelligence, Edmonton, Alberta, Canada (pp. 352-359).
22. Misra, H.; Cappé, O.; & Yvon, F. (2008). Using LDA to detect semantically incoherent documents. In Proceedings of CoNLL, Manchester, UK (pp. 41-48).
23. J. Morris, and G. Hirst Lexical cohesion computed by thesaural relations as an indicator of the structure of text Computational Linguistics 17 1 1991 21 48
24. Mulbregt, P. V.; Carp, I.; Gillick, L.; Lowe, S.; & Yamron, J. (1998). Text segmentation and topic tracking on broadcast news via a hidden Markov model approach. In Proceedings of ICSLP, Sydney, Australia (pp. 2519-2522).
25. K. Nigam, A.K. McCallum, S. Thrun, and T.M. Mitchell Text classification from labeled and unlabeled documents using EM Machine Learning 39 2/3 2000 103 134 (Pubitemid 30594822)
26. Ponte, J. M.; & Croft, W. B. (1997). Text segmentation by topic. In European conference on digital libraries, Pisa, Italy (pp. 113-125).
27. Reynar, J. C. (1998). Topic segmentation: Algorithms and applications. Ph.D. thesis, University of Pennsylvania.
28. L. Rigouste, O. Cappé, and F. Yvon Inference and evaluation of the multinomial mixture model for text clustering Information Processing and Management 43 5 2007 1260 1280 (Pubitemid 46636019)
29. N. Stokes, J. Carthy, and A.F. Smeaton SeLeCT: A lexical cohesion based news story segmentation system Journal of AI Communications 17 1 2004 3 12
30. Sun, Q.; Li, R.; Luo, D.; & Wu, S. (2008). Text segmentation with LDA-based Fisher kernel. In Proceedings of ACL-08: HLT, Short Papers, Association for Computational Linguistics, Columbus, Ohio (pp. 269-272).
31. Tam, Y-C.; & Schultz, T. (2006). Unsupervised language model adaptation using latent semantic marginals. In Proceedings of ICSLP, Pittsburgh, PA, USA.
32. TREC Video Retrieval Evaluation (2003). < http://wwwnlpir.nist.gov/ projects/tv2003/tv2003.html >.
33. Utiyama, M.; & Isahara, H. (2001). A statistical model for domain-independent text segmentation. In Meeting of the association for computational linguistics, Bergen, Norway (pp. 491-498).
34. Wilkinson, R. (1994). Effective retrieval of structured documents. In Proceedings of ACM special interest group on information retrieval, Dublin, Ireland (pp. 311-317).
35. D. Xing, and M. Girolami Employing latent Dirichlet allocation for fraud detection in telecommunications Pattern Recognition Letters 28 13 2007 1727 1734 (Pubitemid 47058626)
36. G. Youmans A new tool for discourse analysis: The vocabulary-management profile Language 67 1991 763 789