Topic segmentation and labeling in asynchronous conversations

Journal of Artificial Intelligence Research

Volumn 47, Issue , 2013, Pages 521-573

  Joty, Shafiq ^a   Carenini, Giuseppe ^b   Ng, Raymond T ^b  

^a QATAR COMPUTING RESEARCH INSTITUTE   (Qatar)

^b UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

GRAPH THEORY; GRAPHIC METHODS;

COMPUTATIONAL FRAMEWORK; CONVERSATION ANALYSIS; EMPIRICAL EVALUATIONS; FINE-GRAINED STRUCTURE; GRAPH-BASED METHODS; NATURAL LANGUAGE PROCESSING; STATE-OF-THE-ART METHODS; TOPIC SEGMENTATIONS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 84880660500     PISSN: None     EISSN: 10769757     Source Type: Journal    
DOI: 10.1613/jair.3940     Document Type: Article

References (75)

1. Allan, J. (2002). Topic Detection and Tracking: Event-based Information Organization, pp. 1-16. Kluwer Academic Publishers, Norwell, MA, USA.
2. Allan, J., Wade, C., & Bolivar, A. (2003). Retrieval and Novelty Detection at the Sentence Level. In Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, SIGIR'03, pp. 314-321, Toronto, Canada. ACM.
3. Andrzejewski, D., Zhu, X., & Craven, M. (2009). Incorporating domain knowledge into topic modeling via dirichlet forest priors. In Proceedings of the 26th Annual International Conference on Machine Learning, ICML'09, pp. 25-32, Montreal, Quebec, Canada. ACM.
4. Aumayr, E., Chan, J., & Hayes, C. (2011). Reconstruction of threaded conversations in online discussion forums. In Proceedings of the Fifth International AAAI Conference on Weblogs and Social Media (ICWSM-11), pp. 26-33.
5. Bangalore, S., Di Fabbrizio, G., & Stent, A. (2006). Learning the Structure of Task-Driven Human-Human Dialogs. In Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics, pp. 201-208. ACL.
6. Bansal, N., Blum, A., & Chawla, S. (2002). Correlation clustering. In Proceedings of the 43rd Symposium on Foundations of Computer Science, FOCS'02, pp. 238-, Washington, DC, USA. IEEE Computer Society.
7. Baron, N. S. (2008). Always on: Language in an online and mobile world. Oxford; New York: Oxford University Press.
8. Barzilay, R., & Lee, L. (2004). Catching the drift: Probabilistic content models, with applications to generation and summarization. In HLT-NAACL.
9. Beeferman, D., Berger, A., & Lafferty, J. (1999). Statistical models for text segmentation. In Machine Learning, Vol. 34, pp. 177-210, Hingham, MA, USA. Kluwer Academic Publishers.
10. Blei, D., Ng, A., & Jordan, M. (2003). Latent Dirichlet Allocation. The Journal of Machine Learning Research, 3, 993-1022.
11. Blei, D. M., & Moreno, P. J. (2001). Topic segmentation with an aspect hidden markov model. In Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, SIGIR'01, pp. 343-348, New York, NY, USA. ACM.
12. Boyd-Graber, J., & Blei, D. M. (2008). Syntactic topic models. In Neural Information Processing Systems.
13. Breiman, L. (1996). Bagging predictors. Machine Learning, 24(2), 123-140.
14. Carbonell, J., & Goldstein, J. (1998). The use of MMR, diversity-based reranking for reordering documents and producing summaries. In Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval, pp. 335-336, Melbourne, Australia. ACM.
15. Carenini, G., Murray, G., & Ng, R. (2011). Methods for mining and summarizing text conversations, Vol. 3. Morgan Claypool.
16. Carenini, G., Ng, R. T., & Zhou, X. (2007). Summarizing Email Conversations with Clue Words. In Proceedings of the 16th international conference on World Wide Web, pp. 91-100, Banff, Canada. ACM.
17. Carenini, G., Ng, R. T., & Zhou, X. (2008). Summarizing Emails with Conversational Cohesion and Subjectivity. In Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, pp. 353-361, OH. ACL.
18. Choi, F. Y. Y., Hastings, P. W., & Moore, J. (2001). Latent semantic analysis for text segmentation. In Proceedings of the 2001 Conference on Empirical Methods in Natural Language Processing, EMNLP'01, pp. 109-117, Pittsburgh, USA. ACL.
19. Cortes, C., & Vapnik, V. N. (1995). Support Vector Networks. Machine Learning, 20, 273-297.
20. Crystal, D. (2001). Language and the Internet. Cambridge University Press.
21. Dias, G., Alves, E., & Lopes, J. G. P. (2007). Topic Segmentation Algorithms for Text Summarization and Passage Retrieval: an Exhaustive Evaluation. In Proceedings of the 22nd national conference on Artificial intelligence - Volume 2, pp. 1334-1339, Vancouver, BC, Canada. AAAI.
22. Eisenstein, J. (2009). Hierarchical text segmentation from multi-scale lexical cohesion. In Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, NAACL'09, pp. 353-361, Stroudsburg, PA, USA. Association for Computational Linguistics.
23. Eisenstein, J., & Barzilay, R. (2008). Bayesian unsupervised topic segmentation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, EMNLP'08, pp. 334-343, Honolulu, Hawaii. Association for Computational Linguistics.
24. Elsner, M., & Charniak, E. (2010). Disentangling chat. Computational Linguistics, 36, 389-409.
25. Elsner, M., & Charniak, E. (2011). Disentangling chat with local coherence models. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1, HLT'11, pp. 1179-1189, Stroudsburg, PA, USA. Association for Computational Linguistics.
26. Galley, M., McKeown, K., Fosler-Lussier, E., & Jing, H. (2003). Discourse segmentation of multi-party conversation. In Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - Volume 1, ACL'03, pp. 562-569, Sapporo, Japan. ACL.
27. Griffiths, T. L., Steyvers, M., Blei, D. M., & Tenenbaum, J. B. (2005). Integrating topics and syntax. In Advances in Neural Information Processing Systems, pp. 537-544. MIT Press.
28. Harabagiu, S., & Lacatusu, F. (2005). Topic Themes for Multi-document Summarization. In Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, pp. 202-209, Salvador, Brazil. ACM.
29. Hearst, M. A. (1997). TextTiling: segmenting text into multi-paragraph subtopic passages. Computational Linguistics, 23(1), 33-64.
30. Hsueh, P., Moore, J. D., & Renals, S. (2006). Automatic segmentation of multiparty dialogue. In the Proceedings of the 11th Conference of the European Chapter of the Association for Computational Linguistics, EACL'06, Trento, Italy. ACL.
31. Hulth, A. (2003). Improved automatic keyword extraction given more linguistic knowledge. In Proceedings of the 2003 conference on Empirical methods in natural language processing, EMNLP'03, pp. 216-223. Association for Computational Linguistics.
32. Janin, A., Baron, D., Edwards, J., Ellis, D., Gelbart, D., Morgan, N., Peskin, B., Pfau, T., Shriberg, E., Stolcke, A., & Wooters, C. (2003). The ICSI Meeting Corpus. In Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP-03), pp. 364-367.
33. Joty, S., Carenini, G., & Lin, C. (2011). Unsupervised modeling of dialog acts in asynchronous conversations. In Proceedings of the twenty second International Joint Conference on Artificial Intelligence (IJCAI), Barcelona.
34. Joty, S., Carenini, G., Murray, G., & Ng, R. (2010). Exploiting conversation structure in unsupervised topic segmentation for Emails. In Proceedings of the conference on Empirical Methods in Natural Language Processing, EMNLP'10, pp. 388-398, Massachusetts, USA. ACL.
35. Joty, S., Carenini, G., Murray, G., & Ng, R. (2011). Supervised topic segmentation of Email conversations. In Proceedings of the Fifth International AAAI Conference on Weblogs and Social Media, ICWSM'11, pp. 530-533, Barcelona, Spain. AAAI.
36. Kim, S., Baldwin, T., & Kan, M. (2010a). Evaluating n-gram based evaluation metrics for automatic keyphrase extraction. In Proceedings of the 23rd International Conference on Computational Linguistics, C0LING'10, pp. 572-580, Beijing, China. ACL.
37. Kim, S. N., Medelyan, O., Kan, M.-Y., & Baldwin, T. (2010b). Semeval-2010 task 5: Automatic keyphrase extraction from scientific articles. In Proceedings of the 5th International Workshop on Semantic Evaluation, pp. 21-26, Uppsala, Sweden. Association for Computational Linguistics.
38. Kleinbauer, T., Becker, S., & Becker, T. (2007). Combining Multiple Information Layers for the Automatic Generation of Indicative Meeting Abstracts. In Proceedings of the Eleventh European Workshop on Natural Language Generation, ENLG'07, pp. 151-154, Stroudsburg, PA, USA. Association for Computational Linguistics.
39. Lau, J., Grieser, K., Newman, D., & Baldwin, T. (2011). Automatic Labelling of Topic Models. In Proceedings of the 49th annual meeting on Association for Computational Linguistics, pp. 1536-1545, Portland, USA. ACL.
40. Lin, C.-Y. (2004). ROUGE: a package for automatic evaluation of summaries. In Proceedings of Workshop on Text Summarization Branches Out, pp. 74-81, Barcelona.
41. Liu, S., Zhou, M. X., Pan, S., Song, Y., Qian, W., Cai, W., & Lian, X. (2012). TIARA: interactive, topic-based visual text summarization and analysis. ACM Trans. Intell. Syst. Technol., 13(2), 25:1-25:28.
42. Malioutov, I., & Barzilay, R. (2006). Minimum cut model for spoken lecture segmentation. In Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics, ACL-44, pp. 25-32, Sydney, Australia. Association for Computational Linguistics.
43. Mayfield, E., Adamson, D., & Rose, C. P. (2012). Hierarchical conversation structure prediction in multi-party chat. In Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue, SIGDIAL'12, pp. 60-69, Stroudsburg, PA, USA. Association for Computational Linguistics.
44. Medelyan, O. (2009). Human-competitive automatic topic indexing. Ph. D. thesis, The University of Waikato, Hamilton, New Zealand.
45. Medelyan, O., Frank, E., & Witten, I. H. (2009). Human-competitive tagging using automatic keyphrase extraction. In Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, EMNLP'09, pp. 1318-1327, Singapore. Association for Computational Linguistics.
46. Mei, Q., Shen, X., & Zhai, C. (2007). Automatic labeling of Multinomial topic models. In Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 490-499, California, USA. ACM.
47. Mihalcea, R., & Radev, D. (2011). Graph-based natural language processing and information retrieval. Cambridge University Press.
48. Mihalcea, R., & Tarau, P. (2004). Textrank: Bringing order into text. In Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing, EMNLP'04, pp. 404-411, Barcelona, Spain.
49. Minka, T. (1999). The dirichlet-tree distribution. Tech. rep., Justsystem Pittsburgh Research Center.
50. Morris, J., & Hirst, G. (1991). Lexical cohesion computed by thesaural relations as an indicator of structure of text. Computational Linguistics, 17(1), 21-48.
51. Murphy, K. (2012). Machine Learning A Probabilistic Perspective. The MIT Press.
52. Nguyen, V.-A., Boyd-Graber, J., & Resnik, P. (2012). Sits: a hierarchical nonparametric model using speaker identity for topic segmentation in multiparty conversations. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers - Volume 1, ACL'12, pp. 78-87, Stroudsburg, PA, USA. Association for Computational Linguistics.
53. Page, L., Brin, S., Motwani, R., & Winograd, T. (1999). The pagerank citation ranking: Bringing order to the web.. Technical report 1999-66.
54. Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2002). BLEU: a method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, ACL'02, pp. 311-318, Philadelphia, Pennsylvania. Association for Computational Linguistics.
55. Passonneau, R. J., & Litman, D. J. (1997). Discourse segmentation by human and automated means. Computational Linguistics, 23(1), 103-139.
56. Pedersen, T., Patwardhan, S., & Michelizzi, J. (2004). WordNet::Similarity - Measuring the Relatedness of Concepts. In Proceedings of Fifth Annual Meeting of the North American Chapter of the Association for Computational Linguistics (NAACL-04), pp. 38-41, Boston, MA.
57. Pevzner, L., & Hearst, M. A. (2002). A critique and improvement of an evaluation metric for text segmentation. Computational Linguistics, 28(1), 19-36.
58. Purver, M. (2011). Topic segmentation. In Tur, G., & de Mori, R. (Eds.), Spoken Language Understanding: Systems for Extracting Semantic Information from Speech, pp. 291-317. Wiley.
59. Purver, M., Kording, K. P., Griffiths, T. L., & Tenenbaum, J. B. (2006). Unsupervised topic modelling for multi-party spoken discourse. In Proceedings of the ACL'06, pp. 17-24, Sydney, Australia. ACL.
60. Sacks, H., Schegloff, A., & Jefferson, G. (1974). A simplest systematics for the organization of turn-taking for conversation. Language, 50, 696-735.
61. Salton, G., & McGill, M. J. (1986). Introduction to Modern Information Retrieval. McGraw-Hill, Inc., New York, NY, USA.
62. Seneta, E. (1981). Non-negative Matrices and Markov Chains. Springer-Verlag.
63. Shi, J., & Malik, J. (2000). Normalized cuts and image segmentation. IEEE Trans. Pattern Anal. Mach. Intell., 22(8), 888-905.
64. Soon, W. M., Ng, H. T., & Lim, D. C. Y. (2001). A machine learning approach to coreference resolution of noun phrases. Computational Linguistics, 27(4), 521-544.
65. Steyvers, M., & Griffiths, T. (2007). Latent Semantic Analysis: A Road to Meaning, chap. Probabilistic topic models. Laurence Erlbaum.
66. Turney, P. D. (2000). Learning algorithms for keyphrase extraction. Information Retrieval, 2(4), 303-336.
67. Ulrich, J., Murray, G., & Carenini, G. (2008). A publicly available annotated corpus for supervised email summarization. In EMAIL-2008 Workshop, pp. 428-435. AAAI.
68. Verna, P. (2010). The blogosphere: Colliding with social and mainstream media. eMarketer.
69. Wallach, H. M. (2006). Topic modeling: beyond bag-of-words. In Proceedings of the 23rd international conference on Machine learning, ICML'06, pp. 977-984, Pittsburgh, Pennsylvania. ACM.
70. Wang, H., Wang, C., Zhai, C., & Han, J. (2011). Learning online discussion structures by conditional random fields. In Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval, SIGIR'11, pp. 435-444, Beijing, China. ACM.
71. Wang, L., & Oard, D. W. (2009). Context-based message expansion for disentanglement of interleaved text conversations. In Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, NAACL'09, pp. 200-208, Stroudsburg, PA, USA. Association for Computational Linguistics.
72. Zesch, T., & Gurevych, I. (2009). Approximate matching for evaluating keyphrase extraction. In Proceedings of the 7th International Conference on Recent Advances in Natural Language Processing, RANLP'09, pp. 484-489, Borovets, Bulgaria.
73. Zhao, W. X., Jiang, J., He, J., Song, Y., Achananuparp, P., Lim, E.-P., & Li, X. (2011a). Topical keyphrase extraction from twitter. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1, HLT'11, pp. 379-388, Stroudsburg, PA, USA. Association for Computational Linguistics.
74. Zhao, W. X., Jiang, J., Weng, J., He, J., Lim, E.-P., Yan, H., & Li, X. (2011b). Comparing twitter and traditional media using topic models. In Proceedings of the 33rd European conference on Advances in information retrieval, ECIR'11, pp. 338-349, Berlin, Heidelberg. Springer-Verlag.
75. Zhou, D., Orshanskiy, S. A., Zha, H., & Giles, C. L. (2007). Co-ranking authors and documents in a heterogeneous network. In Proceedings of the 2007 Seventh IEEE International Conference on Data Mining, ICDM'07, pp. 739-744, Washington, DC, USA. IEEE Computer Society.