SeLeCT: A lexical cohesion based news story segmentation system

AI Communications

Volumn 17, Issue 1, 2004, Pages 3-12

  Stokes, Nicola ^a   Carthy, Joe ^a   Smeaton, Alan F ^b  

^a UNIVERSITY COLLEGE DUBLIN   (Ireland)

^b DUBLIN CITY UNIVERSITY   (Ireland)

Author keywords

Lexical chaining; Lexical cohesion; NLP; Text segmentation

Indexed keywords

ALGORITHMS; ERROR ANALYSIS; INFORMATION RETRIEVAL; MARKOV PROCESSES; MATHEMATICAL MODELS; NATURAL LANGUAGE PROCESSING SYSTEMS; SEMANTICS;

LEXICAL CHAINING; LEXICAL COHESION; NLP; TEXT SEGMENTATION;

TEXT PROCESSING;

EID: 1842479362     PISSN: 09217126     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (25)

1. J. Allan, J. Carbonell, G. Doddington, J. Yamron and Y. Yang, Topic detection and tracking pilot study: Final report, in: Proceedings of the DARPA Broadcast News Transcription and Understanding Workshop, 1998.
2. R. Barzilay and M. Elhadad, Using lexical chains for text summarization, in: Proceedings of the Intelligent Scalable Text Summarization Workshop, 1997.
3. D. Beeferman, A. Berger and J. Lafferty, Statistical models for text segmentation, Machine Learning 34(1-3) (1999), 177-210.
4. F. Choi, Advances in domain independent linear text segmentation, in: Proceedings of the North American Chapter of the ACL, 2000.
5. S. Dharanipragada, M. Franz, J.S. McCarley, S. Roukos and T. Ward, Story segmentation and topic detection, in: Proceedings of the DARPA Broadcast News Workshop, 1999.
6. M.A.K. Halliday, Spoken and Written Language, Oxford University Press, 1985.
7. M.A.K. Halliday and R. Hasan, Cohesion in English, Longman, 1976.
8. M. Hearst, Texttiling: Segmenting text into multi-paragraph subtopic passages, Computational Linguistics 23(1) (1997), 33-64.
9. J.S. Justeson and S.M. Katz, Technical terminology: some linguistic properties and an algorithm for identification in text, Natural Language Engineering (11) (1995), 9-27.
10. H. Kozima, Text segmentation based on similarity between words, in: Proceedings of the Association for Computational Linguistics, 1993, pp. 286-288.
11. C.D. Manning, Rethinking text segmentation models: An information extraction case study, 1998.
12. G.A. Miller, R. Beckwith, C. Fellbaum, D. Gross and K. Miller, Five papers on wordnet, Technical report, Cognitive Science Laboratory, 1990.
13. M.-Y. Kan, J.L. Klavans and K.R. McKeown, Linear segmentation and segment relevance, in: Proceedings of the International Workshop of Very Large Corpora, 1999, pp. 197-205.
14. J. Morris and G. Hirst, Lexical cohesion by thesaural relations as an indicator of the structure of text, Computational Linguistics 17(1) (1991).
15. M. Okumura and T. Honda, Word sense disambiguation and text segmentation based on lexical cohesion, in: Proceedings of the Conference on Computational Linguistics, 1994, pp. 755-761.
16. R. Passoneau and D. Litman, Intention based segmentation: Human reliability and correlation with linguistic cues, in: Proceedings of the Association of Computation Linguistics, 1993, pp. 148-155.
17. L. Pevzner and M. Hearst, A critique and improvement of an evaluation metric for text segmentation, Computational Linguistics 28(1) (2002), 19-36.
18. J.M. Ponte and W.B. Croft, Text segmentation by topic, in: Proceedings of European Conference on Digital Libraries, 1997, pp. 113-125.
19. J. Reynar, Topic segmentation: algorithms and application, PhD thesis, Computer and Information Science, UPenn, 1998.
20. D. St-Onge, Detecting and correcting malapropisms with lexical chains, Master's thesis, Department of Computer Science, University of Toronto, 1995.
21. M.A. Stairmand, A computational analysis of lexical cohesion with applications in information retrieval, PhD thesis, Department of Language Engineering, UMIST, 1996.
22. N. Stokes, Spoken and written news story segmentation using lexical chaining, in: Proceedings of the Student Workshop at HLT-NAACL, Companion Volume, 2003, pp. 49-54.
23. N. Stokes, J. Carthy and A.F. Smeaton, Segmenting broadcast news streams using lexical chains, in: Proceedings of STarting AI Researchers Symposium, 2002, pp. 145-154.
24. P. van Mulbregt, I. Carp, L. Gillick, S.A. Lowe and J.P. Yamron, Segmentation of automatically transcribed broadcast news text, in: Proceedings of DARPA Broadcast News Workshop, 1999.
25. C.J. van Rijsbergen, Information Retrieval, Butterworths, 1979.