Personalized text snippet extraction using statistical language models

Pattern Recognition

Volumn 43, Issue 1, 2010, Pages 378-386

  Li, Qing ^a   Chen, Yuanzhu Peter ^b  

^a SOUTHWESTERN UNIVERSITY OF FINANCE AND ECONOMICS   (China)

^b MEMORIAL UNIVERSITY OF NEWFOUNDLAND   (Canada)

Author keywords

Hidden Markov Model; Information retrieval; Language model; Natural language processing; Pattern discovery; Personalization; Text snippet extraction

Indexed keywords

LANGUAGE MODEL; NATURAL LANGUAGE PROCESSING; PATTERN DISCOVERY; PERSONALIZATION; TEXT SNIPPET EXTRACTION;

COMPUTATIONAL LINGUISTICS; HIDDEN MARKOV MODELS; INFORMATION RETRIEVAL; INFORMATION SERVICES; OBJECT RECOGNITION; SEARCH ENGINES; WEBSITES; WINDOWS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 68949162051     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2009.06.003     Document Type: Article

References (32)

1. J.P. Callan, Passage-level evidence in document retrieval, in: Proceedings of the 17th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Springer, New York, 1994, pp. 302-310.
2. C. Clarke, G. Cormack, D. Kisman, T. Lynam, Question answering by passage selection (multitext experiments for trec-9), in: Proceedings of the 9th Text Retrieval Conference (TREC), 2000, pp. 673-684.
3. J. Conroy, D.P. O'leary, Text summarization via hidden Markov models and pivoted QR matrix decomposition, Technical Report CS-TR-4221, University of Maryland, College Park, Maryland, USA, 2001.
4. P. Fung, G. Ngai, C.-S. Cheung, Combining optimal clustering and hidden Markov models for extractive summarization, in: ACL Workshop on Multilingual Summarization and Question Answering, Association for Computational Linguistics, Morristown, NJ, USA, 2003, pp. 21-28.
5. Hearst M.A. Texttiling: segmenting text into multi-paragraph subtopic passages. Computational Linguistics 23 1 (1997) 33-64
6. M.A. Hearst, C. Plaunt, Subtopic structuring for full-length document access, Technical Report, Berkeley, CA, USA, 1993.
7. D. Hull, Using statistical testing in the evaluation of retrieval experiments, in: Proceedings of the 16th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM, New York, NY, USA, 1993, pp. 329-338.
8. Jelinek F., and Mercer R. Probability distribution estimation from sparse data. IBM Technical Disclosure Bulletin 28 6 (1985) 2591-2594
9. M. Kaszkiel, J. Zobel, Passage retrieval revisited, in: Proceedings of the 20th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM, New York, NY, USA, 1997, pp. 178-185.
10. Kaszkiel M., and Zobel J. Effective ranking with arbitrary passages. Journal of the American Society for Information Science and Technology 52 4 (2001) 344-364
11. Kupiec J. Robust part-of-speech tagging using a hidden Markov model. Computer Speech & Language 6 3 (1992) 225-242
12. V. Lavrenko, J. Allan, E. DeGuzman, D. LaFlamme, V. Pollard, S. Thomas, Relevance models for topic detection and tracking, in: Proceedings of the 2nd International Conference on Human Language Technology Research, Morgan Kaufmann, San Francisco, CA, USA, 2002, pp. 115-121.
13. V. Lavrenko, W.B. Croft, Relevance based language models, in: Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM, New York, NY, USA, 2001, pp. 120-127.
14. V. Lavrenko, M. Schmill, D. Lawrie, P. Ogilvie, D. Jensen, J. Allan, Language models for financial news recommendation, in: Proceedings of the 9th International Conference on Information and Knowledge Management (CIKM), ACM, New York, NY, USA, 2000, pp. 389-396.
15. C.Y. Lin, E. Hovy, From single to multi-document summarization: a prototype system and its evaluation, in: Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, 2002, pp. 457-464.
16. X. Liu, W.B. Croft, Passage retrieval based on language models, in: Proceedings of the 7th International Conference on Information and Knowledge Management (CIKM), 2002, pp. 375-382.
17. F. Llopis, J.L. Vicedo, A. Ferrández, Passage selection to improve question answering, in: Proceedings of the Conference on Multilingual Summarization and Question Answering (COLING), Association for Computational Linguistics, Morristown, NJ, USA, 2002, pp. 1-6.
18. R. Nobles, Pleased with your google description? Technical Report, 2004.
19. J.M. Ponte, W.B. Croft, Text segmentation by topic, in: Proceedings of the 1st European Conference on Research and Advanced Technology for Digital Libraries (ECDL), Springer, London, UK, 1997, pp. 113-125.
20. J.M. Ponte, W.B. Croft, A language modeling approach to information retrieval, in: Proceedings of the 21st annual international ACM SIGIR Conference on Research and Development in Information Retrieval, ACM, New York, NY, USA, 1998, pp. 275-281.
21. Rabiner L.R. A tutorial on hidden markov models and selected applications in speech recognition. Proceedings of the IEEE 77 2 (1989) 257-286
22. D.R. Radev, H. Jing, M. Budzikowska, Centroid-based summarization of multiple documents: sentence extraction, utility-based evaluation, and user studies, in: Proceedings of ANLP/NAACL Workshop on Summarization, 2000, pp. 21-29.
23. I. Roberts, R. Gaizauskas, Evaluating passage retrieval approaches for question answering, in: Proceedings of 26th European Conference on Information Retrieval, 2004, pp. 72-84.
24. Robertson S.E. The probability ranking principle in IR. Journal of Documentation 33 4 (1977) 294-304
25. R. Rosenfeld, Two decades of statistical language modeling: where do we go from here, in: Proceedings of the IEEE, 2000.
26. Salton G., Allan J., and Singhal A. Automatic text decomposition and structuring. Information Processing and Management 32 2 (1996) 127-138
27. M. Sanderson, J. Zobel, Information retrieval system evaluation: effort, sensitivity, and reliability, in: Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM, New York, NY, USA, 2005, pp. 162-169.
28. F. Song, W.B. Croft, A general language model for information retrieval, in: Proceedings of the 8th International Conference on Information and Knowledge Management (CIKM), ACM, New York, NY, USA, 1999, pp. 316-321.
29. M. Witbrock, V.O. Mittal, Headline generation: A framework for generating highly-condensed non-extractive summaries, in: Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 1999, pp. 315-316.
30. M. Witbrock, V.O. Mittal, Summarizing text documents: sentence selection and evaluation metrics, in: Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 1999, pp. 121-128.
31. D. Zajic, B. Dorr, R. Schwartz, Automatic headline generation for newspaper stories, in: Proceedings of the ACL Workshop on Automatic Summarization and Document Understanding Conference (DUC), 2002, pp. 78-85.
32. D. Zhang, W.S. Lee, A language modeling approach to passage question answering, in: Proceedings of the Text Retrieval Conference (TREC), 2003.