Extraction of coherent relevant passages using hidden markov models

ACM Transactions on Information Systems

Volumn 24, Issue 3, 2006, Pages 295-319

  Jiang, Jing ^a   Zhai, Chengxiang ^a  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Additional Key Words and Phrases: Hidden Markov models; Passage retrieval

Indexed keywords

ADDITIONAL KEY WORDS AND PHRASES; HIDDEN MARKOV MODELS (HMM); PASSAGE EXTRACTION; PASSAGE RETRIEVAL;

FEATURE EXTRACTION; MARKOV PROCESSES; PARAMETER ESTIMATION; QUERY LANGUAGES; SIGNAL FILTERING AND PREDICTION;

INFORMATION RETRIEVAL;

EID: 33749586992     PISSN: 10468188     EISSN: 10468188     Source Type: Journal    
DOI: 10.1145/1165774.1165775     Document Type: Article

References (24)

1. ALLAN, J. 2003. Hard track overview in tree 2003: High accuracy retrieval from documents. In Proceedings of the 12th Text REtrieval Conference. 24-37.
2. CALLAN, J. P. 1994. Passage-level evidence in document retrieval. In Proceedings of the 17th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. Dublin. Springer Verlag, New York, NY, 302-310.
3. CLARKE, C. L. A. AND TERRA, E. L. 2003. Passage retrieval vs. document retrieval for factoid question answering. In Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Toronto, Canada. ACM Press, New York, NY, 427-428.
4. CONROY, J. AND O'LEARY, D. P. 2001. Text summarization via hidden Markov models and pivoted QR matrix decomposition. Tech. Rep., University of Maryland, College Park.
5. CORMACK, G. V., CLARKE, C. L. A., PALMER, C. R., AND To, S. S. L. 1998. Passage-based refinement (MultiText experiments for TREC-6). In Proceedings of the 6th Text REtrieval Conference. 303-320.
6. CORRADA-EMMANUEL, A. AND CROFT, W. B. 2004. Answer models for question answering passage retrieval. In Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. Sheffield, UK. ACM Press, New York, NY, 516-517.
7. DENOYER, L. AND ZARAGOZA, H. 2001. HMM-based passage models for document classification and ranking. In Proceedings of the 23rd BCS European Annual Colloquium on Information Retrieval.
8. FREITAG, D. AND MCCALLUM, A. 2000. Information extraction with HMM structure learned by stochastic optimization. In Proceedings of the 18th Conference on Artifitical Intelligence (AAAI). 584-589.
9. FUNG, P., NGAI, G., AND CHEUNG, P. 2003. Combining optimal clustering and hidden Markov models for extractive summarization. In Proceedings of the ACL Workshop on Multilingual Summarization.
10. HE, D., DEMNER-FUSHMAN, D., OARD, D. W., KARAKOS, D., AND KHUDANPUH, S. 2004. Improving passage retrieval using interactive elicitation and statistical modeling. In Proceedings of the 13th Text REtrieval Conference.
11. HEARST, M. A. 1997. TextTiling: Segmenting text into multi-paragraph subtopic passages. Comput. Linguist. 23, 1, 33-64.
12. JIANG, J. AND ZHAI, C. 2004. UIUC in HARD 2004-Passage retrieval using HMMs. In Proceedings of the 13th Text REtrieval Conference.
13. KASZKIEL, M. AND ZOBEL, J. 1997. Passage retrieval revisited. In Proceedings of the 20th Annual International. ACM SIGIR Conference on Research and Development in Information Retrieval. Philadelphia, PA. ACM Press, New York, NY, 178-185.
14. KASZKIEL, M. AND ZOBEL, J. 2001. Effective ranking with arbitrary passages. J. American Society Inf. Sci. 52, 4, 344-364.
15. KNAUS, D., MITTENDORP, E., SCHÄUBLE, P., AND SHEHIDAN, P. 1996. Highlighting relevant passages for users of the interactive SPIDER retrieval system. In Proceedings of the 4th Text REtrieval Conference.
16. LAVRENKO, V. AND CROFT, W. B. 2001. Relevance-based language models. In Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. New Orleans, LA. ACM Press, New York, NY, 120-127.
17. Liu, X. AND CROFT, W. B. 2002. Passage retrieval based on language models. In Proceedings of the 11th International Conference on Information and Knowledge Management. McLean, VA. ACM Press, New York, NY, 375-382.
18. MITTENDORF, E. AND SCHÄUBLE, P. 1994. Document and passage retrieval based on hidden Markov models. In Proceedings of the 17th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. Dublin. Springer Verlag, New York, 318-327.
19. RABINER, L. R. 1989. A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE 77, 2, 257-286.
20. SALTON, G., ALLAN, J., AND BUCKLEY, C. 1993. Approaches to passage retrieval in full text information systems. In Proceedings of the 16th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. Pittsburgh, PA. ACM Press, New York, NY, 49-58.
21. TELLEX, S., KATZ, B., LIN, J., FERNANDES, A., AND MARTON, G. 2003. Quantitative evaluation of passage retrieval algorithms for question answering. In Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. Toronto, Canada. ACM Press, New York, NY, 41-47.
22. ZAJIC, D., DORR, B., AND SCHWARTZ, R. 2005. Headline generation for written and broadcast news. Tech. Rep. LAMP-TR-120,CS-TR-4698,UMIACS-TR-2005-07, University of Maryland, College Park.
23. ZHAI, C. AND LAFFERTY, J. 2001a. Model-based feedback in the language modeling approach to information retrieval. In Proceedings of the 10th International Conference on Information and Knowledge Management. Atlanta, GA. ACM Press, New York, NY, 403-410.
24. ZHAI, C. AND LAFFERTY, J. 2001b. A study of smoothing methods for language models applied to ad hoc information retrieval. In Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. New Orleans, LA, 334-342.