A probabilistic model for stemmer generation

Information Processing and Management

Volumn 41, Issue 1, 2005, Pages 121-137

  Bacchin, Michela ^a   Ferro, Nicola ^a   Melucci, Massimo ^a  

^a UNIVERSITY OF PADOVA   (Italy)

Author keywords

Multi lingual information retrieval; Mutual reinforcement; Stemming; Web information retrieval

Indexed keywords

ALGORITHMS; DATA PROCESSING; INFORMATION MANAGEMENT; LINGUISTICS; PROBABILITY; QUERY LANGUAGES; WORLD WIDE WEB;

MULTI-LINGUAL INFORMATION RETRIEVAL; MUTUAL REINFORCEMENT; STEMMING; WEB INFORMATION RETRIEVAL;

INFORMATION RETRIEVAL;

EID: 84983165279     PISSN: 03064573     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ipm.2004.04.006     Document Type: Article

References (25)

1. Agosti M., Bacchin M., Ferro N., Melucci M. Improving the automatic retrieval of text documents. Peters C., Braschler M., Gonzalo J., Kluck M. Advances in cross-language information retrieval, third workshop of the cross-language evaluation forum, CLEF 2002, Rome, Italy, September 19-20, 2002. Revised papers. Lecture notes in computer science (LNCS). Vol. 2785:2003;279-290 Springer-Verlag, Germany.
2. Agosti, M., Bacchin, M., & Melucci, M. (1999). Report on the construction of an Italian test collection. In Joint ACM digital library/SIGIR workshop on multilingual information discovery and AccesS (MIDAS), Berkeley, CA, August 1999. Position paper. Available: http://www.clis2.umd.edu/conferences/ midas/papers/agosti.html. Last visit on May 5, 2004.
3. Bacchin M., Ferro N., Melucci M. The effectiveness of a graph-based algorithm for stemming. Lim E.P., Foo S., Khoo C.S.G., Chen H., Fox E.A., Urs S.R., Thanos C. Digital libraries: People, knowledge, and technology. Proceedings of 5th international conference on Asian digital libraries (ICADL 2002), Singapore, December 11-14, 2002. Lecture notes in computer science (LNCS). Vol. 2555:2002;117-128 Springer-Verlag, Germany.
4. Braschler M., Ripplinger B. Stemming and decompounding for German text retrieval. Sebastiani F. Proceedings of the European conference on information retrieval research (ECIR), Pisa, Italy, April 14-16, 2003. Lecture notes in computer science (LNCS). Vol. 2633:2003;177-192 Springer-Verlag, Germany.
5. Buckley, C. (2003). The trec_eval evaluation package. Available: ftp://ftp.cs.cornell.edu/pub/smart/, 2003. Visited on May 2003. Last visit on May 5, 2004.
6. Di Nunzio G., Ferro N., Melucci M., Orio N. Experiments to evaluate probabilistic models for automatic stemmer generation and query word translation. Peters C., Braschler M., Gonzalo J., Kluck M. Evaluation of cross-language information retrieval systems, fourth workshop of the cross-language evaluation forum, CLEF 2003, Trondheim, Norway, August 21-22, 2003. Revised papers. Lecture Notes in Computer Science (LNCS). 2003;Springer-Verlag, Germany. (in print).
7. Frakes W.B. Stemming algorithms. Frakes W.B., Baeza-Yates R. Information retrieval: Data structures and algorithms. 1992;Prentice-Hall, Englewood Cliffs, NJ.
8. Frakes W.B., Baeza-Yates R. Information retrieval: Data structures and algorithms. 1992;Prentice-Hall, Englewood Cliffs, NJ.
9. Goldsmith J. Unsupervised learning of the morphology of a natural language. Computational Linguistics. 27(2):2001;154-198.
10. Hafer M., Weiss S. Word segmentation by letter successor varieties. Information Storage and Retrieval. 10:1974;371-385.
11. Harman D. How effective is suffixing? Journal of the American Society for Information Science. 42(1):1991;7-15.
12. Hull D.A. Using statistical testing in the evaluation of retrieval experiments. Proceedings of the ACM international conference on research and development in information retrieval (SIGIR). 1993;329-338 ACM Press, Pittsburgh, PA, USA.
13. Krovetz R. Viewing morphology as an inference process. Artificial Intelligence. 118:2000;277-294.
14. Lovins J. Development of a stemming algorithm. Mechanical Translation and Computational Linguistics. 11:1968;22-31.
15. Lucene Web Site (2003). Available: http://jakarta.apache.org/lucene/docs/ index.html. Last visit on May 5, 2004.
16. Paice C.D. Another stemmer. ACM SIGIR Forum. 24(3):1990;56-61.
17. Peters C., Braschler M. Cross-language system evaluation: The CLEF campaigns. Journal of the American Society for Information Science and Technology. 52(12):2001;1067-1072.
18. Popovic M., Willett P. The effectiveness of stemming for natural language access to Slovene textual data. Journal of the American Society for Information Science. 43(5):1992;384-390.
19. Porter M.F. An algorithm for suffix stripping. Program. 14(3):1980;130-137. Reprinted in K. Sparck Jones, P. Willet, Readings in information retrieval, Morgan Kaufmann, 1997.
20. Porter M.F. An algorithm for suffix stripping. Program. 14(3):1980;130-137. Reprinted in K. Sparck Jones, P. Willet, Readings in information retrieval, Morgan Kaufmann, 1997.
21. Salton G., Buckley C. Term weighting approaches in automatic text retrieval. Information Processing & Management. 24(5):1988;513-523.
22. Salton G., McGill M.J. Introduction to modern information retrieval. 1983;McGraw-Hill, New York, NY.
23. Sheskin G.J. Handbook of parametric and nonparametric statistical procedures. 1997;CRC Press, Boca Raton, Florida.
24. Snowball Web Site (2003). Available: http://www.snowball.tartarus.org/. Last visit on May 5, 2004.
25. Voorhees E., Harman D. Overview of the sixth text retrieval conference (TREC-6). Information Processing & Management. 36(1):2000;335. Special issue on the sixth text retrieval conference (TREC-6).