How effective is stemming and decompounding for German text retrieval?

Information Retrieval

Volumn 7, Issue 3-4, 2004, Pages 291-316

  Braschler, Martin ^a,b   Ripplinger, Bärbel ^a  

^a Eurospider Information Technology AG   (Switzerland)

^b UNIVERSITY OF NEUCHÂTEL   (Switzerland)

Author keywords

Decompounding; Evaluation; German; Morphological analysis; Stemming

Indexed keywords

EID: 3843075252     PISSN: 13864564     EISSN: None     Source Type: Journal    
DOI: 10.1023/b:inrt.0000011208.60754.a1     Document Type: Conference Paper

References (31)

1. Blustein J (1998) IR STAT PAK. URL: http://www.csd.uwo.ca/~jamie/IRSP- overview.html (last visit 11/19/2002).
2. Braschler M and Schäuble P (2001) Experiments with the Eurospider retrieval system for CLEF 2000. In: Peters C, Ed., Cross-Language Information Retrieval and Evaluation, Workshop of the Cross-Language Evaluation Forum, CLEF 2000, pp. 140-148.
3. Choueka Y (1992) Responsa: An operational full-text retrieval system with linguistic components for large corpora. In: Computational Lexicology and Lexicography: A Volume in Honor of B. Quemada.
4. Frakes WB (1992) Stemming Algorithms. In: Frakes WB and Baeza-Yates R, Eds., Information Retrieval, Data Structures & Algorithms. Prentice Hall, Eaglewood Cliffs, NJ, USA, pp. 131-160.
5. Frisch E and Kluck M (1997) Pretest zum Projekt German Indexing and Retrieval Testdatabase (GIRT) unter Anwendung der Retrievalsysteme Messenger und free WAISsf. IZ Arbeitsbericht Nr. 10, GESIS IZ Soz., Bonn, Germany (in German).
6. Goldsmith J (2001) Unsupervised learning of the morphology of a natural language. Computational Linguistics, 27(2):153-198. MIT Press. Available at: URL: http://humanities.uchicago.edu/faculty/goldsmith/Linguistica2000/(last visit 11/19/2002).
7. Harman D (1991) How effective is suffixing? Journal of the American Society for Information Science, 42(1):7-15.
8. Harman D (1997) The TREC conferences. In: Sparck-Jones K and Willett P, Eds., Readings in Information Retrieval. Morgan Kaufmann Publishers, San Francisco, CA, USA.
9. Hull DA (1996) Stemming algorithms - A case study for detailed evaluation. Journal of the American Society for Information Science, 47(1):70-84.
10. Hull DA (1993) Using statistical testing in the evaluation of retrieval experiments. In: Proceedings of the 16th ACM SIGIR Conference. Pittsburg, USA.
11. Hull DA, Grefenstette G, Schultze BM, Gaussier E, Schütze H and Pedersen O (1996) Xerox TREC-5 site report: Routing, filtering, NLP and Spanish tracks. In: Proceedings of the Fifth Text Retrieval Conference (TREC 5). Gaithersburg, USA.
12. Kraaij W and Pohlmann R (1996) Using linguistic knowledge in information retrieval. OTS Working Paper OTS-WP-CL-96-001, University of Utrecht, The Netherlands.
13. Kraaij W and Pohlmann R (1996) Viewing stemming as recall enhancement. In: Proceedings of the 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. Zurich, Switzerland.
14. Krause J and Womser-Hacker C (1990) Das Deutsche Patent- informationssystem. Entwicklungstendenzen, Retrievaltests und Bewertungen. Carl Heymanns (in German).
15. Lovins JB (1968) Development of a stemming algorithm. Mechanical Translation and Computational Linguistics, 11(1/2):22-31.
16. Maas D (1996) MPRO - Ein System zur Analyse und Synthese deutscher Wörter. In: Hauser R, Ed., Linguistische Verifikation, Max Niemeyer Verlag, Tübingen (in German).
17. Mayfield J, McNamee P and Piatko C (1999) The JHU/APL HAIRCUT system at TREC-8. In: Proceedings of the Eighth Text REtrieval Conference (TREC-8). NIST Special Publication 500-246, pp. 445-451.
18. Monz C and de Rijke M (2002) Shallow morphological analysis in monolingual information retrieval for Dutch, German and Italian. In: Peters C, Braschler M, Gonzalo J, and Kluck M, Eds., Evaluation of Cross-Language Information Retrieval Systems. CLEF 2001, Lecture Notes in Computer Science, LNCS 2406, pp. 262-277.
19. Moulinier I, McCulloh JA and Lund E: West Group at CLEF 2000 (2001) Non-English monolingual retrieval. In: Peters C, Ed., Cross-Language Information Retrieval and Evaluation, Workshop of the Cross-Language Evaluation Forum, CLEF 2000, pp. 253-260.
20. Popovic M and Willet P (1992) The effectiveness of stemming for natural-language access to Slovene textual data. Journal of the American Society for Information Science, 3(5):384-390.
21. Porter MF (1980) An algorithm for suffix stripping. Program, 14(3):130-137. Reprint in: Sparck Jones K and Willett P., Eds., Readings in Information Retrieval, Morgan Kaufmann Publishers, San Francisco, CA, USA, pp. 313-316.
22. Porter MF (1980) An algorithm for suffix stripping. Program, 14(3):130-137. Reprint in: Sparck Jones K and Willett P., Eds., Readings in Information Retrieval, Morgan Kaufmann Publishers, San Francisco, CA, USA, pp. 313-316.
23. Ripplinger B (2002) Linguistic knowledge in cross-language information retrieval. PhD Thesis, Herbert Utz Verlag, Munich, Germany.
24. Savoy J (1999) A stemming procedure and stopword list for general French corpora. Journal of the American Society for Information Science, 50(10):944-952.
25. Savoy J (2003) Cross-language information retrieval: Experiments based on CLEF 2000 Corpora. Information Processing & Management, 39(1):75-115.
26. Singhal A, Buckley C and Mitra M (1996) Pivoted document length normalization. In: Proceedings of the 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. Zurich, Switzerland.
27. Sheridan P and Ballerini JP (1996) Experiments in multilingual information retrieval using the SPIDER system. In: Proceedings of the 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. Zurich, Switzerland.
28. Tague-Sutcliffe J (1997) The pragmatics of information retrieval experimentation, revisited. In: Sparck-Jones K and Willett P, Eds., Readings in Information Retrieval. Morgan Kaufmann Publishers, San Francisco, CA, USA.
29. Tomlinson S (2002) Stemming evaluated in 6 Languages by Hummingbird SearchServer™ at CLEF 2001. In: Peters C, Braschler M, Gonzalo J and Kluck M, Eds., Evaluation of Cross-Language Information Retrieval Systems. CLEF 2001, Lecture Notes in Computer Science, LNCS 2406, pp. 278-287.
30. Wechsler M, Sheridan P and Schäuble P (1997) Multi-language text indexing for internet retrieval. In: Proceedings of the 5th RIAO Conference, Computer-Assisted Information Searching on the Internet, Montreal, Canada, pp. 217-232.
31. Womser-Hacker C (1989) Der PADOK-Retrievaltest. In: "Sprache und Computer" Band 10, Georg Olms Verlag (in German).