Stemming Indonesian: A confix-stripping approach

ACM Transactions on Asian Language Information Processing

Volumn 6, Issue 4, 2007, Pages

  Adriani, Mirna ^a   Asian, Jelita ^b   Nazief, Bobby ^a   Tahaghoghi, S M M ^b   Williams, Hugh E ^c  

^a UNIVERSITY OF INDONESIA   (Indonesia)

^b RMIT UNIVERSITY   (Australia)

^c MICROSOFT   (United States)

Author keywords

Indonesian; Information retrieval; Stemming

Indexed keywords

ALGORITHMS; INFORMATION RETRIEVAL SYSTEMS; TEXT PROCESSING; TRANSLATION (LANGUAGES); WORD PROCESSING;

CONFIX-STRIPPING APPROACH; MORPHOLOGICAL ROOTS; STEMMING INDONESIAN;

FORMAL LANGUAGES;

EID: 38149091838     PISSN: 15300226     EISSN: 15583430     Source Type: Journal    
DOI: 10.1145/1316457.1316459     Document Type: Article

References (53)

1. AHMAD, F., YUSOFF, M., AND SEMBOK, T. M. T. 1996. Experiments with a stemming algorithm for Malay words. J. Amer. Soc. Inform. Sci. 47, 12, 909-918.
2. ARIFIN, A. Z. AND SETIONO, A. N. 2002. Classification of event news documents in Indonesian language using single pass clustering algorithm. In Proceedings of the Seminar on Intelligent Technology and its Applications (SITIA). Teknik Elektro, Sepuluh Nopember Institute of Technology.
3. ASIAN, J., WILLIAMS, H., AND TAHAGHOGHI, S. 2005. Stemming Indonesian. In Proceedings of the 28th Australasian Computer Science Conference (ACSC'06). V. Estivill-Castro, Ed. Australian Computer Society, Inc., 307-314.
4. ASIAN, J., WILLIAMS, H. E., AND TAHAGHOGHI, S. 2004. A testbed for Indonesian text retrieval. In Proceedings of the 9th Australasian Document Computing Symposium (ADCS'04). P. Bruza, A. Moffat, and A. Turpin, Eds. University of Melbourne, Department of Computer Science, Melbourne, Australia, 55-58.
5. BAKAR, Z. A. AND RAHMAN, N. A. 2003. Evaluating the effectiveness of thesaurus and stemming methods in retrieving Malay translated Al-Quran documents. In Digital Libraries: Technology and Management of Indigenous Knowledge for Global Access, T. M. T. Sembok, H. B. Zaman, H. Chen, S.R.Urs, and S. Myaeng, Eds. Lecture Notes in Computer Science, vol. 2911. Springer-Verlag, 653-662.
6. BAKAR, Z. A., SEMBOK, T. M. T., AND YUSOFF, M. 2000. An evaluation of retrieval effectiveness using spelling-correction and string-similarity matching methods on Malay texts. J. Amer. Soc. Inform. Sci. Technol. 51, 8, 691-706.
7. BALLESTEROS, L. AND CROFT, W. B. 1997. Phrasal translation and query expansion techniques for cross-language information retrieval. In Proceedings of the ACM-SIGIR International Conference on Research and Development in Information Retrieval. ACM, 84-91.
8. CICC.1994. Research on Indonesian dictionary. Tech. rep. 6-CICC-MT53, Center of the International Cooperation for Computerization, Tokyo, Japan.
9. CURRAN, J. R. AND CLARK, S. 2003. Language independent NER using a maximum entropy tagger. In Proceedings of Conference on Natural Language Learning. W. Daelemans and M. Osborne, Eds. Association for Computational Linguistics, Edmonton, Canada, 164-167.
10. DEWAN BAHASA DAN PUSTAKA. 1991. Kamus Dewan (Council Dictionary). Dewan Bahasa dan Pustaka, Kuala Lumpur, Malaysia.
11. DWIPAYANA, G. 2001. Sari Kata Bahasa Indonesia (The Essence of Indonesian). Terbit Terang, Surabaya, Indonesia.
12. FAHMI, I. 2004. Personal communication.
13. FRAKES, W. 1992. Stemming algorithms. In Information Retrieval: Data Structures and Algorithms, W. Frakes and R. Baeza-Yates, Eds. Prentice-Hall, Englewood Cliffs, NJ, Chapter 8, 131-160.
14. GAUSTAD, T. AND BOUMA, G. 2002. Accurate stemming of Dutch for text classification. Lang. Comput 45, 1, 104-117.
15. HALL, P. A. V. AND DOWLING, G. R. 1980. Approximate string matching. Comput. Surv. 12, 4, 381-402.
16. HARMAN, D. 1992. Overview of the First TREC conference (TREC-1). In Proceedings of the Text Retrieval Conference (TREC). NIST Special Publication 500-207, 1-20.
17. HOLLINK, V., KAMPS, J., MONZ, C., AND DE RIJKE, M. 2004. Monolingual document retrieval for European languages. Inform. Retrieval 7, 1-2, 33-52.
18. HULL, D. A. 1996. Stemming algorithms: A case study for detailed evaluation. J. Amer. Soc. Inform. Sci. 47, 1, 70-84.
19. IDRIS, N. 2001. Automated essay grading system using nearest neighbour technique in information retrieval. M.S. thesis, University of Malaya.
20. JONES, K. S., WALKER, S., AND ROBERTSON, S. E. 2000. A probabilistic model of information retrieval: Development and comparative experiments. Inf. Process. Manag. 36, 6, 779-808.
21. KROVETZ, R. 1993. Viewing morphology as an inference process. In Proceedings of the ACM- SIGIR International Conference on Research and Development in Information Retrieval. R. Korfhage, E. Rasmussen, and P. Willett, Eds. ACM, 191-202.
22. LARKEY, L. S., BALLESTEROS, L., AND CONNELL, M. E. 2002. Improving stemming for Arabic information retrieval: Light stemming and co-occurrence analysis. In Proceedings of the ACM-SIGIR International Conference on Research and Development in Information Retrieval. M. Beaulieu, R. Baeza-Yates, S. H. Myaeng, and K. Järvelin, Eds. ACM, 275-282.
23. LIBERMAN, M. AND CIERI, C. 1998. The creation, distribution and use of linguistic data. In Proceedings of the First International Conference on Language Resources and Evaluation. European Language Resources Association, Granada, Spain.
24. LOVINS, J. 1968. Development of a stemming algorithm. Mechanical Transia. Computa. 11, 22-31.
25. MCNAMEE, P. AND MAYFIELD, J. 2004. Character n-gram tokenization for European language text retrieval. Inform. Retrieval 7, 1-2, 7397.
26. MOELIONO, A. M. AND DARDJOWIDJOJO, S. 1988. Tata Bahasa Baku Bahasa Indonesia (The Standard Indonesian Grammar). Departemen Pendidikan dan Kebudayaan, Republik Indonesia, Jakarta, Indonesia.
27. NAZIEF, B. A. A. AND ADRIANI, M. 1996. Confix-stripping: Approach to stemming algorithm for Bahasa Indonesia. Internal publication, Faculty of Computer Science, Univ. of Indonesia, Depok, Jakarta.
28. NG, C., WILKINSON, R., AND ZOBEL, J. 2000. Experiments in spoken document retrieval using phonetic n-grams. Speech Comm (Special issue on Accessing Information in Spoken Audio). 32, 12 61-77.
29. ORǍSAN, C., PEKAR, V., AND HASLER, L. 2004. A comparison of summarisation methods based on term specificity estimation. In Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC'04). European Language Resources Association, 1037-1041.
30. OTHMAN, A. 1993. Pengantar perkataan Melayu untuk sistem capaian dokumen (introduction to Melayu words for document retrieval system). M.S. thesis, University Kebangsaan Malaysia.
31. PAICE, C. D. 1996. Method for evaluation of stemming algorithms based on error counting. J. Amer. Soc. Inform. Sci. 47, 8, 632-649.
32. PAYNE, T. E. 1997. Describing Morphosyntax: A Guide for Field Linguists. Cambridge University Press, Cambridge, UK.
33. POPOVIČ, M. AND WILLETT, P. 1992. The effectiveness of stemming for natural-language access to Slovene textual data. J. Amer. Soc. Inform. Sci. 43, 5, 384-390.
34. PORTER, M. 1980. An algorithm for suffix stripping. Program 13, 3, 130-137.
35. QUINN, G. 2001. The Learner's Dictionary of Today's Indonesian. Allen & Unwin, St. Leonards, Australia.
36. SANDERSON, M. AND ZOBEL, J. 2005. Information retrieval system evaluation: effort, sensitivity, and reliability. In Proceedings of the ACM-SIGIR International Conference on Research and Development in Information Retrieval. G. Marchionini, A. Moffat, J. Tait, R. Baeza-Yates, and N. Ziviani, Eds. ACM, 162-169.
37. SAVOY, J. 1993. Stemming of French words based on grammatical categories. J. Amer. Soc. Inform. Sci. 44, 1 (January), 1-9.
38. SAVOY, J. 1999. A stemming procedure and stopword list for general French corpora. J. Amer. Soc. Inform. Sci. 50, 10, 944-952.
39. SHESKIN, D. 1997. Handbook of Parametric and Nonparametric Statistical Proceedures. CRC Press LLC, Boca Raton, FL.
40. SNEDDON, J. N. 1996. Indonesian: A Comprehensive Grammar. Routledge, London, UK.
41. TALA, F. 2003. A study of stemming effects on information retrieval in Bahasa Indonesia. M.S. thesis, University of Amsterdam.
42. THOMPSON, P. AND DOZIER, C. 1997. Name searching and information retrieval. In Proceedings of Second Conference on Empirical Methods on Natural Language Processing. C. Cardie and R. Weischedel, Eds. Association for Computational Linguistics, 134-140.
43. UKKONEN, E. 1992. Approximate string-matching with q-grams and maximal matches. Theor. Comput. Sci. 92, 1, 191-211.
44. VEGA, V. B. 2001. Information retrieval for the Indonesian language. M.S. thesis, National University of Singapore.
45. VOORHEES, E. AND HARMAN, D. 1999. Overview of the 8th Text REtrieval Conference (TREC-8). In Proceedings of the Text Retrieval Conference (TREC). E. Voorhees and D. Harman, Eds. TREC, NIST Special Publication 500-246, 1-23.
46. VOORHEES, E. M. AND HARMAN, D. 2000. Overview of the 9th TREC conference (TREC-9). In Proceedings of the Text Retrieval Conference (TREC). E. Voorhees and D. Harman, Eds. NIST Special Publication 500-249, 1-14.
47. WIDYAMARTAYA, A. 2003. Seni Menerjemahkan, 13th Ed. Kanisius, Yogyakarta, Indonesia.
48. WILLIAMS, H. AND ZOBEL, J. 2005. Searchable words on the Web. Int. J. Digit. Libr. 5, 2, 99-105.
49. WILUJENG, A. 2002. Inti Sari Kata Bahasa Indonesia Lengkap. Serba Jaya, Surabaya, Indonesia.
50. WOODS, P., RINI, K. S., AND MEINHOLD, M. 1995. Indonesian Phrasebook 3rd Ed. Lonely Planet Publications, Hawthorn, Australia.
51. XU, J. AND CROFT, W. B. 1998. Corpus-based stemming using cooccurrence of word variants. ACM Trans. Inform. Syst. 16, 1, 61-81.
52. ZOBEL, J. 1998. How reliable are the results of large-scale information retrieval experiments? In Proceedings of the ACM-SIGIR International Conference on Research and Development in Information Retrieval. W. B. Croft, A. Moffat, C. J. van Rijsbergen, R. Wilkinson, and J. Zobel, Eds. ACM, 307-314.
53. ZOBEL, J. AND DART, P. 1996. Phonetic string matching: Lessons from information retrieval. In Proceedings of the ACM-SIGIR International Conference on Research and Development in Information Retrieval. H. P. Frei, D. Harman, P. Schauble, and R. Wilkinson, Eds. ACM, 166-173.