Error correction vs. query garbling for Arabic OCR document retrieval

ACM Transactions on Information Systems

Volumn 26, Issue 1, 2007, Pages

  Darwish, Kareem ^a,b   Magdy, Walid ^a,b  

^a IBM Center for Advanced Studies in Cairo   (Egypt)

^b MICROSOFT   (United States)

Author keywords

Arabic retrieval; OCR correction; OCR retrieval

Indexed keywords

ARABIC DOCUMENTS; ARABIC RETRIEVAL; OCR CORRECTION; OCR RETRIEVAL;

DATA MINING; ERROR CORRECTION; INDEXING (OF INFORMATION); NATURAL LANGUAGE PROCESSING SYSTEMS; OPTICAL CHARACTER RECOGNITION; QUERY PROCESSING;

INFORMATION RETRIEVAL;

EID: 37049013904     PISSN: 10468188     EISSN: 15582868     Source Type: Journal    
DOI: 10.1145/1292591.1292596     Document Type: Article

References (36)

1. ABDUL-JALEEL, N., ALLAN, J., CROFT, W. B., DIAZ, F., LARKEY, L., LI, X., METZLER, D., STROHMAN, T., TURTLE, H., AND WADE, C. 2004. Umass At Trec 2004: Notebook. Text Retrieval Conference. (TREC 04) Gaithersburg, MD. Nov, National Institutes of Standards and Technology Publications, 657.
2. ABU-SALEM, H., AL-OMARI, M., AND EVENS, M. 1999. Stemming methodologies over individual query words for Arabic information Retrieval. J. Amer. Soc. Inform. Sci., 50, 6, 524-529.
3. AGIRRE, E., GOJENOLA, K., SARASOLA, K., AND VOUTILAINEN, A. 1998. Towards a single proposal in spelling correction. In Proceedings of COLING-ACL'98. San Francisco, CA, 22-28.
4. AHMED, M. 2000. A large-scale computational processor of Arabic morphology and applications. MSc. thesis, Cairo University-Cairo, Egypt.
5. AL-KHARASHI, I. AND EVENS, M. 1994. Comparing words, stems, and roots as index terms in an Arabic information Retrieval system. J. Amer. Soc. Inform. Sci. 45, 8, 548-560.
6. BAEZA-YATES, R. AND NAVARRO, G. 1996. A faster algorithm for approximate string matching. In Proceedings of Combinatorial Pattern Matching (CPM'96). Laguna Beach, CA. Lecture Notes in Computer Science, Springer-Verlag, pp. 1-23.
7. BRILL, E. AND MOORE, R. 2000. An improved error model for noisy channel spelling correction. In Proceedings of the 38th Annual Meeting of the Association for Computational Linguistics (ACLOO). Hong Kong, 286-293.
8. CALLAN, P., LU, Z. AND CROFT, B. 1995. Searching distributed collections with inference networks. In Proceedings of the 18th Annual International ACM SIGIR Conference on Research and development in Information Retrieval (SIGIR95). Seattle, WA, 21-28.
9. CHURCH, K. AND GALE, W. 1991. Probability scoring for spelling correction. Statis. Comput., 1, 93-103.
10. DARWISH, K. AND OARD, D. 2002. CLIR experiments at Maryland for TREC 2002: Evidence combination for Arabic-English Retrieval. Text Retrieval Conference (TREC'02). Gaithersburg, MD.
11. DARWISH, K. AND OARD, D. 2003. Probabilistic structured query methods. In Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'03). Toronto, Canada. 338-344.
12. DARWISH, K. AND OARD, D. 2002b. Term selection for searching printed Arabic. In Proceedings of the 25th annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'02) Tampere, Finland. 261-268.
13. DE ROECK, A. AND AL-FARES, W. 2000. A morphologically sensitive clustering algorithm for identifying Arabic roots. The 38th Annual Meeting of the ACL. Hong Kong, 199-206.
14. DOERMAN, D. 1997. The Retrieval of document images: a brief survey. In Proceedings of the 4th International Conference on Document Analysis and Recognition (ICDAR'97). Ulm, Germany, 945-949
15. DOMEIJ, R., HOLLMAN, J., AND KANN, V. 1994. Detection of spelling errors in Swedish not using a word list en clair. J. Quant. Linguist., 195-201.
16. FRASER, A., XU, J. AND WEISCHEDEL, R. 2002. TREC 2002 cross-lingual Retrieval at BBN. Text Retrieval Conference (TREC'02). Gaithersburg.
17. GEY, F. AND OARD, D. 2001. The TREC-2001 Cross-language information retrieval track: Searching Arabic using English, French or Arabic queries. Text Retrieval Conference (TREC'01). Gaithersburg, MD.
18. HARDING, S., CROFT, B. AND WEIR, C. 1997. Probabilistic Retrieval of OCR-degraded text using n-grams. In European Conference on Digital Libraries. Pisa, Italy. 345-359.
19. HONG, T. 1995. Degraded text recognition using visual and linguistic context. Ph.D. thesis, Computer Science Department, SUNY Buffalo, Buffalo, NY
20. JURAFSKY, D. AND MARTIN, J. 2000. Speech and Language Processing. Prentice Hall.
21. KANTOR, R AND VOORHEES, E. 1996. Report on the TREC-5 confusion track. Text Retrieval Conference (TREC'5). Gaithersburg, MD, 65-74.
22. LARREY, L., ALLEN, J. CONNELL, M. E., BOLIVAR, A., AND WADE, C. 2002. UMass at TREC 2002: Cross Language and novelty tracks. Text Retrieval Conference (TREC'02). Gaithersburg, MD.
23. LU, Z., BAZZI, I., KORNAI, A., MAKHOUL, J., NATARAJAN, R AND SCHWARTZ, R. 1999. Arobust, language-independent OCR system. In the 27th AIPR Workshop: Advances in Computer Assisted Recognition, SPIE, Vol. 3584.
24. MAGDY, W. AND DARWISH, K. 2006. Arabic OCR error correction using character segment correction, language modeling, and shallow morphology. Empirical Methods in Natural Language Processing (EMNLP'06). Sydney, Australia, 408-414.
25. MAGDY, W AND DARWISH, K. 2006b. Arabic word-based correction for Retrieval of Arabic OCR degraded documents. Symposium on String Processing and Information Retrieval (SPIRE'06). University of Strathclyde, UK.
26. MANNING, C. AND SCHUETZE, H. 1999. Foundations of statistical natural language processing. MIT Press.
27. MAYFIELD, J., MCNAMEE, P., COSTELLO, C., PIATKO, C., AND BANERJEE, A. 2001. JHU/APL at TREC 2001: Experiments in filtering and in Arabic, video, and Web retrieval. Text Retrieval Conference (TREC'01). Gaithersburg, MD.
28. MCNAMEE, P., PIATKO, C., AND MAYFIELD, J. 2002. JHU/APL at TREC 2002: Experiments in filtering and Arabic Retrieval. Text Retrieval Conference (TREC'02). Gaithersburg, MD.
29. MOUSSA B., MAAMOURI, M. JIN, H., BIES, A., AND MA, X. 2003. Arabic Treebank: Part 1 - 10K word English translation. Linguistic Data Consortium.
30. OARD, D. W. AND ERTUNC, F. 2002. Translation-based indexing for cross-language Retrieval. In Proceedings of the 24th European Colloquim in Information Retrieval (ECIR 2002). Glasgow, UK, 324-333.
31. OARD, D. AND GEY, F. 2002. The TREC 2002 Arabic/English CLIR Track. Text Retrieval Conference (TREC'02). Gaithersburg, MD.
32. OFLAZER, K. 1996. Error-tolerant finite state recognition with applications to morphological analysis and spelling correction. Comput. Linguis., 22, 1, 73-90.
33. SANDERSON, M. AND ZOBEL, J. 2005. Information Retrieval system evaluation: effort, sensitivity, and reliability. In Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'05). (Salvador, Brazil, August 15-19, 2005), pp. 162-169.
34. TAGHVA, K., BORSACK, J., AND CONDIT, A. 1994. An expert system for automatically correcting OCR output. In Proceedings of the International Symposium on Electronic Imaging Science and Technology (ISEI/SPIE). San Jose, CA, 270-278.
35. TILLENIUS, M. 1996. Efficient generation and ranking of spelling error corrections. NADA tech. report TRITA-NA-E9621.
36. TSENG, Y. AND OARD, D. 2001. Document image Retrieval techniques for Chinese. In Symposium on Document Image Understanding Technology (SDIUT). Columbia, MD. 151-158.