Omni font OCR error correction with effect on retrieval

Proceedings of the 2010 10th International Conference on Intelligent Systems Design and Applications, ISDA'10

Volumn , Issue , 2010, Pages 415-420

  Magdy, Walid ^a   Darwish, Kareem ^b  

^a TRINITY COLLEGE DUBLIN   (Ireland)

^b MICROSOFT RESEARCH   (United States)

Author keywords

Arabic text; Error correction; Information retrieval; Language modeling; OCR

Indexed keywords

ARABIC TEXTS; CHARACTER LEVEL; CHARACTER MODELS; CORRECTION TECHNIQUES; EDIT DISTANCE; ERROR MODEL; LANGUAGE MODEL; LANGUAGE MODELING; OCR; PRINTED DOCUMENTS; PRINTED MATERIALS; RETRIEVAL EFFECTIVENESS; TEMPORAL COVERAGE;

COMPUTATIONAL LINGUISTICS; COPYING; ERRORS; INTELLIGENT SYSTEMS; NATURAL LANGUAGE PROCESSING SYSTEMS; OPTICAL CHARACTER RECOGNITION; SYSTEMS ANALYSIS;

INFORMATION RETRIEVAL;

EID: 79851475788     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISDA.2010.5687228     Document Type: Conference Paper

References (32)

1. Abdul-Jaleel, N., Allan, J., Croft, W.B., Diaz, F., Larkey, L., Li, X., Metzler, D., Strohman, T., Turtle, H., and Wade, C. UMass at TREC 2004: Notebook. Text REtrieval Conference. (TREC 2004), page 657.
2. Abu-Salem, H., M. Al-Omari, and M. Evens. Stemming Methodologies Over Individual Query Words for Arabic Information Retrieval. JASIS, 50(6) (1999) 524-529.
3. Agirre, E., K. Gojenola, K. Sarasola, and A. Voutilainen. Towards a Single Proposal in Spelling Correction. In COLING-ACL'98 (1998).
4. Ahmed, M. A Large-Scale Computational Processor of Arabic Morphology and Applications. MSc. Thesis, in Faculty of Engineering Cairo University: Cairo, Egypt. (2000).
5. Andreas Stolcke. SRILM - An Extensible Lamguage Modeling Toolkit. Proceedings of the Workshop SMT. (2002)
6. Al-Kharashi, I. and M Evens. Comparing Words, Stems, and Roots as Index Terms in an Arabic Information Retrieval System. JASIS 45(8) (1994) 548-560.
7. Baeza-Yates, R. and G. Navarro. A Faster Algorithm for Approximate String Matching. In Combinatorial Pattern Matching (CPM'96), Springer-Verlag LNCS (1996).
8. Brill, E. and R. Moore. An improved error model for noisy channel spelling correction. In the proceedings ACL 2000. (2000).
9. Church, K. and W. Gale. "Probability Scoringfor Spelling Correction." Statistics and Computing, 1: 93-103 (1991).
10. Darwish, K. and D. Oard. Term Selection for Searching Printed Arabic. In SIGIR-2002 (2002).
11. Darwish, K. and D. Oard. CLIR Experiments at Maryland for TREC 2002: Evidence Combination for Arabic-English Retrieval. In TREC-2002, Gaithersburg, MD (2002).
12. De Roeck, A. and W. Al-Fares. A Morphologically Sensitive Clustering Algorithm for Identifying Arabic Roots. In the 38th Annual Meeting of the ACL, Hong Kong, (2000).
13. Domeij, R., J. Hollman, V. Kann. Detection of spelling errors in Swedish not using a word list en clair. Journal of Quantitative Linguistics (1994) 195-201.
14. Fraser, A., J. Xu, and R. Weischedel. TREC 2002 Cross-lingual Retrieval at BBN. In TREC-2002. Gaithersburg, MD (2002).
15. Gey, F. and D. Oard. The TREC-2001 Cross-Language Information Retrieval Track: Searching Arabic Using English, French or Arabic Queries. In TREC-2001, Gaithersburg, MD (2001).
16. Harding, S., W. Croft, and C. Weir. Probabilistic Retrieval of OCR-degraded Text Using N-Grams. In ECDL'97 (1997).
17. Hong, T. Degraded Text Recognition Using Visual and Linguistic Context. Ph.D. Thesis, Computer Science Department, SUNY Buffalo (1995).
18. Jurafsky, D. and J. Martin. Speech and Language Processing. Chapter 5: pages 141-163. Prentice Hall (2000).
19. Larkey, L., L. Ballesteros, and M. Connell. Improving stemming for Arabic information retrieval: light stemming and cooccurrence analysis. In proceedings SIGIR'02. (2002).
20. Lu, Z., I. Bazzi, A. Kornai, J. Makhoul, P. Natarajan, and R. Schwartz. A Robust, Language-Independent OCR System. In the 27th AIPR Workshop: Advances in Computer Assisted Recognition, SPIE (1999).
21. Magdy, W. and K. Darwish. Arabic OCR Error Correction Using Character Segment Correction, Language Modeling, and Shallow Morphology. In EMNLP 2006, pages 408 - 414 (2006)
22. Magdy, W. and K. Darwish. Arabic. Word-Based Correction for Retrieval of Arabic OCR Degraded Documents. In SPIRE (2006)
23. Mayfield, J., P. McNamee, C. Costello, C. Piatko, and A. Banerjee. JHU/APL at TREC 2001: Experiments in Filtering and in Arabic, Video, and Web Retrieval. In TREC-2001. Gaithersburg, MD (2001).
24. McNamee, P., C. Piatko, and J. Mayfield. JHU/APL at TREC 2002: Experiments in Filtering and Arabic Retrieval. In TREC-2002, Gaithersburg, MD (2002).
25. Moussa B., M. Maamouri, H. Jin, A. Bies, X. Ma. Arabic Treebank: Part 1 - 10Kword English Translation. LDC (2003).
26. Oard, D. and F. Gey. The TREC 2002 Arabic/English CLIR Track. In TREC-2002, Gaithersburg, MD (2002).
27. Oflazer, K. Error-Tolerant Finite State Recognition with Applications to Morphological Analysis and Spelling Correction. Computational Linguistics 22(1), 73-90 (1996).
28. Sanderson, M. and J. Zobel. Information Retrieval System Evaluation: Effort, Sensitivity, and Reliability. In SIGIR'05, (2005).
29. Taghva, K., J. Borsack, and A. Condit. An Expert System for Automatically Correcting OCR Output. In SPIE - Document Recognition (1994).
30. Tillenius, M., Efficient generation and ranking of spelling error corrections. NADA (1996).
31. Tseng, Y. and D. Oard. Document Image Retrieval Techniques for Chinese. In Symposium on Document Image Understanding Technology, Columbia, MD (2001).
32. Bilmes J. A. and K. Kirchhoff. Factored Language Models and Generalized Parallel Backoff. In HLT 2003