Unsupervised profiling of OCRed historical documents

Pattern Recognition

Volumn 46, Issue 5, 2013, Pages 1346-1357

  Reffle, Ulrich ^a   Ringlstetter, Christoph ^a  

^a UNIVERSITY OF MUNICH   (Germany)

Author keywords

Error detection and error correction; OCR postprocessing; Processing of historical documents; Statistical learning

Indexed keywords

EVALUATION RESULTS; GLOBAL INFORMATIONS; HISTORICAL DOCUMENTS; LANGUAGE VARIATION; OCR ENGINES; RECOGNITION ERROR; REFINED MODEL; STATISTICAL LEARNING; STRONG CORRELATION; TWO-CHANNEL; TYPICAL PATTERNS; VARIATION PATTERN; WORD FREQUENCIES;

DIGITAL LIBRARIES; ERROR CORRECTION; ERROR DETECTION; OPTICAL CHARACTER RECOGNITION; SEARCH ENGINES;

HISTORY;

EID: 84872490626     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2012.10.002     Document Type: Article

References (27)

1. G. Inc., Google books, 〈 http://books.google.com/ 〉.
2. R. Holley, How good can it get?, D-Lib Magazine 15(3/4).
3. T.L. Packer, Performing information extraction to improve OCR error detection in semi-structured historical documents, in: Proceedings of the 2011 Workshop on Historical Document Imaging and Processing (HIP '11), Beijing, China, 2011, pp. 67-74.
4. A. Fischer, V. Frinken, A. Fornes, H. Bunke, Transcription alignment of Latin manuscripts using hidden Markov models, in: Proceedings of the 2011 Workshop on Historical Document Imaging and Processing (HIP '11), Beijing, China, 2011, pp. 29-36.
5. H. Balk, A. Conteh, IMPACT: centre of competence in text digitisation, in: Proceedings of the 2011 Workshop on Historical Document Imaging and Processing (HIP '11), Beijing, China, 2011, pp. 155-160.
6. A. Gotscharek, U. Reffle, C. Ringlstetter, K. U. Schulz, On lexical resources for digitization of historical documents, in: DocEng '09: Proceedings of the Ninth ACM symposium on Document engineering, ACM, New York, NY, USA, 2009, pp. 193-200.
7. R. Smith, Limits on the application of frequency-based language models to ocr, in: ICDAR, IEEE, 2011, pp. 538-542.
8. P. Yang, A. Antonacopoulos, C. Clausner, S. Pletschacher, Grid-based modelling and correction of arbitrarily warped historical document images for large-scale digitisation, in: Proceedings of the 2011 Workshop on Historical Document Imaging and Processing, HIP '11, ACM, New York, NY, USA, 2011, pp. 106-111.
9. A. Gotscharek, U. Reffle, C. Ringlstetter, K. Schulz, and A. Neumann Towards information retrieval on historical document collections the role of matching procedures and special lexica International Journal of Document Analysis and Recognition 2011 1 13
10. K. Taghva, T. Nartker, J. Borsack, Information access in the presence of ocr errors, in: Proceedings of the First ACM Workshop on Hardcopy Document Processing, HDP '04, ACM, New York, NY, USA, 2004, pp. 1-8.
11. A.C. Popat, A panlingual anomalous text detector, in: Proceedings of the Ninth ACM Symposium on Document Engineering, DocEng '09, ACM, New York, NY, USA, 2009, pp. 201-204.
12. U. Reffle Efficiently generating correction suggestions for garbled tokens of historical language Natural Language Engineering 17 2011 265 282
13. C.E. Shannon A mathematical theory of communication The Bell System Technical Journal 27 1948 379 423
14. R. Wagner, M. Fisher, The string-to-string correction problem, Journal of the ACM 21 (1) (1974) 168-173
15. F. Weigel, S. Baumann, J. Rohrschneider, Lexical postprocessing by heuristic search and automatic determination of the edit costs, in: Proceedings of the Third International Conference on Document Analysis and Recognition (ICDAR 95), 1995, pp. 857-860.
16. E.S. Ristad, P.N. Yianilos, Learning string edit distance, in: Proceedings of the 14th International Conference on Machine Learning, Morgan Kaufmann, 1997, pp. 287-295.
17. E. Brill, R.C. Moore, An improved error model for noisy channel spelling correction, in: ACL '00: Proceedings of the 38th Annual Meeting on Association for Computational Linguistics, Association for Computational Linguistics, Morristown, NJ, USA, 2000, pp. 286-293.
18. O. Kolak, W. Byrne, P. Resnik, A generative probabilistic ocr model for nlp applications, in: Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology, vol. 1, NAACL '03, Association for Computational Linguistics, Stroudsburg, PA, USA, 2003, pp. 55-62.
19. K.W. Church, and W.A. Gale Probability scoring for spelling correction Statistics and Computing 1 1991 93 103
20. L.-M. Liu, Y.M. Babad, W. Sun, K.-K. Chan, Adaptive post-processing of ocr text via knowledge acquisition, in: Proceedings of the 19th annual conference on Computer Science, CSC '91, ACM, New York, NY, USA, 1991, pp. 558-569.
21. S.V. Rice, G. Nagy, and T.A. Nartker Optical Character Recognition An Illustrated Guide to the Frontier 1999 Kluwer Academic Publishers
22. X. Tong, D.A. Evans, A statistical approach to automatic OCR error correction in context, in: Proceedings of the Fourth Workshop on Very Large Corpora, Copenhagen, Denmark, 1996, pp. 88-100.
23. C. Ringlstetter, U. Reffle, A. Gotscharek, K.U. Schulz, Deriving symbol dependent edit weights for text correction - the use of error dictionaries, in: ICDAR, 2007, pp. 639-643.
24. R. Jin, C. Zhai, A.G. Hauptmann, Information retrieval for ocr documents: a content-based probabilistic correction model, in: Document Recognition and Retrieval X Santa Clara, CA, USA, Proceedings, 2003, pp. 128-135.
25. A. Ernst-Gerlach, N. Fuhr, Generating search term variants for text collections with historic spellings, in: Proceedings of the 28th European Conference on Information Retrieval Research (ECIR 2006), Springer, 2006, pp. 1-8.
26. B. Jurish More than words Using token context to improve canonicalization of historical German JLCL 25 1 2010 23 39
27. K.U. Schulz, and S. Mihov Fast string correction with Levenshtein automata International Journal of Document Analysis and Recognition 5 1 2002 67 85