An experimental evaluation of OCR text representations for learning document classifiers

International Journal on Document Analysis and Recognition

Volumn 1, Issue 2, 1998, Pages 116-122

  Junker, Markus ^a   Hoch, Rainer ^b  

^a GERMAN RESEARCH CENTER FOR ARTIFICIAL INTELLIGENCE DFKI   (Germany)

^b SAP RESEARCH   (Germany)

Author keywords

Document classification; Feature selection; Learning; N grams; OCR

Indexed keywords

DOCUMENT CLASSIFICATION; EXPERIMENTAL EVALUATION; FEATURE TYPES; LEARNING; MORPHOLOGICAL ANALYSIS; N-GRAMS; SYSTEMATIC EVALUATION; TEXT REPRESENTATION;

COMPUTER VISION; FEATURE EXTRACTION; INFORMATION ANALYSIS; OPTICAL CHARACTER RECOGNITION; SOFTWARE ENGINEERING;

INFORMATION RETRIEVAL SYSTEMS;

EID: 0008372212     PISSN: 14332833     EISSN: 14332825     Source Type: Journal    
DOI: 10.1007/s100320050012     Document Type: Article

References (19)

1. C. Apté, F. Damerau. Automated Learning of Decision Rules for Text Categorization. ACM Transactions on Information Systems, 12(3):233-251, July 1994
2. W.B. Cavnar, J.M. Trenkle. N-Gram-Based Text Categorization. In: Proc. of the 3rd Annual Symposium on Document Analysis and Information Retrieval (SDAIR 94), pp. 161-175, Las Vegas, NV, April 11-13 1994
3. W.W. Cohen, Y. Singer. Context-Sensitive Learning Methods for Text Categorization. In: Proc. of the 19th Annual International ACM/SIGIR Conference on Research and Development in Information Retrieval (SIGIR 96), pp. 307-316, Zurich, Switzerland, August 18-22 1996
4. M. Damashek. Gauging Similarity with N-Grams: Language-Independent Categorization of Text. Science, 267:843-848, February 1995
5. R. Hoch. Using IR Techniques for Text Classification in Document Analysis. In: Proc. of the 17th Annual International ACM/SIGIR Conference on Research and Development in Information Retrieval, pp. 31-40, Dublin, Ireland, July 3-6 1994
6. S. Huffman. Acquaintance: Language-Independent Document Categorization by N-Grams. In: Proc. of the 4th Text REtrieval Conference (TREC-4), Arlington, VA, Nov 1-3 1996
7. M. Iwayama, T. Tokunaga. Cluster-Based Text Categorization: A Comparison of Category Search Strategies. In: Proc. of the 18th Annual International ACM/SIGIR Conference on Research and Development in Information Retrieval (SIGIR 95), pp. 273-280, Seattle, Washington, July 9-13 1995
8. M. Junker, A. Abecker. Exploiting Thesaurus Knowledge in Rule Induction for Text Classification. In: Recent Advances in Natural Language Processing (RANLP 97), pp. 202-207, Tzigov Chark, Bulgaria, September 11-13 1997
9. D.D. Lewis. Representation and Learning in Information Retrieval. PhD thesis, Department of Computer Science, University of Massachusetts, 1992
10. D.D. Lewis, M. Ringuette. A Comparison of Two Learning Algorithms for Text Categorization. In: Proc. of the 3rd Symposium on Document Analysis and Information Retrieval (SDAIR 94), pp. 81-93, Las Vegas, NV, April 11-13 1994
11. W. Li, B. Lee, F. Krausz, K. Sahin. Text Classification by a Neural Network. In: Proc. of the 23rd Annual Summer Computer Simulation Conference, pp. 313-318, Baltimore, MD, July 22-24 1991
12. O. Lutzy. Morphic-Plus: Ein morphologisches Analyseprogramm für die deutsche Flexionsmorphologie und Komposita-Analyse. Technical Report D-95-07, DFKI GmbH, Kaiserslautern, 1995. (in German)
13. M.E. Maron. Automatic Indexing: An Experimental Inquiry. J. Association for Computing Machinery, 8:404-417, 1961
14. G. Masand, G. Linoff, D. Waltz. Classifying News Stories using Memory Based Reasoning. In: Proc. of the 15th Annual International ACM/SIGIR Conference on Research and Development in Information Retrieval, pp. 59-65, Copenhagen, Denmark, June 1992
15. I. Moulinier, J.-G. Ganascia. Applying an Existing Machine Learning Algorithm to Text Categorization. In Connectionist, Statistical, and Symbolic Approaches to Learning for Natural Language Processing, pp. 343-354. Berlin, Heidelberg, New York: Springer-Verlag, 1996
16. G. Salton, M.J. McGill. Introduction to Modern Information Retrieval, pp. 52-117. New York: McGraw-Hill, first edition, 1983
17. H. Schütze, D.A. Hull, J.O. Pedersen. A Comparison of Classifiers and Document Representations for the Routing Problem. In: Proc. of the 18th Annual International ACM/SIGIR Conference on Research and Development in Information Retrieval, Seattle, WA, July 1995
18. R. Tong, A. Winkler, P. Gage. Classification Trees for Document Routing, a Report on the TREC Experiment. In: Proc. of the 1st Text REtrieval Conference (TREC1), pp. 209-227, 1993
19. C.J. van Rijsbergen. A Theoretical Basis for the Use of Co-occurence Data in Information Retrieval. J. Documentation, 2(33):106-119, 1977