On benchmarking of invoice analysis systems

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3872 LNCS, Issue , 2006, Pages 312-323

  Klein, Bertin ^a   Agne, Stefan ^a   Dengel, Andreas ^a  

^a GERMAN RESEARCH CENTER FOR ARTIFICIAL INTELLIGENCE DFKI   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

BENCHMARKING; CHARACTER RECOGNITION; CLASSIFICATION (OF INFORMATION); INFORMATION ANALYSIS; PROGRAM DOCUMENTATION; TEXT PROCESSING;

DATA COMPARISON; GROUND TRUTH DATA; INVOICE ANALYSIS SYSTEMS; TEXT RECOGNITION;

INFORMATION RETRIEVAL SYSTEMS;

EID: 33745522525     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11669487_28     Document Type: Conference Paper

References (34)

1. [ADK03] Stefan Agne, Andreas Dengel, and Bertin Klein. Evaluating see - a benchmarking systems for document page segmentation. In Proceedings of the 7th International Conference on Document Analysis and Recognition ICDAR'03), volume I, pages 634-638, Edinburgh, Scotland, United Kingdom, August, 3-6 2003.
2. [ARROO] Stefan Agne, Markus Rogger, and Jörg Rohrschneider. Benchmarking of document page segmentation. In Daniel P. Lopresti and Jiangying Zhou, editors, Document and Recognition and Retrieval VII, volume 3967 of Proceedings of SPIE, pages 165-171, San Jose, California, USA, 2000.
3. [Bai93] Henry S. Baird. Document image defect models and their uses. In Proceedings of the Second International Conference on Document Analysis and Recognition ICDAR, pages 62-67, Tsukuba Science City, Japan, October 20-22 1993. IEEE Computer Society Press.
4. [Bai95] Henry S. Baird. Document image defect models. In Lawrence O'Gorman and Rangachar Kasturi, editors, Document Image Analysis, pages 315-325. IEEE Computer Society Press, 1995.
5. [Bre02] T. M. Breuel. Representations and metrics for off-line handwriting segmentation. In 8th International Workshop on Frontiers in Handwriting Recognition, 2002.
6. [Chi92] Nancy Chinchor. MUC-4 evaluation metrics. In Proceedings of the Fourth Message Understanding Conference (MUC-4), pages 22-29, McLean, Virginia, USA, June 16-18 1992. Morgan Kaufmann Publishers, Inc.
7. [CS93] Nancy Chinchor and Beth Sundheim. MUC-5 evaluation metrics. In Proceedings of the Fifth Message Understanding Conference (MUC-5), pages 69-78, Baltimore, Maryland, USA, August 25-27 1993. Morgan Kaufmann Publishers, Inc.
8. +03] A. Dengel, P. Nowak, C. Wagner, K. Rehders, B. Klein, D. Schneider, M. Winkler, and Tebel R. Studie automatisierte rechnungseingangsbearbeitung marktpotential, marktübersicht und trends, commercial study, September 2003.
9. [HB93] Tin Kam Ho and Henry S. Baird. Perfect metrics. In Proceedings of the Second International Conference on Document Analysis and Recognition ICDAR, pages 593-597, Tsukuba Science City, Japan, October 20-22 1993. IEEE Computer Society Press.
10. [HB95] Tin Kam Ho and Henry S. Baird. Evaluation of OCR accuracy using synthetic data. In Proceedings of the Fourth Annual Symposium on Document Analysis and Information Retrieval SDAIR 95, pages 413-422, Las Vegas, Nevada, April 24-26 1995.
11. +05] A. Kumar, A. Burgun, W. Ceusters, J. Cimino, J. Davis, P. Elkin, I. Kalet, A. Rector, J. Rice, J. Rogers, S. Schulz, K. Spackman, D. Zaccagini, P. Zweigenbaum, and B. Smith, Six questions on the construction of ontologies in biomedicine. In AMIA, Washington DC, USA., 2005.
12. [KD04a] Bertin Klein and Andreas Dengel. Problem-adaptable document analysis and understanding for high-volume applications. International Journal on Document Analysis and Recognition, 2004.
13. [KD04b] Bertin Klein and Andreas Dengel. Results of a study on invoice-reading systems in germany. In IAPR International Workshop on Document Analysis Systems, 2004.
14. [KDF04] Bertin Klein, Andreas Dengel, and Andreas Fordan. Reading and Learning - Adaptive Content Recognition, volume 2956 of LNCS, chapter smartFIX: An Adaptive System for Document Analysis and Understanding, pages 166-186. Springer, 2004.
15. [KGKD01] B. Klein, S. Gökkus, T. Kieninger, and A. Dengel. Three approaches to industrial table spotting. In Int. Conf. On Document Analysis and Recognition (ICDAR) '01, 2001.
16. [KRN93] Junichi Kanai, Stephen V. Rice, and Thomas A. Nartker. A preliminary evaluation of automatic zoning. In Kevin O. Grover, editor, Annual Research Report, pages 35-45, University of Nevada, Las Vegas, 1993. Information Science Research Institute.
17. [KRNN95] Junichi Kanai, Stephen V. Rice, Thomas A. Nartker, and George Nagy. Automated evaluation of OCR zoning. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17(1):86-90, January 1995.
18. [Lew91] David D. Lewis. Evaluating text categorization. In Proceedings of the Workshop on Speech and Natural Language, pages 312-318, Pacific Grove, California, USA, February 19-22 1991.
19. [Lew95] David D. Lewis. Evaluating and optimizing autonomous text classification systems. In Edward A. Fox, Peter Ingwersen, and Raya Fidel, editors, Proceedings of the Eighteenth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval SIGIR '95, Special Issue of the SIGIR Forum, pages 246-254, Seattle, Washington, USA, July 9-13 1995. ACM Press.
20. [LS91] Wendy Lehnert and Beth Sundheim. A performance evaluation of text-analysis technologies. AI magazine, 12(3);81-94, Fall 1991.
21. [MUC95] Proceedings of the Sixth Message Understanding Conference (MUC-6), Columbia, Maryland, USA, November 6-8 1995. Morgan Kaufmann Publishers, Inc. Inhaltsverzeichnis.
22. +01] Liangrui Peng, Ming Chen, Changsong Liu, Xiaoqing Ding, and Jirong Zheng. An automatic performance evaluation method for document page segmentation. In Proceedings of the Sixth International Conference on Document Analysis and Recognition (ICDAR), pages 134-137, Seattle, Washington, USA, September 10-13 2001. IEEE Computer Society Press.
23. [RJN95] Stephen V. Rice, Prank R. Jenkins, and Thomas A. Nartker. The fourth annual test of OCR accuracy. In Andrew D. Bagdanov, editor, Annual Research Report, pages 11-49, University of Nevada, Las Vegas, 1995. Information Science Research Institute.
24. [RJN96] Stephen V. Rice, Prank R. Jenkins, and Thomas A. Nartker. The fifth annual test of OCR accuracy, Technical Report TR-96-01, Information Science Research Institute, University of Nevada, Las Vegas, USA, April 1996.
25. [RKN93] Stephen V. Rice, Junichi Kanai, and Thomas A. Nartker. An evaluation of OCR accuracy. In Kevin O. Grover, editor, Annual Research Report, pages 9-33, University of Nevada, Las Vegas, 1993. Information Science Research Institute.
26. [RKN94] Stephen V. Rice, Junichi Kanai, and Thomas A. Nartker, The third annual test of OCR accuracy. In Kevin O. Grover, editor, Annual Research Report, pages 11-38, University of Nevada, Las Vegas, 1994. Information Science Research Institute
27. [RV94a] S. Randriamasy and L. Vincent. Benchmarking page segmentation algorithms. In Proceedings of the 1994 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 411-416, Seattle, Washington, USA, June 21-23 1994. IEEE Computer Society Press.
28. [RV94b] Sabine Randriamasy and Luc Vincent, A region-based system for the automatic evaluation of page segmentation algorithms. In Andreas Dengel and A. Lawrence Spitz, editors, Proceedings of the International Association for Pattern Recognition Workshop on Document Analysis Systems DAS94, pages 29-41, Kaiserslautern, Germany, October 18-20 1994.
29. [RVW94] Sabine Randriamasy, Luc Vincent, and Ben Wittner, An automatic benchmarking scheme for page segmentation. In Proceedings of the IS&T/SPIE 1994 International Symposium on Electronic Imaging Science and Technology, volume 2181, pages 217-230, 1994.
30. [Sum98] K. Summers. Automatic Discovery Of Logical Document Structure. PhD thesis, Cornell University, 1998.
31. [TMD98] M. Thulke, V. Märgner, and A. Dengel. A general approach to quality evaluation of document segmentation results. In S.-W. Lee and Y. Nakano, editors, Proceedings of the International Association for Pattern Recognition Workshop on Document Analysis Systems DAS98, pages 79-88, Nagano, Japan, November 1998.
32. [vR79] C. J. van Rijsbergen. Information Retrieval, chapter 7 Evaluation, pages 144-183. Butterworths, second edition, 1979.
33. [WK91] Sholom M. Weiss and Casimir A. Kulikowski. Computer Systems That Learn, chapter 2 How to Estimate the True Performance of a Learning System, pages 17-49. Morgan Kaufmann Publishers, Inc., 1991.
34. [YV95] Berrin A. Yanikoglu and Luc Vincent. Ground-truthing and benchmarking document page segmentation. In Proceedings of the Third International Conference on Document Analysis and Recognition, volume 2, pages 601-604, Montréal, Canada, August 14-16 1995. IEEE Computer Society Press.