Performance evaluation of symbol recognition and spotting systems: An overview

DAS 2008 - Proceedings of the 8th IAPR International Workshop on Document Analysis Systems

Volumn , Issue , 2008, Pages 497-505

  Delalandre, Mathieu ^a   Valveny, Ernest ^a   Lladós, Josep ^a  

^a Barcelona Perception Computing Lab   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

ELECTRONIC WARFARE; INTELLIGENT VEHICLE HIGHWAY SYSTEMS; MILITARY ELECTRONIC COUNTERMEASURES; TECHNICAL PRESENTATIONS;

AND PERFORMANCE EVALUATIONS; DEGRADATION MODELS; GROUNDTRUTHING; OPEN PROBLEMS; PERFORMANCE CHARACTERIZATIONS; PERFORMANCE EVALUATIONS; PRIORI KNOWLEDGES; SYMBOL RECOGNITIONS; WORKING GROUPS;

PAPER;

EID: 57649233342     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/DAS.2008.63     Document Type: Conference Paper

References (61)

1. S. Aksoy and al. Algorithm performance contest. In International Conference on Pattern Recognition (ICPR), volume 4, pages 870-876, 2000.
2. A. Antonacopoulos and D. Bridson. Performance analysis framework for layout analysis methods. In International Conference on Document Analysis and Recognition (ICDAR), pages 1258-1262, 2007.
3. A. Antonacopoulos, B. Gatos, and D. Bridson. Icdar2007 page segmentation competition. In International Conference on Document Analysis and Recognition (ICDAR), pages 1279-1283, 2007.
4. A. Antonacopoulos, D. Karatzas, and D. Bridson. Ground truth for layout analysis performance evaluation. In Workshop on Document Analysis (DAS), volume 3872 of Lecture Notes in Computer Science (LNCS), pages 302-311, 2006.
5. H. Baird. Document image defect models and their uses. In International Conference on Document Analysis and Recognition (ICDAR), pages 62-67, 1993.
6. T. Breuel. Representations and metrics for off-line handwriting segmentation. In International Workshop on Frontiers in Handwriting Recognition (IWFHR), pages 428-433, 2002.
7. N. Chen and D. Blostein. A survey of document image classification: problem statement, classifier architecture and performance evaluation. International Journal on Document Analysis and Recognition (IJDAR), 10(1):1-16, 2007.
8. A. Chhabra. Graphic symbol recognition: An overview. In Workshop on Graphics Recognition (GREC), volume 1389 of Lecture Notes in Computer Science (LNCS), pages 68-79, 1998.
9. A. Chhabra and I. Phillips. The second international graphics recognition contest - raster to vector conversion : A report. In Workshop on Graphics Recognition (GREC), volume 1389 of Lecture Notes in Computer Science (LNCS), pages 390-410, 1998.
10. T. Cootes, C. Taylor, D. Cooper, and J. Graham. Active shape models-their training and application. Computer Vision and Image Understanding (CVIU), 61(1):38-59, 1995.
11. L. Cordella and M. Vento. Symbol and shape recognition. In Workshop on Graphics Recognition (GREC), volume 1941 of Lecture Notes In Computer Science (LNCS), pages 167-182, 1999.
12. A. Das, S. Saha, and B. Chanda. An empirical measure of the performance of a document image segmentation algorithm. International Journal of Document Analysis and Recognition (IJDAR), 4:183-190, 2002.
13. M. Delalandre, T. Pridmore, E. Valveny, E. Trupin, and H. Locteau. Building synthetic graphical documents for performance evaluation. In Workshop on Graphics Recognition (GREC), pages 84-87, 2007.
14. P. Dosch and J. Lladós. Vectorial signatures for symbol discrimination. In Workshop on Graphics Recognition (GREC), volume 3088 of Lecture Notes in Computer Science (LNCS), pages 154-165, 2004.
15. P. Dosch and E. Valveny. Report on the second symbol recognition contest. In Workshop on Graphics Recognition (GREC), volume 3926 of Lecture Notes in Computer Science (LNCS), pages 381-397, 2006.
16. M. Friedman and A. Kandel. Introduction to Pattern Recognition : Statistical, Structural, Neural and Fuzzy Logic Approaches. Number ISBN-10: 9810233124. World Scientific Publishing Company, 1999.
17. E. Greengrass. Information retrieval: A survey. Technical. Report TR-R52-008-001, Center for Architectures for Data-Driven Information Processing (CADIP), University of Maryland, US, 2000.
18. R. Haralick. Performance characterization in image analysis: Thinning, a case in point. Pattern Recognition Letters (PRL), 13(1):5-12, 1992.
19. R. Haralick. Performance evaluation of document image algorithms. In Workshop on Graphics Recognition (GREC), volume 1941 of Lecture Notes in Computer Science (LNCS), pages 315-323, 2000.
20. J. D. Hartog. Knowledge based interpretation of utility maps. Computer Vision and Image Understanding (CVIU), 63(1):105-117, 1996.
21. J. Hobby. Matching document images with ground truth. International Journal on Document Analysis and Recognition (IJDAR), 1(1):52-61, 1998.
22. X. Jiang, A. Munger, and H. Bunke. On median graphs : Properties, algorithms, and applications. Pattern Analysis and Machine Intelligence (PAMI), 23 (10): 1144-1151, 2001.
23. N. Journet, J. Ramel, R. Mullot, and V. Eglin. A proposition of retrieval tools for historical document images libraries. In International Conference on Document Analysis and Recognition (ICDAR), volume 2, pages 1053-1057, 2007.
24. T. Kanungo, H. Baird, and R. Haralick. International Journal on Document Analysis and Recognition (IJDAR), Special Issue on "Performance Evaluation: Theory, Practice, and Impact", volume 4/3. Springer, 2002.
25. T. Kanungo and R. Haralick. An automatic closed-loop methodology for generating character groundtruth for scanned documents. Pattern Analysis and Machine Intelligence (PAMI), 21(2):179-183, .1999.
26. T. Kanungo, R. Haralick, h.S. Baird, W. Stuezle, and D. M. and A statistical, nonparametric methodology for document degradation model, validation, 2000.
27. R. Kasturi and I. Phillips. The first international graphics recognition contest-dashed-line recognition competition. In Workshop on Graphics Recognition (GREC), volume 1072 of Lecture Notes in Computer Science (LNCS), 1996.
28. D. W. Kim and T. Kanungo. A point matching algorithm for automatic generation of groundtruth for document images. In Workshop on Document Analysis Systems (DAS), pages 475-485, 2000.
29. N. Lavesson. Evaluation of classifier performance and the impact of learning algorithm parameters. Master's thesis, Department of Software Engineering and Computer Science, Blekinge Institute of Technology, Sweden, 2003.
30. C. Lee and T. Kanungo. The architecture of trueviz: A groundtruth/metadata editing and visualizing toolkit. Pattern Recognition (PR), 36(3):811-825, 2003.
31. J. Lladós, E. Valveny, G. Sánchez, and E. Martí. Symbol recognition : Current advances and perspectives. In Workshop on Graphics Recognition (GREC), volume 2390 of Lecture Notes in Computer Science (LNCS), pages 104-127, 2002.
32. H. Locteau, S. Adam, E. Trupin, J. Labiche, and P. Heroux. Symbol spotting using full visibility graph representation. In Workshop on Graphics Recognition (GREC), pages 49-50, 2007.
33. D. Lopresti and G. Nagy. Issues in ground-truthing graphic documents. In Workshop on Graphics Recognition (GREC), volume 2390 of Lecture Notes in Computer Science (LNCS), pages 46-66, 2002.
34. S. Mao and T. Kanungo. Software architecture of pset: a page segmentation evaluation toolkit. International Journal on Doucment Analysis and Recognition (IJDAR), 4:205-217, 2002.
35. H. Muller, W. Muller, D. Squire, S. Marchand-Maillet, and T. Pun. Performance evaluation in content-based image retrieval: Overview and proposals. Pattern Recognition Letters (PRL), 22(5):593-601, 2001.
36. S. Nicolas, T. Paquet, and L. Heutte. Complex handwritten page segmentation using contextual models. In Document Image Analysis for Libraries (DIAL), pages 46-57, 2006.
37. I. Phillips and A. Chhabra. Empirical performance evaluation of graphics recognition systems. Pattern Analysis and Machine Intelligence (PAMI), 21(9):849-870, 1999.
38. I. Phillips, J. Ha, R. Haralick, and D. Dori. The implementation methodology for the cd-rom english document database. In International Conference on Document Analysis and Recognition (ICDAR), pages 484-487, 1993.
39. T. Pridmore, A. Darwish, and D. Elliman. Interpreting line drawing images: A knowledge level perspective. In Workshop on Graphics Recognition (GREC), volume 2390 of Lecture Notes in Computer Science (LNCS), pages 245-255, 2002.
40. R. Qureshi, J. Ramel, D. Barret, and H. Cardot. Symbol spotting in graphical documents using graph representations. In Workshop on Graphics Recognition (GREC), pages 39-40, 2007.
41. M. Rusinol and J. Lladós. A region-based hashing approach for symbol spotting in technical documents. In Workshop on Graphics Recognition (GREC), 2007.
42. F. Shafait, D. Keysers, and T. Breuel. Pixel-accurate representation and evaluation of page segmentation in document images. In International Conference on Pattern Recognition (ICPR), pages 872-875, 2006.
43. S. Tabbone, L. Wendling, and D. Zuwala. A hybrid approach to detect graphical, symbols in documents. In Workshop on Document Analysis Systems (DAS), volume 3163 of Lecture Notes in Computer Science (LNCS), pages 342-353, 2004.
44. N. A. Thacker, A. F. Clark, J. Barron, R. Beveridge, C. Clark, P. Courtney, W. Crum, and V. Ramesh. Performance characterisation in computer vision: A guide to best practices. Technical Report 2005-009, Medical School, University of Manchester, Manchester, UK, 2005.
45. G. F. G. Thoma. Ground truth data for document image analysis. In Symposium on Document Image Understanding and Technology (SDIUT), pages 199-205, 2003.
46. K. Tombre and B. Lamiroy. Graphics recognition - from re-engineering to retrieval. In International Conference on Document Analysis and Recognition (ICDAR), pages 148-155, 2003.
47. K. Tombre, S. Tabbone, and P. Dosch. Musings on symbol recognition. In Workshop on Graphics Recognition (GREC), volume 3926 of Lecture Notes in Computer Science (LNCS), pages 23-34, 2005.
48. E. Valveny and al. A general framework for the evaluation of symbol recognition methods. International Journal on Document Analysis and Recognition (IJDAR), 1(9):59-74, 2007.
49. E. Valveny and P. Dosch. Symbol recognition contest: A synthesis. In Workshop on Graphics Recognition (GREC), volume 3088 of Lecture Notes in Computer Science (LNCS), pages 368-386, 2004.
50. E. Valveny and E. Martí. A. model for image generation and symbol recognition through the deformation of lineal shapes. Pattern Recognition Letters (PRL), 24(15):2857-2867, 2003.
51. E. Valveny, S. Tabbone, O. Ramos, and E. Philippot. Performance characterization of shape descriptors for symbol representation. In Workshop on Graphics Recognition (GREC), 2007.
52. L. Wenyin and D. Dori. A proposed scheme for performance evaluation of graphics/text separation algorithms. In Workshop on Graphics Recognition (GREC), volume 1389 of Lecture Notes in Computer Science (LNCS), pages 335-346, 1997.
53. L. Wenyin and D. Dori. A protocol for performance evaluation of line detection algorithms. Machine Vision and Applications, 9:240-250, 1997.
54. L. Yan and L. Wenyin. Interactive recognizing graphic objects in engineering drawings. In Workshop on Graphics Recognition (GREC), volume 3088 of Lecture Notes in Computer Science (LNCS), pages 126-137, 2004.
55. L. Yang, W. Huang, and C. Tan. Semi-automatic ground truth generation for chart image recognition. In Workshop on Document Analysis Systems (DAS), volume 3872 of Lecture Notes in Computer Science (LNCS), pages 324-335, 2006.
56. B. Yanikoglus and L. Vincent. Pink panther: a complete environment for ground-truthing and benchmarking document page segmentation. Pattern Recognition (PR), 31(9):1191-1204, 1998.
57. S. Yoon, G. Kim, Y. Choi, and Y. Lee. New paradigm for segmentation and recognition. In Workshop on Graphics Recognition (GREC), pages 216-225, 2001.
58. L. Younes. Introduction to machine learning. Technical report, Department of Applied Mathematics and Statistics, Center for Imaging Science, Johns Hopkins University, Baltimore, USA, 2008.
59. Y. Yu, A. Samal., and S. Seth. A system for recognizing a large class of engineering drawing. Pattern Analysis and Machine Intelligence (RAMI), 19(8):868-890, 1997.
60. J. Zhai, L. Wenyin, D. Dori, and Q. Li. A line drawings degradation model for performance characterization. In International Conference on Document Analysis And Recognition (ICDAR), pages 1020-1024, 2003.
61. D. Zuwala and S. Tabbone. A method for symbol spotting in graphical documents. In Workshop on Document Analysis Systems (DAS), volume 3872 of Lecture Notes in Computer Science (LNCS), pages 518-528, 2006.