Issues in performance evaluation: A case study of math recognition

Proceedings of the International Conference on Document Analysis and Recognition, ICDAR

Volumn , Issue , 2009, Pages 1355-1359

  Lapointe, Adrien ^a   Blostein, Dorothea ^a  

^a QUEEN S UNIVERSITY   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

DOCUMENT RECOGNITION SYSTEMS; MATHEMATICAL EXPRESSIONS; OPEN PROBLEMS; PERFORMANCE EVALUATION; PERFORMANCE METRICS; TEST DATA; THEORY AND PRACTICE;

EID: 71249149487     PISSN: 15205363     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDAR.2009.247     Document Type: Conference Paper

References (29)

1. Infty. www.inftyproject.org/en/index.html, April 23, 2008.
2. MathBrush. www.cs.uwaterloo.ca/scg/mathbrush, Apr 23, 2008
3. arXiv. http://arxiv.org/, November 1, 2008.
4. M. Altamimi, A. Youssef, "A More Canocial Form of Content MathML to Facilitate Math Search," Proc. Extreme Markup Languages, 2007.
5. D. Archambault, V. Moço, "Canonical MathML to Simplify Conversion of MathML to Braille Mathematical Notations," LNCS Vol. 4061, pp. 1191-1198, Springer, 2006.
6. K. Ashida, M. Okamoto, H. Imai, T. Nakatsuka, "Perf. Eval. of a Math. Formula Recognition System with a Large Scale of Printed Formula Images," Proc. DIAL'06, 321-331, Apr. 2006.
7. H. Baird, M. Casey, "Towards Versatile Document Analysis Systems," LNCS Vol. 3872, pp. 280-290, Springer, 2006.
8. D. Blostein, R. Zanibbi, G. Nagy, R. Harrap, "Document Representations," Proc. GREC'03, pp. 3-12, July 2003.
9. P. Calingaert, "System Performance Evaluation: Survey and Appraisal," CACM, 10(1):12-18, January 1967.
10. K-F Chan, D-Y Yeung, "Error Detection, Error Correction and Performance Evaluation in On-Line Math. Expression Recognition," Pattern Recognition, 34(8):1671-1684, Aug. 2001.
11. Document Recognition Contests: www.icdar2007.org/competition.html
12. U. Garain, B. Chaudhuri, "A Corpus for OCR Research on Mathematical Expressions," IJDAR, 7(4):241-259, Sept. 2005.
13. G. Guida, G. Mauri, "Evaluation of Natural Language Processing Systems: Issues and Approaches," Proceedings of the IEEE, 74:1026-1035, July 1986.
14. J. Hu, R. Kashi, D. Lopresti, G. Nagy, G. Wilfong, "Why Table Ground-Truthing is Hard," Proc. ICDAR 2001, Seattle, Washington, Sept. 2001, pp. 129-133.
15. A. Jackson, "The Digital Mathematics Library," Notices of the AMS, 50(8):918-923, September 2003.
16. E. Keogh, S. Lonardi, C. Ratanamahatana, "Towards Parameter-Free Data Mining," Proc. KDD 2004, 206-215, 2004.
17. A. Kosmala, S. Lavirotte, L. Pottier, G. Rigoll, "On-Line Handwritten Formula Rec. using HMMs and Context Dependent Graph Grammars," Proc. ICDAR'99, pp. 107-110, 1999.
18. A. Lapointe, "Issues in Performance Evaluation of Math. Notation Recognition Systems," MSc thesis, Queen's Univ., 2008.
19. S. Mao, T. Kanungo, "Empirical Performance Evaluation Methodology and its Application to Page Segmentation Algorithms," IEEE PAMI, 23(3):242-256, 2001.
20. University of Washington UW-III English/Technical Document Image Database. CD-ROM, 1996.
21. M. Okamoto, H. Imai, K. Takagi, "Performance Evaluation of a Robust Method for Mathematical Exprression Recognition," Proc. ICDAR'01, pp. 121-128, 2001.
22. I. Phillips, A. Chhabra, "Empirical Performance Evaluation of Graphics Recognition Systems," IEEE Trans. Pattern Analysis and Machine Intelligence, 21(9):849-870, 1999.
23. Y. Takiguchi, M. Okada, Y. Miyake, "A Fundamental Study of Output Translation from Layout Recognition ... for Mathematical Formulae," ICDAR'05, 2:745-749, 2005.
24. M. Thulke, V. Märgner, A. Dengel, "A General Approach to Quality Evaluation of Document Segmentation Results," LNCS Vol. 1655, pp. 43-57, Springer, 1999.
25. E. Valveny et al., "A General Framework for the Evaluation of Symbol Recognition Methods," IJDAR, 9(1):59-74, 2007.
26. L. Wenyin, D. Dori, "A Protocol for Performance Evaluation of Line Detection Algorithms", Machine Vision and Applications, Special Issue on Performance...., 9(5/6): 240-250, 1997.
27. L. Wenyin, D. Dori, "Performance Evaluation of Graphics Recognition Algorithms: Principles and Applications," Proc. ICPR'98, 2:1180-1182, 1998.
28. R. Zanibbi, D. Blostein, J. R. Cordy, "Recognizing Mathematical Expressions Using Tree Transformation," IEEE PAMI, 24(11):1455-1467, 2002.
29. R. Zanibbi, D. Blostein, J. R. Cordy, "Historical Recall and Precision: Summarizing Generated Hypotheses", Proc. ICDAR'05, 1:202-206, 2005.