Real-Time Lexicon-Free Scene Text Localization and Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 38, Issue 9, 2016, Pages 1872-1885

  Neumann, Lukáš ^a   Matas, Jiří ^a  

^a CZECH TECHNICAL UNIVERSITY IN PRAGUE   (Czech Republic)

Author keywords

end to end text recognition; photo OCR; scene text; Text in the wild

Indexed keywords

ALGORITHMS; CLUSTERING ALGORITHMS;

CLASSIFICATION ACCURACY; REAL TIME PERFORMANCE; RECOGNITION METHODS; SCENE TEXT; SEQUENTIAL SELECTION; STATE-OF-THE-ART METHODS; TEXT RECOGNITION; TEXT-IN-THE WILD;

CHARACTER RECOGNITION;

EID: 84981285560     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2015.2496234     Document Type: Article

References (40)

1. D. Karatzas, F. Shafait, et al., "ICDAR 2013 robust reading competition," in Proc. 12th Int. Conf. Document Anal. Recog., 2013, pp. 1484-1493.
2. A. Bissacco, M. Cummins, et al., "PhotoOCR: Reading text in uncontrolled conditions," in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 785-792.
3. K. Wang, B. Babenko, and S. Belongie, "End-to-end scene text recognition," in Proc. IEEE Int. Conf. Comput. Vis., 2011, pp. 1457-1464.
4. J. J. Lee, P.-H. Lee, et al., "AdaBoost for text detection in natural scene," in Proc. Int. Conf. Document Anal. Recog., 2011, pp. 429-434.
5. P. Viola and M. J. Jones, "Robust real-time face detection," Int. J. Comput. Vis., vol. 57, no. 2, pp. 137-154, 2004.
6. B. Epshtein, E. Ofek, and Y. Wexler, "Detecting text in natural scenes with stroke width transform," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2010, pp. 2963-2970.
7. L. Kang, Y. Li, and D. Doermann, "Orientation robust text line detection in natural images," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 4034-4041.
8. X.-C. Yin, X. Yin, K. Huang, and H.-W. Hao, "Robust text detection in natural scene images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 5, pp. 970-983, May 2014.
9. D. Karatzas, L. Gomez-Bigorda, et al., "ICDAR 2015 robust reading competition," in ICDAR 2015. IEEE, 2013, pp. 1156-1160.
10. L. Neumann and J. Matas, "A method for text localization and recognition in real-world images," in Proc. 10th Asian Conf. Comput. Vis., Nov. 2010, pp. 2067-2078.
11. L. Neumann and J. Matas, "Text localization in real-world images using efficiently pruned exhaustive search," in Proc. Int Conf. Document Anal. Recog., Sep. 2011, pp. 687-691.
12. L. Neumann and J. Matas, "Real-time scene text localization and recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2012, vol. 6, pp. 3538-3545.
13. L. Neumann and J. Matas, "On combining multiple segmentations in scene text recognition," in Proc. 12th Int. Conf. Document Anal. Recog., Aug. 2013, pp. 523-527.
14. A. Mishra, K. Alahari, and C. V. Jawahar, "Top-down and bottomup cues for scene text recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2012, pp. 2687-2694.
15. X.-C. Yin, W.-Y. Pei, J. Zhang, and H. Hao, "Multi-orientation scene text detection with adaptive clustering," IEEE Trans. Pattern Anal. Mach. Intell., vol. 37, no. 9, pp. 1930-1937, Sep. 2015.
16. J. Canny, "A computational approach to edge detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-8, no. 6, pp. 679-698, Nov. 1986.
17. J. Zhang and R. Kasturi, "Character energy and link energy-based text extraction in scene images," in Proc. 10th Asian Conf. Comput. Vis., Nov. 2010, pp. 832-844.
18. J. Matas, O. Chum, et al., "Robust wide-baseline stereo from maximally stable extremal regions," Image Vis. Comput., vol. 22, no. 10, pp. 761-767, 2004.
19. T. E. de Campos, B. R. Babu, and M. Varma, "Character recognition in natural images," in Proc. Int. Conf. Comput. Vis. Theory Appl., Feb. 2009, pp. 273-280.
20. M. Iwamura, M. Tsukada, and K. Kise, "Automatic labeling for scene text database," in Proc. 12th Int. Conf. Document Anal. Recog., Aug. 2013, pp. 1397-1401.
21. J. J. Weinman, E. Learned-Miller, and A. R. Hanson, "Scene text recognition using similarity and a lexicon with sparse belief propagation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 10, pp. 1733-1746, Oct. 2009.
22. T. Novikova, O. Barinova, et al., "Large-lexicon attribute-consistent text recognition in natural images," in Proc. 12th Eur. Conf. Comput. Vis., 2012, pp. 752-765.
23. C. Yao, X. Bai, et al., "Strokelets: A learned multi-scale representation for scene text recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 4042-4049.
24. C.-Y. Lee, A. Bhardwaj, et al., "Region-based discriminative feature pooling for scene text recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 4050-4057.
25. T. Wang, D. J. Wu, et al., "End-to-end text recognition with convolutional neural networks," in Proc. 21st Int. Conf. Pattern Recog., 2012, pp. 3304-3308.
26. A. Shahab, F. Shafait, and A. Dengel, "ICDAR 2011 robust reading competition challenge 2: Reading text in scene images," in Proc. 12th Int. Conf. Document Anal. Recog., 2011, pp. 1491-1496.
27. H. Cheng, X. Jiang, et al., "Color image segmentation: Advances and prospects," Pattern Recog., vol. 34, no. 12, pp. 2259-2281, 2001.
28. J. Matas and K. Zimmermann, "A new class of learnable detectors for categorisation," in Proc. 14th Scand. Conf. Image Anal., 2005, vol. 3540, pp. 541-550.
29. W. K. Pratt, Digital Image Processing: PIKS Inside, 3rd ed. New York, NY, USA: Wiley, 2001.
30. R. E. Schapire and Y. Singer, "Improved boosting algorithms using confidence-rated predictions," Mach. Learn., vol. 37, no. 3, pp. 297-336, 1999.
31. A. Niculescu-Mizil and R. Caruana, "Obtaining calibrated probabilities from boosting," in Proc. 21st Conf. Uncertainty Artif. Intell., 2005, p. 413.
32. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines. Cambridge, U.K.: Cambridge Univ. Press, Mar. 2000.
33. K.-R. Muller, S. Mika, G. Ratsch, K. Tsuda, and B. Scholkopf, "An introduction to kernel-based learning algorithms," IEEE Trans. Neural Netw., vol. 12, no. 2, pp. 181-201, Mar. 2001.
34. C.-L. Liu, K. Nakashima, et al., "Handwritten digit recognition: Investigation of normalization and feature extraction techniques," Pattern Recog., vol. 37, no. 2, pp. 265-279, 2004.
35. M. Muja and D. G. Lowe, "Fast approximate nearest neighbors with automatic algorithm configuration," in Proc. Int. Conf. Comput. Vis. Theory Appl., 2009, pp. 331-340.
36. J. J. Weinman, Z. Butler, et al., "Toward integrated scene text reading," IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 2, pp. 375-387, Feb. 2014.
37. C. Wolf and J.-M. Jolion, "Object count/area graphs for the evaluation of object detection and segmentation algorithms," Int. J. Document Anal. Recog., vol. 8, no. 4, pp. 280-296, Aug. 2006.
38. M. Jaderberg, K. Simonyan, et al., "Reading text in the wild with convolutional neural networks," Int. J. Comput. Vis., pp. 1-20, 2014.
39. T. Vojǐř and J. Matas, "The enhanced flock of trackers," in Registration and Recognition in Images and Videos. New York, NY, USA: Springer, 2014, pp. 113-136.
40. B. Keni and S. Rainer, "Evaluating multiple object tracking performance: The CLEAR MOT metrics," J. Image Video Process., vol. 2008, p. 1, 2008.