A hybrid approach to detect and localize texts in natural scene images

IEEE Transactions on Image Processing

Volumn 20, Issue 3, 2011, Pages 800-813

  Pan, Yi Feng ^a   Hou, Xinwen ^a   Liu, Cheng Lin ^a  

^a INSTITUTE OF AUTOMATION   (China)

Author keywords

Conditional random field (CRF); connected component analysis (CCA); text detection; text localization

Indexed keywords

BINARIZATIONS; COMPLEX BACKGROUND; COMPONENT PROPERTIES; CONDITIONAL RANDOM FIELD; CONNECTED COMPONENT ANALYSIS (CCA); CONTENT-BASED; DATA SETS; ENERGY MINIMIZATION METHODS; HYBRID APPROACH; IMAGE DATASETS; IMAGE PYRAMIDS; MANUAL TUNING; NATURAL SCENE IMAGES; NON-UNIFORM ILLUMINATION; PARAMETER LEARNING; PRECISION AND RECALL; STATE-OF-THE-ART METHODS; TEXT DETECTION; TEXT LOCALIZATION; TEXT REGION; THREE STAGES;

DETECTORS;

IMAGE SEGMENTATION;

EID: 79951841939     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2010.2070803     Document Type: Article

References (50)

1. C. M. Bishop, Neural Networksfor Pattern Recognition. New York: Oxford University Press, 1995.
2. Y. Boykov, O. Veksler, and R. Zabih, "Fast approximate energy minimization via graph cuts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 11, pp. 1222-1239, 2001. (Pubitemid 33137959)
3. D. T. Chen, J.-M. Odobez, and H. Bourlard, "Text detection and recognition in images and video frames," Pattern Recogn., vol. 37, no. 5, pp. 595-608, 2004. (Pubitemid 38003096)
4. X. L. Chen, J. Yang, J. Zhang, and A. Waibel, "Automatic detection and recognition of signs from natural scenes," IEEE Trans. Image Process., vol. 13, no. 1, pp. 87-99, Jan. 2004.
5. X. R. Chen and A. L. Yuille, "Detecting and reading text in natural scenes," inProc. IEEE Conf. Computer Vision andPatternRecognition (CVPR'04), Washington, DC, 2004, pp. 366-373.
6. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR'05), San Diego, CA, 2005, pp. 886-893. (Pubitemid 43897286)
7. S. L. Feng, R. Manmatha, and A. McCallum, "Exploring the use of conditional random field models and HMMs for historical handwritten document recognition," in Proc. 2nd Int. Conf. Document Image AnalysisforLibraries (DIAL'06), Washington, DC, 2006, pp. 30-37. (Pubitemid 44732198)
8. J. Gllavata, R. Ewerth, and B. Freisleben, "Text detection in images based on unsupervised classification of high-frequency wavelet coefficients," in Proc. 17th Int. Conf. Pattern Recognition (ICPR'04), Cambridge, U.K., 2004, pp. 425-428.
9. J. M. Hammersley and P. Clifford, Markov Field on Finite Graphs and Lattices, 1971, unpublished.
10. X.-B. Jin, C.-L. Liu, and X. Hou, "Regularized margin-based conditional log-likelihood loss for prototype learning," Pattern Recogn., vol. 43, no. 7, pp. 2428-2438, 2010.
11. Y. Jin and S. Geman, "Context and hierarchy in a probabilistic image model," in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR'06), New York, NY, 2006, pp. 2145-2152. (Pubitemid 44931579)
12. B.-H. Juang and S. Katagiri, "Discriminative learning for minimum error classification," IEEE Trans. Signal Process., vol. 40, pp. 3043-3054, 1992. (Pubitemid 23603018)
13. K. Jung, K. I. Kim, and A. K. Jain, "Text information extraction in images and video: A survey," PatternRecogn.,vol. 37, no. 5, pp. 977-997, 2004. (Pubitemid 38473840)
14. K. I. Kim, K. Jung, and J. H. Kim, "Texture-based approach for text detection in images using support vector machines and continuously adaptive mean shift algorithm," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 12, pp. 1631-1639, 2003.
15. S. Kumar, J. August, and M. Hebert, "Exploiting inference for approximate parameter learning in discriminative fields: An empirical study," in Proc. 5th Int. Workshop on Energy Minimization Methods in Computer Vision and Pattern (EMMCVPR'05), St. Augustine, FL, 2005, pp. 153-168. (Pubitemid 43722932)
16. S. Kumar and M. Hebert, "Discriminative random fields," Int. J. Comput. Vision, vol. 68, no. 2, pp. 179-201, 2006. (Pubitemid 43724245)
17. J. Lafferty, A. McCallum, and F. Pereira, "Conditional random fields: Probabilistic models for segmenting and labeling sequence data," in Proc. 18th Int. Conf. Machine Learning (ICML'01), San Francisco, CA, 2001, pp. 282-289.
18. H. P. Li, D. Doermann, and O. Kia, "Automatic text detection and tracking in digital video," IEEE Trans. Image Process., vol. 9, pp. 147-156, Jan. 2000. (Pubitemid 30562093)
19. J. Liang, D. Doermann, and H. P. Li, "Camera-based analysis oftext and documents: A survey," Int. J. Document Anal. Recogn., vol. 7, no. 2-3, pp. 84-104, 2005. (Pubitemid 41051508)
20. R. Lienhart and A. Wernicke, "Localizing and segmenting text in images and videos," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 4, pp. 256-268, 2002. (Pubitemid 34692486)
21. X. B. Liu, H. Fu, and Y. D. Jia, "Gaussian mixture modeling and learning of neighboring characters for multilingual text extraction in images," Pattern Recogn., vol. 41, no. 2, pp. 484-493, 2008. (Pubitemid 47503242)
22. Y. X. Liu, S. Goto, and T. Ikenaga, "A contour-based robust algorithm for text detection in color images," IEICE Trans. Inf. Syst., vol. E89-D, no. 3, pp. 1221-1230, 2006.
23. S. M. Lucas, "ICDAR 2005 text locating competition results," in Proc. 8thInt. Conf. Document Analysis andRecognition (ICDAR'05), Seoul, South Korea, 2005, pp. 80-84. (Pubitemid 46442295)
24. M. Lyu, J. Q. Song, and M. Cai, "A comprehensive method for multilingual video text detection, localization, and extraction," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 2, pp. 243-255, 2005. (Pubitemid 40265948)
25. C. Mancas-Thillou and B. Gosselin, "Color text extraction with selective metric-based clustering," Comput. Vis. Image Underst., vol. 107, no. 1-2, pp. 97-107, 2007. (Pubitemid 46829949)
26. K. Murphy, A. Torralba, and W. T. Freeman, "Using the forest to see the trees: A graphical model for recognizing scenes and objects," Adv. Neural Inf. Process. Syst., vol. 16, 2003.
27. W. Niblack, An Introduction to Digital Image Processing. Birkeroed, Denmark: Strandberg Publishing, 1985.
28. S. Nicolas, J. Dardenne, T. Paquet, and L. Heutte, "Document image segmentation using a 2-D conditional random field model," in Proc. 9th Int. Conf. Document Analysis and Recognition (ICDAR'07), Curitiba, Brazil, 2007, pp. 407-411.
29. Y.-F. Pan, X. W. Hou, and C.-L. Liu, "A robust system to detect and localize texts in natural scene images," in Proc. 8th IAPR Workshop on Document Analysis Syetems (DAS'08), Nara, Japan, 2008, pp. 35-42.
30. Y.-F. Pan, X. W. Hou, and C.-L. Liu, "Text localization in natural scene images based on conditional random field," in Proc. 10th Int. Conf. Document Analysis and Recognition (ICDAR'09), Barcelona, Spain, 2009, pp. 6-10.
31. J. C. Platt, "Fast training of support vector machines using sequential minimal optimization," in Advances in Kernel Methods: Support Vector Learning. Cambridge, MA: MITPress, 1999, pp. 185-208.
32. P. Schnitzspan, M. Fritz, and B. Schiele, "Hierarchical support vector random fields: Joint training to combine local and global features," in Proc. 10th European Conf. Computer Vision (ECCV'08), Berlin, Germany, 2008, pp. 527-540.
33. R. Sedgewick, Algorithms in C, Part 5: Graph Algorithms, 3rd ed. Boston, MA: Addison-Wesley Professional, 2001.
34. F. Sha and F. Pereira, "Shallow parsing with conditional random fields," in Proc. Conf. North American Chapter Assoc. Computational Linguistics on Human Language Technology (NAACL'03), Morristown, NJ, 2003, pp. 134-141.
35. S. Shetty, H. Srinivasan, M. Beal, and S. Srihari, "Segmentation and labeling of documents using conditional random fields," in Proc. Document Recognition and Retrieval XIV, Proc. SPIE, San Jose, CA, Jan. 2007, pp. 6500U-1-11.
36. J. Shotton, J. M. Winn, C. Rother, and A. Criminisi, "TextonBoost: Joint appearance, shape and context modeling for multi-class object recognition and segmentation," in Proc. 9th European Conf. Computer Vision (ECCV'06), Graz, Austria, 2006, pp. 1-15. (Pubitemid 44029764)
37. J. Sochman and J. Matas, "WaldBoost-Learning for time constrained sequential detection," in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR'05), San Diego, CA, 2005, pp. 150-156.
38. R. Szeliski, R. Zabih, D. Scharstein, O. Veksler, V. Kolmogorov, A. Agarwala, M. Tappen, and C. Rother, "A comparative study of energy minimization methods for Markov random fields with smoothness-based priors," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 6, pp. 1068-1080, 2008. (Pubitemid 351650109)
39. H. Takahashi, "Region graph based text extraction from outdoor images," in Proc. 3rd Int. Conf. Information Technology and Applications (ICITA'05), Sydney, Australia, 2005, pp. 680-685. (Pubitemid 43763131)
40. H. Takatsuka, M. Tanaka, and M. Okutomi, "Distribution-based face detection using calibrated boosted cascade classifier," in Proc. 14th Int. Conf. ImageAnalysisandProcessing(ICIAP'07), Modena, Italy, 2007, pp. 351-356.
41. A. B. Torralba, K. P. Murphy, and W. T. Freeman, "Contextual models for object detection using boosted random fields," Adv. Neural Inf. Process. Syst., vol. 16, 2004.
42. J. Weinman, A. Hanson, and A. McCallum, "Sign detection in natural images with conditional random fields," in Proc. 14th IEEE Workshop on Machine Learningfor Signal Processing (MLSP'04), São Luís, Brazil, 2004, pp. 549-558. (Pubitemid 40557221)
43. J. Weinman, E. Learned-Miller, and A. Hanson, "Scene text recognition using similarity and a lexicon with sparse belief propagation," IEEE Trans.PatternAnal.Mach.Intell.,vol.31,no. 10,pp. 1733-1746, 2009.
44. V. Wu, R. Manmatha, and E. M. Riseman, "Finding text in images," in Proc. 2nd ACM Int. Conf. Digital Libraries (DL'97), New York, NY, 1997, pp. 3-12.
45. F. Yin and C.-L. Liu, "Handwritten text line segmentation by clustering with distance metric learning," in Int. Conf. Frontiers in Handwriting Recognition (ICFHR'08), Montreal, Canada, 2008, pp. 229-234.
46. D.-Q. Zhang and S.-F. Chang, "Learning to detect scene text using a higher-order MRF with belief propagation," in Proc. IEEE Conf. Computer Vision and Pattern Recognition Workshop s (CVPRW'04), Washington, DC, 2004, pp. 101-108.
47. J. Zhang and R. Kasturi, "Extraction of text objects in video documents: Recent progress," in Proc. 8th IAPR Workshop on Document Analysis Syetems (DAS'08), Nara, Japan, 2008, pp. 1-13.
48. Y. Zhong, H. J. Zhang, and A. K. Jain, "Automatic caption localization in compressed video," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 4, pp. 385-392, 2000.
49. X.-D. Zhou, D.-H. Wang, and C.-L. Liu, "A robust approach to text line grouping in online handwritten Japanese documents," Pattern Recogn., vol. 42, no. 9, pp. 2077-2088, 2009.
50. K. H. Zhu, F. H. Qi, R. J. Jiang, L. Xu, M. Kimachi, Y. Wu, and T. Aizawa, "Using Adaboost to detect and segment characters from nat-uralsenes,"in Proc. 1stConf CarameraBasedDocumentAnalysisand Recognition (CBDAR'05), Seoul, South Korea, 2005, pp. 52-59.