A novel text detection system based on character and link energies

IEEE Transactions on Image Processing

Volumn 23, Issue 9, 2014, Pages 4187-4198

  Zhang, Jing ^a   Kasturi, Rangachar ^a  

^a University of South Florida   (United States)

Author keywords

Content based information retrieval; Image tags; Text extraction; Video indexing

Indexed keywords

IMAGE PROCESSING; MATHEMATICAL MODELS;

CHARACTER FEATURE; CHARACTER STROKES; CONTENT-BASED INFORMATION RETRIEVAL; IMAGE TAGS; TEXT DETECTION; TEXT EXTRACTION; VIDEO ANALYSIS; VIDEO INDEXING;

INDEXING (OF INFORMATION);

EID: 84934916244     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2341935     Document Type: Article

References (38)

1. C. S. Shin, K. I. Kim, M. H. Park, and H. J. Kim, "Support vector machine-based text detection in digital video," in Proc. IEEE Signal Process. Soc. Workshop Neural Netw. Signal Process., vol. 2. Dec. 2000, pp. 634-641. (Pubitemid 32070248)
2. K. I. Kim, K. Jung, and J. H. Kim, "Texture-based approach for text detection in images using support vector machine and continuously adaptive mean shift algorithm," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 12, pp. 1631-1638, Dec. 2003.
3. Q. Ye, Q. Huang, W. Gao, and D. Zhao, "Fast and robust text detection in images and video frames," Image Vis. Comput., vol. 23, no. 6, pp. 565-576, 2005. (Pubitemid 40537040)
4. D. Chen, H. Bourlard, and J. Thiran, "Text identification in complex background using SVM," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 2. 2000, pp. II-621-II-626. (Pubitemid 34096772)
5. S. M. Hanif and L. Prevost, "Text detection and localization in complex scene images using constrained AdaBoost algorithm," in Proc. 10th Int. Conf. Document Anal. Recognit., Jul. 2009, pp. 1-5.
6. L. Tang and J. R. Kender, "A unified text extraction method for instructional videos," in Proc. IEEE Int. Conf. Image Process., vol. 3. Sep. 2005, pp. 11-14.
7. D. Chen, J.-M. Odobez, and H. Bourlard, "Text detection and recognition in images and video frames," Pattern Recognit., vol. 37, no. 3, pp. 595-608, 2004. (Pubitemid 38003096)
8. J. Gllavata, E. Qeli, and B. Freisleben, "Detecting text in videos using fuzzy clustering ensembles," in Proc. 8th IEEE Int. Symp. Multimedia, Dec. 2006, pp. 283-290.
9. X. Chen and A. L. Yuille, "Detecting and reading text in natural scenes," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 2. Jun./Jul. 2004, pp. II-366-II-373.
10. M. R. Lyu, J. Song, and M. Cai, "A comprehensive method for multilingual video text detection, localization, and extraction," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 2, pp. 243-255, Feb. 2005. (Pubitemid 40265948)
11. Y. Liu, H. Lu, X. Xue, and Y.-P. Tan, "Effective video text detection using line features," in Proc. 8th Control, Autom., Robot., Vis. Conf., Dec. 2004, pp. 1528-1532. (Pubitemid 40893787)
12. P. Dubey, "Edge based text detection for multi-purpose application," in Proc. 8th Int. Conf. Signal Process., vol. 4. 2006.
13. J. Zhou, L. Xu, B. Xiao, R. Dai, and S. Si, "A robust system for text extraction in video," in Proc. Int. Conf. Mach. Vis., Dec. 2007, pp. 119-124.
14. H. Tran, A. lux, T. H. L. Nguyen, and A. Boucher, "A novel approach for text detection in images using structural features," in Proc. 3rd Int. Conf. Adv. Pattern Recognit., 2005, pp. 627-635. (Pubitemid 41520606)
15. Y.-F. Pan, X. Huo, and C.-L. Liu, "A hybrid approach to detect and localize texts in natural scene images," IEEE Trans. Image Process., vol. 20, no. 3, pp. 800-813, Mar. 2010.
16. D. Chen, J. Luettin, and K. Shearer, "A survey of text detection and recognition in images and videos," Institute Dalle Molled Intelligence Perceptive (IDIAP), Martigny, Switzerland, Res. Rep. IDIAP-RR 00-38, 2000.
17. K. Jung, K. I. Kim, and A. K. Jain, "Text information extraction in images and video: A survey," Pattern Recognit., vol. 37, no. 5, pp. 977-997, 2004. (Pubitemid 38473840)
18. J. Zhang and R. Kasturi, "Extraction of text objects in video documents: Recent progress," in Proc. 8th IAPR Int. Workshop Document Anal. Syst., Sep. 2008, pp. 5-17.
19. W. Kim and C. Kim, "A new approach for overlay text detection and extraction from complex video scene," IEEE Trans. Image Process., vol. 18, no. 2, pp. 401-411, Feb. 2009.
20. X. Zhao, K.-H. Lin, Y. Fu, Y. Hu, Y. Liu, and T. S. Huang, "Text from corners: A novel approach to detect text and caption in videos," IEEE Trans. Image Process., vol. 20, no. 3, pp. 790-799, Mar. 2011.
21. C. Yi and Y. Tian, "Text string detection from natural scenes by structure-based partition and grouping," IEEE Trans. Image Process., vol. 20, no. 9, pp. 2594-2605, Sep. 2011.
22. P. Shivakumara, T. Q. Phan, and C. L. Tan, "A Laplacian approach to multi-oriented text detection in video," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 2, pp. 412-419, Feb. 2011.
23. Z. Tu, X. Chen, A. L. Yuille, and S.-C. Zhu, "Image parsing: Unifying segmentation, detection, and recognition," Int. J. Comput. Vis., vol. 63, no. 2, pp. 113-140, 2005. (Pubitemid 40536818)
24. C. Mancas-thillou and B. Gosselin, "Color text extraction with selective metric-based clustering," Comput. Vis. Image Understand., vol. 107, nos. 1-2, pp. 97-107, 2007. (Pubitemid 46829949)
25. J. Zhang and R. Kasturi, "Text detection using edge gradient and graph spectrum," in Proc. 20th Int. Conf. Pattern Recognit., Aug. 2010, pp. 3979-3982.
26. K. Wang and S. Belongie, "Word spotting in the wild," in Proc. Eur. Conf. Comput. Vis., 2010, pp. 591-604.
27. B. Epshtein, E. Ofek, and Y. Wexler, "Detecting text in natural scenes with stroke width transform," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 2963-2970.
28. J. Zhang and R. Kasturi, "Character energy and link energy-based text extraction in scene images," in Proc. Asian Conf. Comput. Vis., 2011, pp. 308-320.
29. P. F. Felzenszwalb and D. P. Huttenlocher, "Pictorial structures for object recognition," Int. J. Comput. Vis., vol. 61, no. 1, pp. 55-79, 2005.
30. D. Marr and E. Hildreth, "Theory of edge detection," Proc. Roy. Soc. London B, vol. 207, no. 1167, pp. 187-217, 1980. (Pubitemid 10103608)
31. R. C. Prim, "Shortest connection networks and some generalizations," Bell Syst. Tech. J., vol. 36, no. 6, pp. 1389-1401, 1957.
32. Datasets-Algoval-University of Essex. [Online]. Available: http://algoval.essex.ac.uk/icdar/Datasets.html, accessed Jul. 16, 2014.
33. ICDAR 2005 Competitions: Text Locating-Algoval. [Online]. Available: http://algoval.essex.ac.uk:8080/icdar2005/ index.jsp?page=textlocate.html, accessed Jul. 16, 2014.
34. Microsoft Text Detection Database. [Online]. Available: http://research.microsoft.com/en-us/um/people/eyalofek/textdetectiondatabase. zip, accessed Jul. 16, 2014.
35. R. Kasturi et al., "Framework for performance evaluation of face, text, and vehicle detection and tracking in video: Data, metrics, and protocol," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 319-336, Feb. 2009.
36. S. M. Lucas, A. Panaretos, L. Sosa, A. Tang, S. Wong, and R. Young, "ICDAR 2003 robust reading competitions," in Proc. 7th Int. Conf. Document Anal. Recognit., vol. 2. 2003, p. 682.
37. S. M. Lucas, "ICDAR 2005 text locating competition results," in Proc. 8th Int. Conf. Document Anal. Recognit., Sep. 2005, pp. 80-84. (Pubitemid 46442295)
38. Z. Liu and S. Sarkar, "Robust outdoor text detection using text intensity and shape features," in Proc. 19th Int. Conf. Pattern Recognit., Dec. 2008, pp. 1-4.