Characterness: An indicator of text in the wild

IEEE Transactions on Image Processing

Volumn 23, Issue 4, 2014, Pages 1666-1677

  Li, Yao ^a   Jia, Wenjing ^b   Shen, Chunhua ^a   Van Den Hengel, Anton ^a  

^a UNIVERSITY OF ADELAIDE   (Australia)

^b UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

Characterness; saliency detection; scene text detection

Indexed keywords

BAYESIAN NETWORKS; MARKOV PROCESSES;

BAYESIAN METHODS; BOTTOM UP APPROACH; CHARACTERNESS; MARKOV RANDOM FIELD MODEL; RESEARCH PROBLEMS; SALIENCY DETECTION; SCENE TEXT; STATE-OF-THE-ART METHODS;

DETECTORS;

EID: 84896116821     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2302896     Document Type: Article

References (66)

1. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998. (Pubitemid 128742001)
2. N. D. B. Bruce and J. K. Tsotsos, "Saliency based on information maximization," in Proc. Adv. Neural Inf. Process. Syst., 2005, pp. 155-162.
3. X. Hou and L. Zhang, "Saliency detection: A spectral residual approach," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2007, pp. 1-8.
4. T. Judd, K. A. Ehinger, F. Durand, and A. Torralba, "Learning to predict where humans look," in Proc. IEEE 12th Int. Conf. Comput. Vis., Sep. 2009, pp. 2106-2113.
5. X. Li, Y. Li, C. Shen, A. Dick, and A. van den Hengel, "Contextual hypergraph modeling for salient object detection," in Proc. IEEE Int. Conf. Comput. Vis., Oct. 2013, pp. 3328-3335.
6. Y. Zhai and M. Shah, "Visual attention detection in video sequences using spatiotemporal cues," in Proc. 14th Annu. ACM Int. Conf. Multimedia , 2006, pp. 815-824. (Pubitemid 47113641)
7. R. Achanta, S. Hemami, F. Estrada, and S. Susstrunk, "Frequency- tuned salient region detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2009, pp. 1597-1604.
8. Y. Wei, F. Wen, W. Zhu, and J. Sun, "Geodesic saliency using background priors," in Proc. Eur. Conf. Comput. Vis., 2012, pp. 29-42.
9. J. Feng, Y. Wei, L. Tao, C. Zhang, and J. Sun, "Salient object detection by composition," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 1028-1035.
10. M.-M. Cheng, G.-X. Zhang, N. J. Mitra, X. Huang, and S.-M. Hu, "Global contrast based salient region detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 409-416.
11. T. Liu, Z. Yuan, J. Sun, J. Wang, N. Zheng, X. Tang, et al., "Learning to detect a salient object," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 2, pp. 353-367, Feb. 2011.
12. D. A. Klein and S. Frintrop, "Center-surround divergence of feature statistics for salient object detection," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 2214-2219.
13. B. Alexe, T. Deselaers, and V. Ferrari, "What is an object?" in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 73-80.
14. F. Perazzi, P. Krahenbuhl, Y. Pritch, and A. Hornung, "Saliency filters: Contrast based filtering for salient region detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 733-740.
15. X. Shen and Y. Wu, "A unified approach to salient object detection via low rank matrix recovery," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 853-860.
16. H. Jiang, J. Wang, Z. Yuan, T. Liu, N. Zheng, and S. Li, "Automatic salient object segmentation based on context and shape prior," Brit. Mach. Vis. Conf., vol. 3, no. 4, pp. 1-12, 2011.
17. S. Goferman, L. Zelnik-Manor, and A. Tal, "Context-aware saliency detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 2376-2383.
18. K.-Y. Chang, T.-L. Liu, H.-T. Chen, and S.-H. Lai, "Fusing generic objectness and visual saliency for salient object detection," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 914-921.
19. E. Rahtu, J. Kannala, M. Salo, and J. Heikkilä, "Segmenting salient objects from images and videos," in Proc. Eur. Conf. Comput. Vis., 2010, pp. 366-379.
20. Y. Ding, J. Xiao, and J. Yu, "Importance filtering for image retargeting," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 89-96.
21. J. Sun and H. Ling, "Scale and object aware image retargeting for thumbnail browsing," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 1511-1518.
22. G. Sharma, F. Jurie, and C. Schmid, "Discriminative spatial saliency for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 3506-3513.
23. M. Cerf, E. P. Frady, and C. Koch, "Faces and text attract gaze independent of the task: Experimental data and computer model," J. Vis., vol. 9, no. 12, pp. 1-27, 2009.
24. Q. Sun, Y. Lu, and S. Sun, "A visual attention based approach to text extraction," in Proc. IEEE 20th Int. Conf. Pattern Recognit., Aug. 2010, pp. 3991-3995.
25. A. Shahab, F. Shafait, A. Dengel, and S. Uchida, "How salient is scene text?" in Proc. IEEE 10th Int. Workshop. Document Anal. Syst., Mar. 2012, pp. 317-321.
26. Q. Meng and Y. Song, "Text detection in natural scenes with salient region," in Proc. IEEE 10th Int. Workshop Document Anal. Syst., Mar. 2012, pp. 384-388.
27. S. Uchida, Y. Shigeyoshi, Y. Kunishige, and Y. Feng, "A keypoint-based approach toward scenery character detection," in Proc. IEEE Int. Conf. Doc. Anal. Recognit., Sep. 2011, pp. 819-823.
28. D. Hoiem, A. A. Efros, and M. Hebert, "Recovering occlusion boundaries from an image," Int. J. Comput. Vis., vol. 91, no. 3, pp. 328-346, 2011.
29. P. Arbelaez, B. Hariharan, C. Gu, S. Gupta, L. D. Bourdev, and J. Malik, "Semantic segmentation using regions and parts," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 3378-3385.
30. A. Prest, C. Leistner, J. Civera, C. Schmid, and V. Ferrari, "Learning object class detectors from weakly annotated video," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 3282-3289.
31. Y. Boykov, O. Veksler, and R. Zabih, "Fast approximate energy minimization via graph cuts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 11, pp. 1222-1239, Nov. 2001. (Pubitemid 33137959)
32. J.-J. Lee, P.-H. Lee, S.-W. Lee, A. L. Yuille, and C. Koch, "Adaboost for text detection in natural scene," in Proc. IEEE Int. Conf. Document Anal. Recognit., Sep. 2011, pp. 429-434.
33. X. Chen and A. L. Yuille, "Detecting and reading text in natural scenes," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jul. 2004, pp. 366-373.
34. B. Epshtein, E. Ofek, and Y. Wexler, "Detecting text in natural scenes with stroke width transform," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 2963-2970.
35. J. Zhang and R. Kasturi, "Text detection using edge gradient and graph spectrum," in Proc. IEEE 20th Int. Conf. Pattern Recognit., Aug. 2010, pp. 3979-3982.
36. J. Zhang and R. Kasturi, "Character energy and link energy-based text extraction in scene images," in Proc. Asian Conf. Comput. Vis., 2010, pp. 308-320.
37. C. Yi and Y. Tian, "Text string detection from natural scenes by structure-based partition and grouping," IEEE Trans. Image Process., vol. 20, no. 9, pp. 2594-2605, Apr. 2011.
38. H. Chen, S. S. Tsai, G. Schroth, D. M. Chen, R. Grzeszczuk, and B. Girod, "Robust text detection in natural images with edge-enhanced maximally stable extremal regions," in Proc. 18th IEEE Int. Conf. Image Process., Sep. 2011, pp. 2609-2612.
39. Y. Li and H. Lu, "Scene text detection via stroke width," in Proc. IEEE Int. Conf. Pattern Recognit., Nov. 2012, pp. 681-684.
40. Y. Li, C. Shen, W. Jia, and A. van den Hengel, "Leveraging surrounding context for scene text detection," in Proc. IEEE Int. Conf. Image Process., Feb. 2013, pp. 2264-2268.
41. L. Neumann and J. Matas, "A method for text localization and recognition in real-world images," in Proc. Asian Conf. Comput. Vis., 2010, pp. 770-783.
42. L. Neumann and J. Matas, "Real-time scene text localization and recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 3538-3545.
43. Y.-F. Pan, X. Hou, and C.-L. Liu, "A hybrid approach to detect and localize texts in natural scene images," IEEE Trans. Image Process., vol. 20, no. 3, pp. 800-813, Mar. 2011.
44. C. Yao, X. Bai, W. Liu, Y. Ma, and Z. Tu, "Detecting texts of arbitrary orientations in natural images," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 1083-1090.
45. C. Yi and Y. Tian, "Localizing text in scene images by boundary clustering, stroke segmentation, and string fragment classification," IEEE Trans. Image Process., vol. 21, no. 9, pp. 4256-4268, Sep. 2012.
46. H. Koo and D. Kim, "Scene text detection via connected component clustering and non-text filtering," IEEE Trans. Image Process., vol. 22, no. 6, pp. 2296-2305, Jun. 2013.
47. W. Huang, Z. Lin, J. Yang, and J. Wang, "Text localization in natural images using stroke feature transform and text covariance descriptors," in Proc. IEEE Int. Conf. Comput. Vis., Aug. 2013, pp. 1241-1248.
48. J. Matas, O. Chum, M. Urban, and T. Pajdla, "Robust wide baseline stereo from maximally stable extremal regions," in Proc. Brit. Mach. Vis. Conf., 2002, pp. 384-393.
49. M. Donoser and H. Bischof, "Efficient maximally stable extremal region (MSER) tracking," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2006, pp. 553-560. (Pubitemid 44931375)
50. P.-E. Forssén and D. G. Lowe, "Shape descriptors for maximally stable extremal regions," in Proc. IEEE 11th Int. Conf. Comput. Vis., Oct. 2007, pp. 1-8.
51. L. Neumann and J. Matas, "Text localization in real-world images using efficiently pruned exhaustive search," in Proc. IEEE Int. Conf. Document Anal. Recognit., Sep. 2011, pp. 687-691.
52. S. Tsai, V. Parameswaran, J. Berclaz, R. Vedantham, R. Grzeszczuk, and B. Girod, "Design of a text detection system via hypothesis generation and verification," in Proc. Asian Conf. Comput. Vis., 2012, pp. 1-12.
53. K. Mikolajczyk, T. Tuytelaars, C. Schmid, A. Zisserman, J. Matas, F. Schaffalitzky, et al., "A comparison of affine region detectors," Int. J. Comput. Vis., vol. 65, nos. 1-2, pp. 43-72, 2005. (Pubitemid 43281159)
54. K. He, J. Sun, and X. Tang, "Guided image filtering," in Proc. Eur. Conf. Comput. Vis., 2010, pp. 1-14.
55. N. B. Ali Mosleh and A. B. Hamza, "Image text detection using a bandlet-based edge detector and stroke width transform," in Proc. Brit. Mach. Vis. Conf., 2012, pp. 1-12.
56. J. Pan, Y. Chen, B. Anderson, P. Berkhin, and T. Kanade, "Effectively leveraging visual context to detect texts in natural scenes," in Proc. Asian Conf. Comput. Vis., 2012, pp. 1-20.
57. Z. Liu and S. Sarkar, "Robust outdoor text detection using text intensity and shape features," in Proc. IEEE 19th Int. Conf. Pattern Recognit., Dec. 2008, pp. 1-4.
58. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2005, pp. 886-893. (Pubitemid 43897286)
59. Y. Boykov and M.-P. Jolly, "Interactive graph cuts for optimal boundary and region segmentation of objects in N-D images," in Proc. 8th IEEE Int. Conf. Comput. Vis., Jul. 2001, pp. 105-112. (Pubitemid 32794944)
60. D. Küttel and V. Ferrari, "Figure-ground segmentation by transferring window masks," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 558-565.
61. A. Borji, D. N. Sihite, and L. Itti, "Salient object detection: A benchmark," in Proc. Eur. Conf. Comput. Vis., 2012, pp. 414-429.
62. A. Rosenfeld and D. Weinshall, "Extracting foreground masks towards object recognition," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 1371-1378.
63. S. M. Lucas, A. Panaretos, L. Sosa, A. Tang, S. Wong, and R. Young, "ICDAR 2003 robust reading competitions," in Proc. IEEE Int. Conf. Document Anal. Recognit., Jun. 2003, pp. 682-687.
64. A. Shahab, F. Shafait, and A. Dengel, "ICDAR 2011 robust reading competition challenge 2: Reading text in scene images," in Proc. IEEE Int. Conf. Document Anal. Recognit., Feb. 2011, pp. 1491-1496.
65. S. M. Lucas, "ICDAR 2005 text locating competition results," in Proc. IEEE 8th Int. Conf. Document Anal. Recognit., Sep. 2005, pp. 80-85.
66. C. Wolf and J.-M. Jolion, "Object count/area graphs for the evaluation of object detection and segmentation algorithms," Int. J. Document Anal. Recognit., vol. 8, no. 4, pp. 280-296, 2006. (Pubitemid 44251802)