Script identification in the wild via discriminative convolutional neural network

Pattern Recognition

Volumn 52, Issue , 2016, Pages 448-458

  Shi, Baoguang ^a   Bai, Xiang ^a   Yao, Cong ^a  

^a HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

Author keywords

Convolutional neural network; Dataset; Discriminative clustering; Mid level representation; Script identification

Indexed keywords

CONVOLUTION; NEURAL NETWORKS;

CONVOLUTIONAL NEURAL NETWORK; DATASET; DISCRIMINATIVE CLUSTERING; MID-LEVEL REPRESENTATION; SCRIPT IDENTIFICATION;

IMAGE SEGMENTATION;

EID: 84949254659     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2015.11.005     Document Type: Article

References (59)

1. Google Street View. (http://maps.google.com).
2. Icdar 2015 Competition on Video Script Identification (CVSI-2015). (http://www.ict.griffith.edu.au/cvsi2015/).
3. T. Ahonen, A. Hadid, and M. Pietikäinen Face description with local binary patterns: application to face recognition IEEE Trans. Pattern Anal. Mach. Intell. 28 12 2006 2037 2041
4. V. Alabau, A. Sanchis, and F. Casacuberta Improving on-line handwritten recognition in interactive machine translation Pattern Recognit. 47 3 2014 1217 1228
5. S. Basu, N. Das, R. Sarkar, M. Kundu, M. Nasipuri, and D.K. Basu A novel framework for automatic sorting of postal documents with multi-script address blocks Pattern Recognit. 43 10 2010 3507 3521
6. I. Bazzi, R.M. Schwartz, and J. Makhoul An omnifont open-vocabulary OCR system for English and Arabic IEEE Trans. Pattern Anal. Mach. Intell. 21 6 1999 495 504
7. A. Busch, W.W. Boles, and S. Sridharan Texture for script identification IEEE Trans. Pattern Anal. Mach. Intell. 27 11 2005 1720 1732
8. P.R. Cavalin, R. Sabourin, C.Y. Suen, and A. de Souza Britto Jr. Evaluation of incremental learning algorithms for HMM in the recognition of alphanumeric characters Pattern Recognit. 42 12 2009 3241 3253
9. D. Chen, J. Odobez, and H. Bourlard Text detection, recognition in images and video frames Pattern Recognit. 37 3 2004 595 608
10. A. Coates, A.Y. Ng, H. Lee, An analysis of single-layer networks in unsupervised feature learning, in: Proceedings of AISTATS, 2011, pp. 215-223.
11. T. Cour, C. Jordan, E. Miltsakaki, B. Taskar, Movie/script: alignment and parsing of video and text transcription, in: Proceedings of ECCV, 2008.
12. N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, in: Proceedings of CVPR, 2005.
13. M. Everingham, L.J.V. Gool, C.K.I. Williams, J.M. Winn, and A. Zisserman The Pascal visual object classes (VOC) challenge Int. J. Comput. Vis. 88 2 2010 303 338
14. D. Ghosh, T. Dube, and A.P. Shivaprasad Script recognition - a review IEEE Trans. Pattern Anal. Mach. Intell 32 12 2010 2142 2161
15. M.M. Haji, T.D. Bui, and C.Y. Suen Removal of noise patterns in handwritten images using expectation maximization and fuzzy inference systems Pattern Recognit. 45 12 2012 4237 4249
16. H. Hase, T. Shinokawa, M. Yoneda, and C.Y. Suen Character string extraction from color documents Pattern Recognit. 34 7 2001 1349 1365
17. J. He, J. Feng, X. Liu, T. Cheng, T. Lin, H. Chung, S. Chang, Mobile product search with bag of hash bits and boundary reranking, in: Proceedings of CVPR, 2012.
18. K. He, X. Zhang, S. Ren, J. Sun, Spatial pyramid pooling in deep convolutional networks for visual recognition, in: Proceedings of ECCV, 2014.
19. P.S. Hiremath, and S. Shivashankar Wavelet based co-occurrence histogram features for texture classification with an application to script identification in a document image Pattern Recognit. Lett. 29 9 2008 1182 1189
20. J. Hochberg, P. Kelly, T. Thomas, and L. Kerns Automatic script identification from document images using cluster-based templates IEEE Trans. Pattern Anal. Mach. Intell. 19 2 1997 176 181
21. D.H. Hubel, and T.N. Wiesel Receptive fields, binocular interaction and functional architecture in the cats visual cortex J. Physiol. 160 1 1962 106 154
22. L.G. i Bigorda, D. Karatzas, Multi-script text extraction from natural scenes, in: Proceedings of ICDAR, 2013.
23. A.K. Jain, and B. Yu Automatic text location in images and video frames Pattern Recognit. 31 12 1998 2055 2076
24. G.D. Joshi, S. Garg, and J. Sivaswamy A generalised framework for script identification Int. J. Doc. Anal. Recognit. 10 2 2007 55 68
25. K. Jung, K.I. Kim, and A.K. Jain Text information extraction in images and video: a survey Pattern Recognit. 37 5 2004 977 997
26. M. Khayyat, L. Lam, and C.Y. Suen Learning-based word spotting system for arabic handwritten documents Pattern Recognit. 47 3 2014 1021 1030
27. A. Krizhevsky, I. Sutskever, G.E. Hinton, Imagenet classification with deep convolutional neural networks, in: Proceedings of NIPS, 2012.
28. S. Lazebnik, C. Schmid, J. Ponce, Beyond bags of features: spatial pyramid matching for recognizing natural scene categories, in: Proceedings of CVPR, 2006.
29. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner Gradient-based learning applied to document recognition Proc. IEEE 86 11 1998 2278 2324
30. Y. LeCun, L. Bottou, G.B. Orr, K. Müller, Efficient backprop, in: Neural Networks: Tricks of the Trade, 2nd edition, 2012, pp. 9-48.
31. F. Li, P. Perona, A Bayesian Hierarchical model for learning natural scene categories, in: Proceedings of CVPR, 2005.
32. L. Li, R. Socher, F. Li, Towards total scene understanding: classification, annotation and segmentation in an automatic framework, in: Proceedings of CVPR, 2009.
33. D.G. Lowe Distinctive image features from scale-invariant keypoints Int. J. Comput. Vis. 60 2 2004 91 110
34. R. Manthalkar, P.K. Biswas, and B.N. Chatterji Rotation and scale invariant texture features using discrete wavelet packet transform Pattern Recognit. Lett. 24 14 2003 2455 2462
35. A. Mishra, K. Alahari, C.V. Jawahar, Scene text recognition using higher order language priors, in: Proceedings of BMVC, 2012.
36. V. Nair, G.E. Hinton, Rectified linear units improve restricted Boltzmann machines, in: Proceedings of ICML, 2010.
37. L. Neumann, J. Matas, A method for text localization and recognition in real-world images, in: Proceedings of ACCV, 2010.
38. X. Niu, and C.Y. Suen A novel hybrid CNN-SVM classifier for recognizing handwritten digits Pattern Recognit. 45 4 2012 1318 1325
39. P.B. Pati, and A.G. Ramakrishnan Word level multi-script identification Pattern Recognit. Lett. 29 9 2008 1218 1229
40. T.Q. Phan, P. Shivakumara, Z. Ding, S. Lu, C.L. Tan, Video script identification based on text lines, in: Proceedings of ICDAR, 2011.
41. J. Schenk, J. Lenz, and G. Rigoll Novel script line identification method for script normalization and feature extraction in on-line handwritten whiteboard note recognition Pattern Recognit. 42 12 2009 3383 3393
42. A. Shahab, F. Shafait, A. Dengel, ICDAR 2011 robust reading competition challenge 2: reading text in scene images, in: Proceedings of ICDAR, 2011.
43. B. Shi, C. Yao, C. Zhang, X. Guo, F. Huang, X. Bai, Automatic script identification in the wild, in: Proceedings of ICDAR, 2015.
44. C. Shi, C. Wang, B. Xiao, Y. Zhang, and S. Gao Scene text detection using graph model built upon maximally stable extremal regions Pattern Recognit. Lett. 34 2 2013 107 116
45. S. Singh, A. Gupta, A.A. Efros, Unsupervised discovery of mid-level discriminative patches, in: Proceedings of ECCV, 2012.
46. S. Sinha, U. Pal, B.B. Chaudhuri, Word-wise script identification from Indian documents, in: Proceedings of Workshop on DAS, 2004.
47. C. Strouthopoulos, N. Papamarkos, and A. Atsalakis Text extraction in complex color documents Pattern Recognit. 35 8 2002 1743 1758
48. T.N. Tan Rotation invariant texture features and their use in automatic script identification IEEE Trans. Pattern Anal. Mach. Intell. 20 7 1998 751 756
49. Y.Y. Tang, S. Lee, and C.Y. Suen Automatic document processing: a survey Pattern Recognit. 29 12 1996 1931 1952
50. A.H. Toselli, V. Romero, M.P.i. Gadea, and E. Vidal Multimodal interactive transcription of text images Pattern Recognit. 43 5 2010 1814 1825
51. A. Vedaldi, B. Fulkerson, VLFeat: An Open and Portable Library of Computer Vision Algorithms. (http://www.vlfeat.org/), 2008.
52. J. Wang, J. Yang, K. Yu, F. Lv, T.S. Huang, Y. Gong, Locality-constrained linear coding for image classification, in: Proceedings of CVPR, 2010.
53. K. Wang, S. Belongie, Word spotting in the wild, in: Proceedings of ECCV, 2010.
54. V. Wu, R. Manmatha, and E.M. Riseman Textfinder: an automatic system to detect and recognize text in images IEEE Trans. Pattern Anal. Mach. Intell 21 11 1999 1224 1229
55. C. Yao, X. Bai, and W. Liu A unified framework for multi-oriented text detection and recognition IEEE Trans. Image Process. 23 11 2014 4737 4749
56. C. Yao, X. Bai, B. Shi, W. Liu, Strokelets: a learned multi-scale representation for scene text recognition, in: Proceedings of CVPR, 2014.
57. C. Zhang, C. Yao, B. Shi, X. Bai, Automatic discrimination of text and non-text natural images, in: Proceedings of ICDAR, 2015.
58. D. Zhao, P. Shivakumara, S. Lu, C.L. Tan, New spatial-gradient-features for video script identification, in: Proceedings of Workshop on DAS, 2012.
59. Y. Zhong, K. Karu, and A.K. Jain Locating text in complex color images Pattern Recognit. 28 10 1995 1523 1535