Principal Component 2-D Long Short-Term Memory for Font Recognition on Single Chinese Characters

IEEE Transactions on Cybernetics

Volumn 46, Issue 3, 2016, Pages 756-765

  Tao, Dapeng ^a   Lin, Xu ^b   Jin, Lianwen ^b   Li, Xuelong ^c  

^a YUNNAN UNIVERSITY   (China)

^b SOUTH CHINA UNIVERSITY OF TECHNOLOGY   (China)

^c XI AN INSTITUTE OF OPTICS AND PRECISION MECHANICS   (China)

Author keywords

Font recognition; long short term memory; neurodynamic models; optical character recognition; recurrent neural networks (RNNs)

Indexed keywords

BRAIN; CHARACTER RECOGNITION; CONVOLUTION; OPTICAL CHARACTER RECOGNITION; RECURRENT NEURAL NETWORKS;

CHINESE CHARACTERS; FONT RECOGNITION; INTELLIGENT APPLICATIONS; LONG SHORT TERM MEMORY; PRINCIPAL COMPONENTS; SCAN DIRECTION; SEQUENCE CLASSIFICATION; STATE OF THE ART;

PRINCIPAL COMPONENT ANALYSIS;

EID: 84926214098     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2015.2414920     Document Type: Article

References (59)

1. A. A. Ahmed and I. Traoré, "Biometric recognition based on free-text keystroke dynamics," IEEE Trans. Cybern., vol. 44, no. 4, pp. 458-472, Apr. 2014.
2. Z. Bai, G.-B. Huang, D. Wang, H. Wang, and M. B. Westover, "Sparse extreme learning machine for classification," IEEE Trans. Cybern., vol. 44, no. 10, pp. 1858-1870, Oct. 2014.
3. A. Bauer, N. Görnitz, F. Biegler, K.-R. Müller, and M. Kloft, "Efficient algorithms for exact inference in sequence labeling SVMs," IEEE Trans. Neural Netw. Learn. Syst., vol. 25, no. 5, pp. 870-881, May 2014.
4. D. Cai and X. He, "Manifold adaptive experimental design for text categorization," IEEE Trans. Knowl. Data Eng., vol. 24, no. 4, pp. 707-719, Apr. 2012.
5. A. Cichocki and R. Unbehauen, Neural Networks for Optimization and Signal Processing. Chichester, U.K.: Wiley, Nov. 1994.
6. J. Chen and J. Yang, "Robust subspace segmentation via low-rank representation," IEEE Trans. Cybern., vol. 44, no. 8, pp. 1432-1445, Aug. 2014.
7. Y. Chen, J. Zhang, D. Cai, W. Liu, and X. He, "Nonnegative local coordinate factorization for image representation," IEEE Trans. Image Process., vol. 22, no. 3, pp. 969-979, Mar. 2013.
8. L. Cheng, Z.-G. Hou, M. Tan, and X. Wang, "Necessary and sufficient conditions for consensus of double-integrator multi-agent systems with measurement noises," IEEE Trans. Autom. Control, vol. 56, no. 8, pp. 1958-1963, Aug. 2011.
9. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., vol. 1. San Diego, CA, USA, 2005, pp. 886-893.
10. R. Diao, F. Chao, T. Peng, N. Snooke, and Q. Shen, "Feature selection inspired classifier ensemble reduction," IEEE Trans. Cybern., vol. 44, no. 8, pp. 1259-1268, Aug. 2014.
11. X.-Q. Ding, C. Li, and W. Tao, "Character independent font recognition on a single Chinese character," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 2, pp. 195-204, Feb. 2007.
12. J. L. Elman, "Finding structure in time," Cogn. Sci., vol. 14, no. 2, pp. 179-211, 1990.
13. R. A. Fisher, "The use of multiple measurements in taxonomic problems," Ann. Eugen., vol. 7, no. 2, pp. 179-188, 1936.
14. W. Fu, M. Johnston, and M. Zhang, "Low-level feature extraction for edge detection using genetic programming," IEEE Trans. Cybern., vol. 44, no. 8, pp. 1459-1472, Aug. 2014.
15. H. Fujisawa, "Forty years of research in character and document recognition - An industrial perspective," Pattern Recognit., vol. 41, no. 8, pp. 2435-2446, 2008.
16. E. S. García-Treviño and J. A. Barria, "Structural generative descriptions for time series classification," IEEE Trans. Cybern., vol. 44, no. 10, pp. 1978-1991, Oct. 2014.
17. A. Graves, S. Fernandez, and J. Schmidhuber, "Multidimensional recurrent neural networks," in Proc. Int. Conf. Artif. Neural Netw., Porto, Portugal, Sep. 2007, pp. 549-558.
18. A. Graves and J. Schmidhuber, "Offline handwriting recognition with multidimensional recurrent neural networks," in Proc. Adv. Neural Inf. Process. Syst., Whistler, BC, Canada, 2009, pp. 1-8.
19. A. Graves et al., "A novel connectionist system for unconstrained handwriting recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 5, pp. 855-868, May 2009.
20. B. Hammer, "On the approximation capability of recurrent neural networks," Neurocomputing, vol. 31, nos. 1-4, pp. 107-123, 2000.
21. S. Hochreiter and J. Schmidhuber, "Long short-term memory," Neural Comput., vol. 9, no. 8, pp. 1735-1780, 1997.
22. H. Hotelling, "Analysis of a complex of statistical variables into principal components," J. Educ. Psychol., vol. 24, no. 6, pp. 417-441, 1933.
23. S.-C. Huang and B.-H. Do, "Radial basis function based neural network for motion detection in dynamic scenes," IEEE Trans. Cybern., vol. 44, no. 1, pp. 114-125, Jan. 2014.
24. B. Hyun, P. Kabamba, and A. Girard, "Optimal classification by mixedinitiative nested thresholding," IEEE Trans. Cybern., vol. 45, no. 1, pp. 29-39, Jan. 2015.
25. B. Jiang, M. Valstar, B. Martínez, and M. Pantic, "A dynamic appearance descriptor approach to facial actions temporal modeling," IEEE Trans. Cybern., vol. 44, no. 2, pp. 161-174, Feb. 2014.
26. F. Kimura, K. Takashina, S. Tsuruoka, and Y. Miyake, "Modified quadratic discriminant functions and the application to Chinese character recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-9, no. 1, pp. 149-153, Jan. 1987.
27. L. I. Kuncheva and W. J. Faithfull, "PCA feature extraction for change detection in multidimensional unlabeled data," IEEE Trans. Neural Netw. Learn. Syst., vol. 25, no. 1, pp. 69-80, Jan. 2014.
28. L. Laporte, R. Flamary, S. Canu, S. Dejean, and J. Mothe, "Nonconvex regularizations for feature selection in ranking with sparse SVM," IEEE Trans. Neural Netw. Learn. Syst., vol. 25, no. 6, pp. 1118-1130, Jun. 2014.
29. C.-L. Liu, F. Yin, D.-H. Wang, and Q.-F. Wang, "Online and offline handwritten Chinese character recognition: Benchmarking on new databases," Pattern Recognit., vol. 46, no. 1, pp. 155-162, 2013.
30. L. Liu, M. Yu, and L. Shao, "Multiview alignment hashing for efficient image search," IEEE Trans. Image Process., vol. 24, no. 3, pp. 956-966, Mar. 2015.
31. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
32. S. B. Moussa, A. Zahour, A. Benabdelhafid, and A. M. Alimi, "New features using fractal multi-dimensions for generalized Arabic font recognition," Pattern Recognit. Lett., vol. 31, no. 5, pp. 361-371, 2010.
33. T. Ojala, M. Pietikainen, and T. Maenpaa, "Multiresolution gray-scale and rotation invariant texture classification with local binary patterns," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 971-987, Jul. 2002.
34. L. Peng et al., "Multi-font printed Mongolian document recognition system," Int. J. Doc. Anal. Recognit., vol. 13, no. 2, pp. 93-106, 2010.
35. M. Perez-Ilzarbe, "New discrete-time recurrent neural network proposal for quadratic optimization with general linear constraints," IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 2, pp. 322-328, Feb. 2013.
36. A. H. Phan, P. Tichavský, and A. Cichocki, "Fast alternating LS algorithms for high order CANDECOMP/PARAFAC tensor factorizations," IEEE Trans. Signal Process., vol. 61, no. 19, pp. 4834-4846, Oct. 2013.
37. P. Qi and X. Hu, "Learning nonlinear statistical regularities in natural images by modeling the outer product of image intensities," Neural Comput., vol. 26, no. 4, pp. 693-711, Apr. 2014.
38. F. Slimane, S. Kanoun, J. Hennebert, A. M. Alimi, and R. Ingold, "A study on font-family and font-size recognition applied to Arabic word images at ultra-low resolution," Pattern Recognit. Lett., vol. 34, no. 2, pp. 209-218, 2013.
39. L. Shao, L. Liu, and X. Li, "Feature learning for image classification via multiobjective genetic programming," IEEE Trans. Neural Netw. Learn. Syst., vol. 25, no. 7, pp. 1359-1371, Jul. 2014.
40. L. Shao, X. Zhen, D. Tao, and X. Li, "Spatio-temporal Laplacian pyramid coding for action recognition," IEEE Trans. Cybern., vol. 44, no. 6, pp. 817-827, Jun. 2014.
41. U. Srinivas, N. M. Nasrabadi, and V. Monga, "Graph-based sensor fusion for classification of transient acoustic signals," IEEE Trans. Cybern., vol. 45, no. 3, pp. 576-587, Mar. 2015.
42. D. Stewart, R. Seymour, A. Pass, and J. Ming, "Robust audio-visual speech recognition under noisy audio-video conditions," IEEE Trans. Cybern., vol. 44, no. 2, pp. 175-184, Feb. 2014.
43. H. Tamura, S. Mori, and T. Yamawaki, "Textural features corresponding to visual perception," IEEE Trans. Syst., Man, Cybern., vol. 8, no. 6, pp. 460-473, Jun. 1978.
44. D. Tao, L. Jin, S. Zhang, Z. Yang, and Y. Wang, "Sparse discriminative information preservation for Chinese character font categorization," Neurocomputing, vol. 129, pp. 159-167, Apr. 2014.
45. D. Tao, L. Jin, Y. Wang, and X. Li, "Person reidentification by minimum classification error-based KISS metric learning," IEEE Trans. Cybern., vol. 45, no. 2, pp. 242-252, Feb. 2015.
46. D. Tao, X. Li, X. Wu, and S. J. Maybank, "General tensor discriminant analysis and Gabor features for gait recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 10, pp. 1700-1715, Oct. 2007.
47. D. Tao, X. Li, X. Wu, and S. J. Maybank, "Geometric mean for subspace selection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 260-274, Feb. 2009.
48. Y. Xia, T. Chen, and J. Shan, "A novel iterative method for computing generalized inverse," Neural Comput., vol. 26, no. 2, pp. 449-465, Feb. 2014.
49. Y. Xia, C. Sun, and W. Zheng, "Discrete-time neural network for fast solving large linear L1 estimation problems and its application to image restoration," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 5, pp. 812-820, May 2012.
50. J. Xiao, Z. Zeng, and A. Wu, "New criteria for exponential stability of delayed recurrent neural networks," Neurocomputing, vol. 134, pp. 182-188, Jun. 2014.
51. C. Xu, D. Tao, and C. Xu, "Large-margin multi-view information bottleneck," IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 8, pp. 1559-1572, Aug. 2014.
52. Y. Yang, Q. He, and X. Hu, "A compact neural network for training support vector machines," Neurocomputing, vol. 86, pp. 193-198, Jun. 2012.
53. J. Yu, Y. Rui, Y. Tang, and D. Tao, "High-order distance-based multiview stochastic learning in image classification," IEEE Trans. Cybern., vol. 44, no. 12, pp. 2431-2442, Dec. 2014.
54. Z. Zeng, T. Huang, and W. Zheng, "Multistability of recurrent neural networks with time-varying delays and the piecewise linear activation function," IEEE Trans. Neural Netw., vol. 21, no. 8, pp. 1371-1377, Aug. 2010.
55. H. Zhang, D.-H. Wang, and C.-L. Liu, "Character confidence based on N-best list for keyword spotting in online Chinese handwritten documents," Pattern Recognit., vol. 47, no. 5, pp. 1880-1890, 2014.
56. L. Zhang, X. Zhen, and L. Shao, "Learning object-to-class kernels for scene classification," IEEE Trans. Image Process., vol. 23, no. 8, pp. 3241-3253, Aug. 2014.
57. Y. Zhu, T. Tan, and Y. Wang, "Font recognition based on global texture analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 10, pp. 1192-1200, Oct. 2001.
58. F. Zhu and L. Shao, "Weakly-supervised cross-domain dictionary learning for visual recognition," Int. J. Comput. Vis., vol. 109, nos. 1-2, pp. 42-59, Aug. 2014.
59. A. Zramdini and R. Ingold, "Optical font recognition using typographical features," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 8, pp. 877-882, Aug. 1998.