Handwritten Character Recognition by Alternately Trained Relaxation Convolutional Neural Network

Proceedings of International Conference on Frontiers in Handwriting Recognition, ICFHR

Volumn 2014-December, Issue , 2014, Pages 291-296

  Wu, Chunpeng ^a   Fan, Wei ^a   He, Yuan ^a   Sun, Jun ^a   Naoi, Satoshi ^a  

^a Fujitsu Research and Development Center Co Ltd   (China)

Author keywords

alternate training; convolutional neural network; handwritten character recognition; relaxation convolution

Indexed keywords

CONVOLUTION; DEEP LEARNING; NEURAL NETWORKS; SPEECH RECOGNITION;

CHINESE HANDWRITING; CONVOLUTIONAL KERNEL; CONVOLUTIONAL NEURAL NETWORK; HAND WRITTEN CHARACTER RECOGNITION; HANDWRITING RECOGNITION; LEARNING METHODS; TRAINING PROCEDURES; VISUAL RECOGNITION;

CHARACTER RECOGNITION;

EID: 84942244321     PISSN: 21676445     EISSN: 21676453     Source Type: Conference Proceeding    
DOI: 10.1109/ICFHR.2014.56     Document Type: Conference Paper

References (34)

1. D. Keysers, T. Deselaers, C. Gollan and H. Ney. Deformation models for image recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2007
2. Y. Mizukami, K. Yamaguchi, J. Warrell, P. Li and S. Prince. CUDA implementation of deformable pattern recognition and its application to MNIST handwritten digit database. IEEE International Conference on Pattern Recognition (ICPR), 2010
3. F. Lauer, C. Y. Suen, G. Bloch. A trainable feature extractor for handwritten digit recognition. Pattern Recognition, 2007
4. B. Kegl and R. B. Fekete. Boosting products of base classifiers. IEEE International Conference on Machine Learning (ICML), 2009
5. C.-L. Liu, F. Yin, D.-H. Wang and W.-F. Wang. Online and offline handwritten Chinese character recognition: Benchmarking on new databases. Pattern Recognition, 2013
6. Y. Wang, X. Ding and C.-L. Liu. MQDF discriminative learning based offline handwritten Chinese character recognition. International Conference on Document Analysis and Recognition (ICDAR), 2011
7. T.-H. Su, C.-L. Liu and X.-Y. Zhang. Perceptron learning of modified quadratic discriminant function. International Conference on Document Analysis and Recognition (ICDAR), 2011
8. S. Wshah, G. Kumar and V. Govindaraju. Script independent word spotting in offline handwritten documents based on hidden markov models. International Conference on Frontiers in Handwriting Recognition (ICFHR), 2012
9. M. Cheriet, N. Kharma, C.-L. Liu and C. Y. Suen. Character recogntion systems: A Guide for Students and Practitioners. Wiley-Interscience, 2007
10. A. Yuan, G. Bai, P. Yang. Y. Guo and X. Zhao. Handwritten English word recognition based on convolutional neural networks. International Conference on Frontiers in Handwriting Recognition (ICFHR), 2012
11. L. Wan, M. Zeiler, S. Zhang, Y. Lecun and R. Fergus. Regularization of neural networks using dropconnect. IEEE International Conference on Machine Learning (ICML), 2013
12. F. Yin, Q.-F. Wang, X.-Y. Zhang and C.-L. Liu. ICDAR 2013 Chinese handwriting recognition competition. International Conference on Document Analysis and Recognition (ICDAR), 2013
13. A. Bissacco, M. Cummins, Y. Netzer and H. Neven. PhotoOCR: Reading text in uncontrolled conditions. IEEE International Conference on Computer Vision (ICCV), 2013
14. P. Sermanet, D. Eigen, X. Zhang, M. Mathieu, R. Fergus and Y. Lecun. OverFeat: Integrated recognition, localization and detection using convolutional networks. arXiv, 2013
15. N. Wang and D.-Y. Yeung. Learning a deep compact image representation for visual tracking. Advances in Neural Information Processing Systems (NIPS), 2013
16. D. Ciresan. U. Meier and J. Schmidhuber. Mutli-Column deep neural networks for image classification. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012
17. M. Lin, Q. Chen and S.-C. Yan. Network in network. arXiv, 2013
18. G. E. Hinton, N. Srivastava, A. Krizhevsky, I. Sutskever and R. R. Salakhutdinov. Improving neural networks by preventing co-adaptation of feature detectors. arXiv, 2012
19. Y. Bengio. Deep learning of representations: Looking forward. arXiv, 2013
20. G. E. Hinton and R. R. Salakhutdinov. Reducing the dimensionality of data with neural networks. Science, 2006
21. A. Krizhevsky, I. Sutskever and G. E. Hinton. Imagenet classification with deep convolutional nerual networks. Advances in Neural Information Processing Systems (NIPS), 2012
22. D. Ciresan and J. Schmidhuber. Multi-Column deep neural networks for offline handwritten Chinese character classification. arXiv, 2013
23. L. Deng. A tutorial survey of architectures, algorithms, and applications for deep learning. APSIPA Transactions on Signal and Information Processing, 2013
24. Y. Bengio, A. Courville and P. Vincent. Representation learning: A review and new perspectives. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2012
25. J. Dean, G. S. Corrado, R. Monga, K. Chen, M. Devin, Q. V. Le, M. Z. Mao, M. A. Ranzato, A. Senior, P. Tucker, K. Yang and A. Y. Ng. Large scale distributed deep networks. Advances in Neural Information Processing Systems Workshop (NIPSW), 2012
26. Q. V. Le, M. A. Ranzato, R. Monga, M. Devin, K. Chen, G. S. Corrado, J. Dean and A. Y. Ng. Building high-level features using large scale unsupervised learning. IEEE International Conference on Machine Learning (ICML), 2012
27. A. Coates, B. Huval, T. Wang, D. J. Wu, A. Y. Ng and B. Catanzaro. Deep learning with COTS HPC systems. IEEE International Conference on Machine Learning (ICML), 2013
28. R. Johnson and T. Zhang. Accelerating stochastic gradient descent using predictive variance reduction. Advances in Neural Information Processing Systems (NIPS), 2013
29. G. Nontavon, G. Orr and K.-R. Muller, editors. Neural networks: Tricks of the trade. Springer, 2012
30. M. D. Zeiler and R. Fergus. Stochastic pooling for regularization of deep convolutional neural networks. International Conference on Learning Representations (ICLR), 2013
31. P. Y. Simard, D. Steinkraus and J. C. Platt. Best practice for convolutional neural networks applied to visual document analysis. International Conference on Document Analysis and Recognition (ICDAR), 2003
32. V. Nair and G. E. Hinton. Rectified linear units imporve restricted boltzmann machines. IEEE International Conference on Machine Learning (ICML), 2010
33. Y. Lecun, L. Bottou, Y. Bengio and P. Haffner. Gradient based learning applied to document recognition. Proc. of the IEEE, 1998
34. C.-L. Liu. Handwritten Chinese character recognition: Effects of shape normalization and feature extraction. Arabic and Chinese Handwriting Recognition, LNCS, 2008.