A trainable feature extractor for handwritten digit recognition

Pattern Recognition

Volumn 40, Issue 6, 2007, Pages 1816-1824

  Lauer, Fabien ^a   Suen, Ching Y ^b   Bloch, Gérard ^a  

^a CENTRE DE RECHERCHE EN AUTOMATIQUE DE NANCY   (France)

^b Gina Cody School of Engineering and Computer Science   (Canada)

Author keywords

Character recognition; Convolutional neural networks; Elastic distortion; Feature extraction; Support vector machines

Indexed keywords

CHARACTER RECOGNITION; CLASSIFICATION (OF INFORMATION); CONVOLUTION; DATABASE SYSTEMS; NEURAL NETWORKS; SUPPORT VECTOR MACHINES;

CONVOLUTIONAL NEURAL NETWORKS; ELASTIC DISTORTION; TRAINING SAMPLES;

FEATURE EXTRACTION;

EID: 33947170570     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2006.10.011     Document Type: Article

References (21)

1. Duda R.O., Hart P.E., and Stork D.G. Pattern Classification. 2nd ed. (2000), Wiley, New York
2. LeCun Y., Bottou L., Bengio Y., and Haffner P. Gradient-based learning applied to document recognition. Proc. IEEE 86 11 (1998) 2278-2324
3. Vapnik V.N. The Nature of Statistical Learning Theory (1995), Springer, New York
4. Guyon I., and Elisseeff A. An introduction to variable and feature selection. J. Mach. Learn. Res. 3 (2003) 1157-1182
5. LeCun Y., Boser B., Denker J.S., Henderson D., Howard R.E., Hubbard W., and Jackel L.D. Handwritten digit recognition with a back-propagation network. In: Touretzky D. (Ed). Advances in Neural Information Processing Systems 2 (1990), M. Kaufman, Denver, CO 396-404
6. Burges C.J.C., and Schölkopf B. Improving the accuracy and speed of support vector machines. In: Mozer M., Jordan M., and Petsche T. (Eds). Advances in Neural Information Processing Systems 9 (1997), The MIT Press, Cambridge, MA 375-381
7. Simard P.Y., Steinkraus D., and Platt J.C. Best practices for convolutional neural networks applied to visual document analysis. Proceedings of the Seventh International Conference on Document Analysis and Recognition vol. 2 (2003), Edinburgh, Scotland 958-962
8. Friedrichs F., and Igel C. Evolutionary tuning of multiple SVM parameters. In: Verleysen M. (Ed). Proceedings of the 12th European Symposium on Artificial Neural Networks (ESANN) (2004), Bruges, Belgium 519-524
9. Chapelle O., Vapnik V.N., Bousquet O., and Mukherjee S. Choosing multiple parameters for support vector machines. Mach. Learn. 46 1-3 (2002) 131-159
10. N.E. Ayat, M. Cheriet, C.Y. Suen, Optimizing the SVM kernels using an empirical error minimization scheme, in: S. Lee, A. Verri (Eds.), Proceedings of the International Workshop on Pattern Recognition with Support Vector Machines, Lecture Notes in Computer Science, vol. 2388, 2002, pp. 354-369.
11. J. Weston, C. Watkins, Multiclass support vector machines, Technical Report CSD-TR-98-04, Royal Holloway, University of London, 1998.
12. Crammer K., and Singer Y. On the algorithmic implementation of multiclass kernel-based vector machines. J. Mach. Learn. Res. 2 (2001) 265-292
13. Y. Guermeur, A. Elisseeff, H. Paugam-Moisy, A new multi-class SVM based on a uniform convergence result, in: Proceedings of the International Joint Conference on Neural Networks, vol. 4, 2000, pp. 183-188.
14. Bredensteiner E.J., and Bennett K.P. Multicategory classification by support vector machines. Comput. Optim. Appl. 12 (1999) 53-79
15. Guermeur Y. Combining discriminant models with new multi-class support vector machines. Pattern Anal. Appl. 5 2 (2002) 168-179
16. LeCun Y., Jackel L.D., Bottou L., Cortes C., Denker J.S., Drucker H., Guyon I., Muller U.A., Sackinger E., Simard P., and Vapnik V. Learning algorithms for classification: a comparison on handwritten digit recognition. In: Oh J.H., Kwon C., and Cho S. (Eds). Neural Networks: The Statistical Mechanics Perspective (1995), World Scientific, Singapore 261-276
17. Y. LeCun, The MNIST database of handwritten digits, 〈http://yann.lecun.com/exdb/mnist/index.html〉.
18. Decoste D., and Schölkopf B. Training invariant support vector machines. Mach. Learn. 46 (2002) 161-190
19. Belongie S., Malik J., and Puzicha J. Shape matching and object recognition using shape contexts. IEEE Trans. Pattern Anal. Mach. Intell. 24 (2002) 509-522
20. Suen C.Y., and Tan J. Analysis of errors of handwritten digits made by a multitude of classifiers. Pattern Recognition Lett. 26 (2005) 369-379
21. J.M. Tan, Automatic verification of the outputs of multiple classifiers for unconstrained handwritten numerals, Master's Thesis, Concordia University, Montréal, QC, Canada, 2004.