A multi-class classification strategy for Fisher scores: Application to signer independent sign language recognition

Pattern Recognition

Volumn 43, Issue 5, 2010, Pages 1776-1788

  Aran, Oya ^a   Akarun, Lale ^b  

^a IDIAP RESEARCH INSTITUTE   (Switzerland)

^b BOGAZICI UNIVERSITY   (Turkey)

Author keywords

Fisher scores; Generative and discriminative classifiers; Hidden Markov models; Multi class classification; Sign language recognition

Indexed keywords

DISCRIMINATIVE CLASSIFIERS; FISHER SCORE; GENERATIVE AND DISCRIMINATIVE CLASSIFIERS; MULTI-CLASS CLASSIFICATION; SIGN LANGUAGE RECOGNITION;

CLASSIFIERS; COMBINES; COMPUTATIONAL COMPLEXITY; LINGUISTICS;

HIDDEN MARKOV MODELS;

EID: 75749138425     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2009.12.002     Document Type: Article

References (30)

1. L.R. Rabiner, A tutorial on hidden Markov models and selected applications in speech recognition, in: Proceedings of the IEEE, vol. 77, no. 2, 1989, pp. 257-285.
2. Wu Y., and Huang T.S. Hand modeling, analysis, and recognition for vision based human computer interaction. IEEE Signal Processing Magazine 21 1 (2001) 51-60
3. Ong S.C.W., and Ranganath S. Automatic sign language analysis: a survey and the future beyond lexical meaning. IEEE Transactions on Pattern Analysis and Machine Intelligence 27 6 (2005) 873-891
4. He X., Deng L., and Chou W. Discriminative learning in sequential pattern recognition. IEEE Signal Processing Magazine 25 5 (2008) 14-36
5. Dietterich T.G. Machine learning for sequential data: a review. Joint IAPR International Workshop on Structural, Syntactic, and Statistical Pattern Recognition (2002), Springer, Berlin 15-30
6. Jaakkola T.S., and Haussler D. Exploiting generative models in discriminative classifiers. Conference on Advances in Neural Information Processing Systems II (1998), MIT Press, Cambridge, MA 487-493
7. Smith N., and Gales M. Speech recognition using SVMs. In: Dietterich T., Becker S., and Ghahramani Z. (Eds). Advances in Neural Information Processing Systems vol. 14 (2002), MIT Press, Cambridge, MA
8. Jaakkola T., Diekhans M., and Haussler D. Using the Fisher kernel method to detect remote protein homologies. Proceedings of the Seventh International Conference on Intelligent Systems for Molecular Biology (1999), AAAI Press 149-158
9. Moreno P., and Rifkin R. Using the Fisher kernel method for web audio classification. IEEE International Conference on Acoustics, Speech, and Signal Processing. ICASSP '00 6 (2000) 2417-2420
10. Holub A.D., Welling M., and Perona P. Combining generative models and Fisher kernels for object recognition. Tenth IEEE International Conference on Computer Vision (ICCV '05) vol. 1 (2005), IEEE Computer Society, Washington, DC, USA 136-143
11. Chen L., and Man H. Hybrid IMM/SVM approach for wavelet-domain probabilistic model based texture classification. IEE Proceedings of Vision, Image and Signal Processing 152 6 (2005) 724-730
12. Chen L., Man H., and Nefian A.V. Face recognition based on multi-class mapping of Fisher scores. Pattern Recognition 38 (2005) 799-811
13. O. Aran, L. Akarun, Multi-class classification strategies for Fisher scores of gesture and sign sequences, in: International Conference On Pattern Recognition, 2008.
14. O. Aran, L. Akarun, Recognizing two handed gestures with generative discriminative and ensemble methods via Fisher kernels, in: Multimedia Content Representation, Classification and Security International Workshop, MRCS 2006, Istanbul, Turkey, Proceedings, Lecture Notes in Computer Science, vol. 4015, 2006, pp. 159-166.
15. Scholkopf B., and Smola A.J. Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond (2001), MIT Press, Cambridge, MA, USA
16. N. Smith, M. Gales, Using SVMs to classify variable length speech patterns, Technical Report, Cambridge University Engineering Department, 2002.
17. Liu N., Lovell B.C., Kootsookos P.J., and Davis R.I.A. Model structure selection and training algorithms for an HMM gesture recognition system. Ninth International Workshop on Frontiers in Handwriting Recognition (IWFHR'04) (2004), IEEE Computer Society, Washington, DC, USA 100-105
18. O. Aran, Vision based sign language recognition: modeling and recognizing isolated signs with manual and non-manual components, Ph.D. Thesis, Bogazici University, Istanbul, Turkey, 2008.
19. Rifkin R., and Klautau A. In defense of one-vs-all classification. Journal of Machine Learning Research 5 (2004) 101-141
20. Duda R.O., Hart P.E., and Stork D.G. Pattern Classification (2001), Wiley, New York
21. Pudil P., Novovicova J., and Kittler J. Floating search methods in feature selection. Pattern Recognition Letters 15 11 (1994) 1119-1125
22. Aran O., Ari I., Benoit A., Campr P., Carrillo A.H., Fanard F.-X., Akarun L., Caplier A., and Sankur B. Signtutor: an interactive system for sign language tutoring. IEEE Multimedia 16 1 (2009) 81-93
23. T. Burger, A. Urankar, O. Aran, L. Akarun, A. Caplier, Cued speech hand shape recognition, in: Second International Conference on Computer Vision Theory and Applications (VISAPP '07), Spain, 2007.
24. Aran O., Burger T., Caplier A., and Akarun L. A belief-based sequential fusion approach for fusing manual and non-manual signs. Pattern Recognition 42 5 (2009) 812-822
25. C.-C. Chang, C.-J. Lin, LIBSVM: a library for support vector machines, Software available at: 〈http://www.csie.ntu.edu.tw/∼cjlin/libsvm〉, 2001.
26. Ong S.C., Ranganath S., and Venkatesha Y. Understanding gestures with systematic variations in movement dynamics. Pattern Recognition 39 9 (2006) 1633-1648
27. S.C.W. Ong, S. Ranganath, Deciphering gestures with layered meanings and signer adaptation, in: Sixth IEEE International Conference on Automatic Face and Gesture Recognition (FGR 2004), 2004, pp. 559-564.
28. A. Just, S. Marcel, Two-handed gesture recognition, Technical Report 24, Idiap, 2005. URL: 〈http://www.idiap.ch/resources/twohanded/〉.
29. O. Aran, I. Ari, A. Guvensan, H. Haberdar, Z. Kurt, I. Turkmen, A. Uyar, L. Akarun, A database of non-manual signs in Turkish sign language, in: IEEE 15th Signal Processing and Communications Applications (SIU '07), 2007.
30. I. Ari, Facial feature tracking and expression recognition for sign language, Master's Thesis, Bogazici University, 2008.