A belief-based sequential fusion approach for fusing manual signs and non-manual signals

Pattern Recognition

Volumn 42, Issue 5, 2009, Pages 812-822

  Aran, Oya ^a   Burger, Thomas ^b   Caplier, Alice ^c   Akarun, Lale ^a  

^a BOGAZICI UNIVERSITY   (Turkey)

^b ORANGE LABS   (France)

^c GIPSA LAB   (France)

Author keywords

Belief functions; Data fusion; Hidden Markov models; Manual signs and non manual; Sign language recognition

Indexed keywords

COMPUTATIONAL GRAMMARS; IMAGE SEGMENTATION; INFORMATION FUSION; LINGUISTICS; MARKOV PROCESSES; OBJECT RECOGNITION;

BASELINE SYSTEMS; BELIEF FUNCTIONS; FACIAL EXPRESSIONS; FEATURE FUSIONS; FUSION TECHNIQUES; HAND GESTURES; MANUAL SIGNS AND NON-MANUAL; SIGN LANGUAGE RECOGNITION;

HIDDEN MARKOV MODELS;

EID: 58249093231     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2008.09.010     Document Type: Article

References (24)

1. W.C. Stokoe, Sign language structure: an outline of the visual communication systems of the American deaf, Studies in Linguistics: Occasional papers 8, 1960.
2. Liddell S.K. Grammar, Gesture, and Meaning in American Sign Language (2003), Cambridge University Press, Cambridge
3. Wu Y., and Huang T.S. Hand modeling, analysis, and recognition for vision based human computer interaction. IEEE Signal Process. Mag. 21 1 (2001) 51-60
4. Ong S.C.W., and Ranganath S. Automatic sign language analysis: a survey and the future beyond lexical meaning. IEEE Trans. Pattern Anal. Mach. Intell. 27 6 (2005) 873-891
5. Munib Q., Habeeba M., Takruria B., and Al-Malika H.A. American sign language (ASL) recognition based on Hough transform and neural networks. Expert Syst. Appl. 32 1 (2007) 24-37
6. N. Liu, B.C. Lovell, P.J. Kootsookos, R.I.A. Davis, Model structure selection and training algorithms for an HMM gesture recognition system, in: Ninth International Workshop on Frontiers in Handwriting Recognition (IWFHR'04), IEEE Computer Society, Washington, DC, USA, 2004, pp. 100-105.
7. C. Vogler, D. Metaxas, Parallel hidden Markov models for American sign language recognition, in: International Conference on Computer Vision, vol. 1, Kerkyra, Greece, 1999, pp. 116-122.
8. K. Ming, S. Ranganath, Representations for facial expressions, in: International Conference on Control Automation, Robotics and Vision, vol. 2, 2002, pp. 716-721.
9. U. Erdem, S. Sclaroff, Automatic detection of relevant head gestures in American sign language communication, in: International Conference on Pattern Recognition, vol. 1, 2002, pp. 460-463.
10. J. Ma, W. Gao, R. Wang, A parallel multistream model for integration of sign language recognition and lip motion, in: Third International Conference on Advances in Multimodal Interfaces (ICMI '00), Springer, London, UK, 2000, pp. 572-581.
11. Dempster A.P. A generalization of Bayesian inference. J. R. Stat. Soc. Ser. B (Methodological) 30 2 (1968) 205-247
12. Shafer G. A Mathematical Theory of Evidence (1976), Princeton University Press, Princeton, NJ
13. Smets P., and Kennes R. The transferable belief model. Artif. Intell. 66 2 (1994) 191-234
14. Kohlas J., and Monney P.A. Theory of evidence: a survey of its mathematical foundations, applications and computations. ZOR-Math. Methods Oper. Res. 39 (1994) 35-68
15. B. Cobb, P. Shenoy, A comparison of methods for transforming belief functions models to probability models, Lecture Notes in Artificial Intelligence, vol. 2711, 2003, pp. 255-266.
16. M. Daniel, Probabilistic transformations of belief functions, in: ECSQARU, 2005, pp. 539-551.
17. P. Smets, Decision making in a context where uncertainty is represented by belief functions, Belief Functions in Business Decisions, Physica-Verlag, Heidelberg, Germany, IRIDIA, 2002, pp. 17-61.
18. G. Shafer, P.P. Shenoy, Local computation in hypertrees, Technical Report, School of Business, University of Kansas, 1991.
19. Cobb B.R., and Shenoy P.P. On the plausibility transformation method for translating belief function models to probability models. Int. J. Approx. Reasoning 41 3 (2006) 314-330
20. L.R. Rabiner, A tutorial on hidden Markov models and selected applications in speech recognition, in: Proceedings of the IEEE, vol. 77(2), 1989, pp. 257-285.
21. O. Aran, T. Burger, A. Caplier, L. Akarun, Sequential belief based fusion of manual and non-manual signs, in: Gesture Workshop, 2007.
22. T. Burger, O. Aran, A. Caplier, Modeling hesitation and conflict: a belief-based approach for multi-class problems, in: ICMLA '06: Proceedings of the 5th International Conference on Machine Learning and Applications, IEEE Computer Society, Washington, DC, USA, 2006, pp. 95-100.
23. O. Aran, I. Ari, A. Benoit, P. Campr, A.H. Carrillo, F.-X. Fanard, L. Akarun, A. Caplier, M. Rombaut, B. Sankur, Signtutor: an interactive system for sign language tutoring, IEEE Multimedia 16 (1) (2009).
24. A. Benoit, A. Caplier, Head nods analysis: interpretation of non verbal communication gestures, in: International Conference on Image Processing, vol. 3, ICIP2005, Genova, Italy, 2005, pp. 425-428.