Enhanced sign language recognition using weighted intrinsic-mode entropy and signer's level of deafness

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 41, Issue 6, 2011, Pages 1531-1543

  Kosmidou, Vasiliki E ^a   Petrantonakis, Panagiotis C ^a   Hadjileontiadis, Leontios J ^a  

^a ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

Author keywords

[No Author keywords available]

Indexed keywords

ACCELEROMETER DATA; ADAPTIVE WEIGHTING; DISCRIMINATION ABILITY; FEATURE SETS; GROUP IDENTIFICATION; INTRINSIC MODES; SAMPLE ENTROPY; SIGN LANGUAGE; SIGN LANGUAGE RECOGNITION; SURFACE ELECTROMYOGRAM; TIME FREQUENCY;

ACCELEROMETERS;

ENTROPY;

EID: 81955168078     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2011.2157141     Document Type: Article

References (40)

1. C. Charayaphan and A. Marble, "Image processing system for interpreting motion in American sign language," J. Biomed. Eng., vol. 14, no. 5, pp. 419-425, Sep. 1992.
2. T. Starner, "Visual recognition of American sign language using hidden Markov models," M.S. thesis, Media Lab., MIT, Cambridge, MA, Jul., 1995.
3. H. Cooper and R. Bowden, "Large lexicon detection of sign language," in Human Comput. Interact., Lee, Ed. Heidelberg: Springer Verlag Berlin, 2007, pp. 88-97.
4. 10.1109/TPAMI.2008.123J. F. Lichtenauer, E. A. Hendriks, and M. J. T. Reinders, "Sign language recognition by combining Statistical DTW and independent classification," IEEE Trans. Pattern Analysis and Machine Intelligence.
5. R.-H. Liang and M. Ouhyoung, "A real-time continuous gesture recognition system for sign language," in Proc. 3rd Int. Conf. Autom. Face Gesture Recog., 1998, pp. 558-565.
6. C. Vogler and D.Metaxas, "ASL recognition based on a coupling between HMMs and 3D motion analysis," in Proc. IEEE Int. Conf. Comput. Vis., 1998, pp. 363-369.
7. S. S. Fels and G. Hinton, "GloveTalk: A neural network interface between a DataDlove and a speech synthesizer," IEEE Trans. Neural Netw., vol. 4, pp. 2-8, Jan. 1993.
8. M. W. Kadous, "Machine recognition of Auslan signed using Power- Glove: Towards large-lexicon recognition of sign language," in Proc. WIGLS, Workshop Integr. Gesture Lang. Speech, 1996, pp. 165-174.
9. J. Ma,W. Gao, J.Wu, and C.Wang, "A continuous Chinese sign language recognition system," in Proc. IEEE 4th Int. Conf. Autom. Face Gesture Recog., 2000, pp. 428-433.
10. J. Hernandez-Rebollar, N. Kyriakopoulos, and R. Lindeman, "A new instrumented approach for translating American sign language into sound and text," in Proc. IEEE 6th Int. Conf. Autom. Face Gesture Recog., 2004, pp. 547-552.
11. A. D. Wexelblat, "A feature-based approach to continuous gesture analysis," M.S. thesis, Media Lab., MIT, Cambridge, MA, 1994.
12. T. Takahashi and F. Kishino, "Gesture coding based on experiments using a hand gesture interface device," ACM SIGCHI Bull., vol. 23, no. 2, pp. 67-74, Apr. 1991.
13. H. Brashear, T. Starner, P. Lukowicz, and H. Junker, "Using multiple sensors for mobile sign language recognition," in Proc. IEEE 7th Int. Symp. Wearable Comput., 2005, pp. 45-52.
14. S. Lee, V. Henderson, H. Brashear, T. Starner, and S. Hamilton, " Usercentered development of a gesture-based American sign language game," in Proc. Instruc. Technol. Educ. Deaf Symp., Rochester, NY, Jun. 2005.
15. G. Fang, W. Gao, and D. Zhao, "Large-vocabulary continuous sign language recognition based on transition-movement models," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 37, no. 1, pp. 1-9, Jan. 2007. (Pubitemid 46002473)
16. S. Mitra and T. Acharya, "Gesture recognition: A survey," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 37, no. 3, pp. 311-323, May 2007.
17. V. E. Kosmidou, L. J. Hadjileontiadis, and S. M. Panas, "Evaluation of surface EMG features for the recognition of American sign language gestures," in Proc. IEEE 28th Annu. Int. Conf. EMBS , 2006, pp. 6197-6200. (Pubitemid 46521335)
18. V. E. Kosmidou and L. J. Hadjileontiadis, "ICT-based biofeedback in everyday applications for people with disabilities," in Proc. 4th Personalized Health Conf., 2007.
19. V. E. Kosmidou and L. J. Hadjileontiadis, "Using sample entropy for automated sign language recognition on sEMG and accelerometer data," Med. Biol. Eng. Comput., vol. 48, no. 3, pp. 255-267, 2010.
20. V. E. Kosmidou and L. J. Hadjileontiadis, "Sign language recognition using intrinsic mode sample entropy on sEMG and accelerometer data," IEEE Trans. Biomed. Eng., vol. 56, no. 12, pp. 2879-2890, Dec. 2009.
21. G. Saridis and T. Gootee, "EMG pattern analysis and classification for a prosthetic arm," IEEE Trans. Biomed. Eng., vol. BME-29, no. 6, pp. 403- 412, Jun. 1982.
22. A. B. Ajiboye and R. F. Weir, "A heuristic fuzzy logic approach to EMG pattern recognition for multifunctional prosthesis control," IEEE Trans. Neural Syst. Rehab. Eng., vol. 13, no. 3, pp. 280-291, Sep. 2005. (Pubitemid 41416009)
23. K. Murakami and H. Taguchi, "Gesture recognition using recurrent neural networks," in Proc. SIGCHI Conf. Human Factors Comput. Syst., Reaching Through Technology Table of Contents, 1991, pp. 237-242.
24. M. S. Yang and N. Ahuja, "Recognizing hand gesture using motion trajectories," in Proc. IEEE CS Conf. Comput. Vis. Pattern Recogn., 1998, vol. 1, pp. 466-472.
25. P. Hong, M. Turk, and T. S. Huang, "Gesture modeling and recognition using finite state machines," in Proc. 4th IEEE Int. Conf. Autom. Face Gesture Recogn., Grenoble, France, 2000, pp. 410-415.
26. S.-F. Wong and R. Cipolla, "Real-time interpretation of hand motions using a sparse Bayesian classifier on motion gradient orientation images," in Brit. Mach. Vis. Conf., 2005, vol. 1, pp. 379-388.
27. J.-H. Kim, D.-G. Kim, J.-H. Shin, S.-W. Lee, and K.-S. Hong, Hand Gesture Recognition System Using Fuzzy Algorithm and RDBMS for Post PC, vol. 3614, L. Wang and Y. Jin, Eds. Heidelberg: Springer-Verlag, 2005, pp. 170-175.
28. C. W. Ng and S. Ranganath, "Real-time gesture recognition system and application," Image Vis. Comput., vol. 20, no. 13-14, pp. 993-1007, Dec. 2002. (Pubitemid 35452373)
29. S. B. Wang, A. Quattoni, L.-P. Morency, and D. Demirdjian, "Hidden conditional random fields for gesture recognition," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., 2006, vol. 2, pp. 1521-1527. (Pubitemid 44931500)
30. M. Grimaldi and F. Cummins, "Speaker identification using instantaneous frequencies," IEEE Trans. Audio, Speech Lang. Process., vol. 16, no. 6, pp. 1097-1111, Aug. 2008.
31. A. Davis and A. Parving, "Towards appropriate epidemiology data on childhood hearing disability: A comparative European study of birth cohorts 1982-1988," J Audiol Med, vol. 3, pp. 35-47, 1994. (Pubitemid 24223569)
32. J. S. Richman and J. R. Moorman, "Physiological time-series analysis using approximate entropy and sample entropy," Amer. J. Physiol.-Heart and Circulatory Physiol., vol. 278, pp. H2039-H2049, 2000. (Pubitemid 30439218)
33. N. Huang, Z. Shen, S. Long, M. Wu, H. H. Shih, N. C. Zheng, N. C. Yen, C. Tung, and H. Liu, "The empirical mode decomposition and Hilbert spectrum for nonlinear and nonstationary time series analysis," Proc. Roy. Soc. London A, vol. 454, no. 1971, pp. 903-995, 1998. (Pubitemid 128733183)
34. H. Amoud, H. Snoussi, D. Hewson, M. Doussot, and J. Duchêne, "Intrinsic mode entropy for nonlinear discriminant analysis," IEEE Signal Process. Lett., vol. 14, no. 5, pp. 297-300, May 2007. (Pubitemid 46614464)
35. P. C. Petrantonakis and L. J. Hadjileontiadis, "EEG-based emotion recognition using hybrid filtering and higher order crossings," in Proc. Int. Conf. Affective Comput. Intell. Interac., 2009, pp. 147-152.
36. P. C. Petrantonakis and L. J. Hadjileontiadis, "Emotion recognition from brain signals using hybrid adaptive filtering and higher-order crossings analysis," IEEE Trans. Affective Comput., vol. 1, no. 2, pp. 81-97, Jul.-Dec. 2010.
37. B. Tabachnick and L. Fidell, Using Multivariate Statistics., 4th ed. Boston, MA: Allyn & Bacon, 2001, ch. 11.
38. H. Xu, "Mahalanobis distance based ARTMAP networks," M.Sc. thesis, Dept. Comput. Sci., San Diego State Univ., California, USA, Oct., 2003.
39. D. Goldberg, Genetic Algorithms in Search, Optimization, and Machine Learning. Reading, MA: Addison-Wesley, 1989.
40. D. Yuk-Ming Chan and I. King, "Genetic algorithm for weights assignment in dissimilarity function for trademark retrieval," in Visual Inf. Inf. Syst., 1999, vol. 1614, pp. 557-565.