Using sample entropy for automated sign language recognition on sEMG and accelerometer data

Medical and Biological Engineering and Computing

Volumn 48, Issue 3, 2010, Pages 255-267

  Kosmidou, Vasiliki E ^a   Hadjileontiadis, Leontios I ^a  

^a ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

Author keywords

Gesture recognition; Sample entropy; SEMG; Sign language recognition; Three dimensional accelerometer

Indexed keywords

ACCELEROMETER DATA; AUTOMATED RECOGNITION; BASELINE METHODS; CHANNEL SURFACE; COMMUNICATION CHANNEL; CONVENTIONAL METHODS; DIMENSION REDUCTION; FEATURE VECTORS; INFORMATION TRANSMISSION; MEAN CLASSIFICATION; SAMPLE ENTROPY; SEMG; SIGN LANGUAGE; SIGN LANGUAGE RECOGNITION; TIME FREQUENCY FEATURES;

ACCELEROMETERS; AUTOMATION; ENTROPY; FEATURE EXTRACTION; HEAT TREATING FURNACES; LINGUISTICS; THREE DIMENSIONAL;

GESTURE RECOGNITION;

ACCELERATION; ARTICLE; AUTOMATED PATTERN RECOGNITION; ELECTROMYOGRAPHY; ENTROPY; FEMALE; GESTURE; HUMAN; MALE; METHODOLOGY; SIGN LANGUAGE; SIGNAL PROCESSING;

ACCELERATION; ELECTROMYOGRAPHY; ENTROPY; FEMALE; GESTURES; HUMANS; MALE; PATTERN RECOGNITION, AUTOMATED; SIGN LANGUAGE; SIGNAL PROCESSING, COMPUTER-ASSISTED;

EID: 77649234850     PISSN: 01400118     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11517-009-0557-6     Document Type: Article

References (46)

1. Addison PS (2002) The illustrated wavelet transform handbook: introductory theory and applications in science, engineering, medicine and finance. Institute of Physics (IoP) Publishing, Bristol BS1 6BE, UK
2. R Boostani MH Moradi 2003 Evaluation of the forearm EMG signal features for the control of a prosthetic hand Physiol Meas 24 309 319 10.1088/0967-3334/24/2/307 (Pubitemid 36648398)
3. Brashear H, Starner T, Lukowicz P, Junker H (2005) Using multiple sensors for mobile sign language recognition. In: Proceedings of IEEE 7th International Symposium on Wearable Computers, pp 45-52
4. C Charayaphan A Marble 1992 Image processing system for interpreting motion in American Sign Language J Biomed Eng 14 419 425 10.1016/0141-5425(92) 90088-3
5. Q Chen ND Georganas EM Petriu 2008 Hand gesture recognition using Haar-like features and a stochastic context-free grammar IEEE Trans Instrum Meas 57 8 1562 1571 10.1109/TIM.2008.922070
6. Cooper H, Bowden R (2007) Large lexicon detection of sign language. In: Lee et al (eds) Human computer interaction, ICCV2007, LNCS 4796. Springer Verlag, Berlin, Heidelberg, pp 88-97
7. JP Eckmann D Ruelle 1985 Ergodic theory of chaos and strange attractors Rev Modern Phys 57 617 654 10.1103/RevModPhys.57.617 800052
8. G Fang W Gao D Zhao 2007 Large-vocabulary continuous sign language recognition based on transition-movement models IEEE Trans Syst Man Cybern 37 1 1 9
9. Fels SS (1994) Glove-TalkII: mapping hand gestures to speech using neural networks-an approach to building adaptive interfaces. Ph.D. dissertation, Computer Science Department, University of Toronto, Canada
10. SS Fels G Hinton 1993 GloveTalk: a neural network interface between a DataDlove and a speech synthesizer IEEE Trans Neural Netw 4 2 8 10.1109/72.182690 (Pubitemid 23648063)
11. Freeman WT, Roth M (1995) Orientation histograms for hand gesture recognition. In: IEEE proceedings of international workshop on automatic face and gesture recognition, pp 296-301
12. Graupe J, Cine KK (1975) Functional separation of EMG signals via ARMA identification method for prosthesis control purpose. IEEE Trans Syst Man Cybern SMC-5, pp 252-259
13. Hernandez-Rebollar J, Kyriakopoulos N, Lindeman R (2004) A new instrumented approach for translating American Sign Language into sound and text. Proceedings of IEEE 6th international conference on automatic face and gesture recognition, pp 547-552
14. Hong P, Turk M, Huang TS (2000) Gesture modeling and recognition using finite state machines. Proceedings of 4th IEEE international conference on automatic face and gesture recognition, pp 410-415
15. Hongyu X. (2003) Mahalanobis distance based ARTMAP networks. Master Thesis, Dept. Computer Science, San Diego State Univ., California, USA
16. Kadous MW (1996) Machine recognition of Auslan signed using PowerGlove: towards large-lexicon recognition of sign language. Proceedings of WIGLS, pp 165-174
17. Kim JH, Kim DG, Shin JH, Lee SW, Hong KS (2005) Hand gesture recognition system using fuzzy algorithm and RDBMS for Post PC. In: Wang L, Jin Y (eds) FSKD 2005 LNCS (LNAI), vol 3614. Springer, Heidelberg, pp 170-175
18. Kosmidou VE, Hadjileontiadis LJ, Panas SM (2006) Evaluation of surface EMG features for the recognition of American Sign Language gestures. Proceedings of IEEE 28th annual international conference on EMBS 6197-6200
19. Kosmidou VE, Hadjileontiadis LJ (2007) ICT-based biofeedback in everyday applications for people with disabilities. Proceedings of the 4th personalized health conference
20. Lee S, Henderson V, Brashear H, Starner T, Hamilton S (2005) User-centered development of a gesture-based american sign language game. Proceedings of instructional technology and education of the deaf symposium. NTID, Rochester, NY
21. Liang RH, Ouhyoung M (1996) A sign language recognition system using hidden markov model and context sensitive search. Proceedings of ACM VRST'96, pp 59-66
22. Liang RH, Ouhyoung M (1998) A real-time continuous gesture recognition system for sign language. Proceedings of the 3rd international conference on automatic face and gesture recognition, pp 558-565
23. JF Lichtenauer EA Hendriks MJT Reinders 2008 Sign language recognition by combining statistical DTW and independent classification IEEE Trans Pattern Anal Mach Intell 30 11 2040 2046 10.1109/TPAMI.2008.123
24. Ma J, Gao W, Wu J, Wang C (2000) A continuous Chinese sign language recognition system. In: Proceedings of IEEE 4th international conference of automatic face and gesture recognition, pp 428-433
25. S Mitra T Acharya 2007 Gesture recognition: a survey IEEE Trans Syst Man Cybern C 37 3 311 323 10.1109/TSMCC.2007.893280 (Pubitemid 46621535)
26. Murakami K, Taguchi H (1991) Gesture recognition using recurrent neural networks. In: Proceedings of SIGCHI conference on human factors in computing systems, pp 237-242
27. SB Needleman CD Wunsch 1970 A general method applicable to the search for similarities in the amino acid sequence of two proteins J Mol Biol 48 3 443 453 10.1016/0022-2836(70)90057-4
28. CW Ng S Ranganath 2002 Real-time gesture recognition system and application J Image Vision Comput 20 13-14 993 1007
29. Paschaloudi VN, Margaritis KG (2003) Towards an assistive tool for Greek sign language communication. In: Proceedings of IEEE 3th international conference of advanced learning technologies, pp 125-129
30. SM Pincus 1991 Approximate entropy as a measure of system complexity Proc Natl Acad Sci USA 88 2297 2301 0756.60103 10.1073/pnas.88.6.2297 1095519
31. JS Richman JR Moorman 2000 Physiological time-series analysis using approximate entropy and sample entropy Am J Physiol Heart Circ Physiol 278 H2039 H2049
32. Seber GAF (2004) Multivariate observations (Wiley Series in probability and statistics). Wiley, San Francisco, CA
33. R Shaw 1981 Strange attractors, chaotic behavior, and information flow Z Naturforsch 36A 80 112
34. Starner T (1995) Visual recognition of american sign language using hidden Markov models. Master thesis, MIT Media Laboratory, Cambridge, MA, USA
35. Starner T, Pentland A (1996) Real-time American sign language recognition from video using hidden Markov Model. Perceptual Computing Section, Technical Report No. 375, MIT Media Lab Cambridge MA, USA
36. Tabachnick B, Fidell L (2001) Using multivariate statistics, 4 th edn. Allyn and Bacon, Boston (chap 11)
37. T Takahashi F Kishino 1991 Gesture coding based on experiments using a hand gesture interface device ACM SIGCHI Bull 23 2 67 73 10.1145/122488.122499
38. Vogler C, Metaxas D (1997) Adapting hidden Markov models for ASL recognition by using three-dimensional computer vision methods. In: Proceedings of IEEE international conference on systems, man and cybernetics, pp 156-161
39. Vogler C, Metaxas D (1998) ASL recognition based on a coupling between HMMs and 3D motion analysis. Proc of IEEE Inter Conf on Computer Vision 363-369
40. Vogler C, Metaxas D (1999) Toward scalability in ASL recognition: breaking down signs into phonemes. In: Proceedings of gesture workshop. http://gri.gallaudet.edu/~cvogler/research/ data/cvdm-gw99.pdf
41. C Vonesch T Blu M Unser 2007 Generalized Daubechies wavelet families IEEE Trans Signal Process 55 9 4415 4429 10.1109/TSP.2007.896255 2464454 (Pubitemid 47323620)
42. MB Waldron 1995 Isolated ASL sign recognition system for deaf persons IEEE Trans on Rehabilitation Eng 3 3 261 271 10.1109/86.413199
43. SB Wang A Quattoni LP Morency D Demirdjian 2006 Hidden conditional random fields for gesture recognition Proc IEEE Comp Soc Conf Comput Vis Pattern Recognit 2 1521 1527
44. Wexelblat AD (1993) A feature-based approach to continuous gesture analysis. Master Thesis, MIT, Media Laboratory, Cambridge, MA, USA
45. SF Wong R Cipolla 2005 Real-time interpretation of hand motions using a sparse Bayesian classifier on motion gradient orientation images Br Mach Vis Conf 1 379 388
46. MS Yang N Ahuja 1998 Recognizing hand gesture using motion trajectories Proc IEEE CS Conf Comput Vis Pattern Recognit 1 466 472