Recognition System for Home-Service-Related Sign Language Using Entropy-Based K-Means Algorithm and ABC-Based HMM

IEEE Transactions on Systems, Man, and Cybernetics: Systems

Volumn 46, Issue 1, 2016, Pages 150-162

  Li, Tzuu Hseng S ^a   Kao, Min Chi ^a   Kuo, Ping Huan ^a  

^a NATIONAL CHENG KUNG UNIVERSITY   (Taiwan)

Author keywords

Artificial bee colony (ABC) algorithm; entropy based K means algorithm; hidden Markov models (HMMs); Taiwan sign language (TSL)

Indexed keywords

ENTROPY; HIDDEN MARKOV MODELS; OPTIMIZATION; TRELLIS CODES;

ARTIFICIAL BEE COLONY ALGORITHMS; ARTIFICIAL BEE COLONY ALGORITHMS (ABC); BAUM-WELCH ALGORITHMS; DATA-DRIVEN METHODS; ENTROPY-BASED; HIDDEN MARKOV MODELS (HMMS); RECOGNITION SYSTEMS; SIGN LANGUAGE;

K-MEANS CLUSTERING;

EID: 84970028209     PISSN: 21682216     EISSN: 21682232     Source Type: Journal    
DOI: 10.1109/TSMC.2015.2435702     Document Type: Article

References (55)

1. H.-D. Yang, A.-Y. Park, S.-W. Lee, "Gesture spotting and recognition for human-robot interaction," IEEE Trans. Robot., vol. 23, no. 2, pp. 256-270, Apr. 2007.
2. L. Gupta and S. Ma, "Gesture-based interaction and communication: Automated classification of hand gesture contours," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 31, no. 1, pp. 114-120, Feb. 2001.
3. F. Chersi, "Learning through imitation: A biological approach to robotics," IEEE Trans. Auton. Mental Develop., vol. 4, no. 3, pp. 204-214, Sep. 2012.
4. K. Zheng, D. F. Glas, T. Kanda, H. Ishiguro, N. Hagita, "Designing and Implementing a human-robot team for social interactions," IEEE Trans. Syst., Man, Cybern., Syst., vol. 43, no. 4, pp. 843-859, Jul. 2013.
5. Y. Kim and W. C. Yoon, "Generating task-oriented interactions of service robots," IEEE Trans. Syst., Man, Cybern., Syst., vol. 44, no. 8, pp. 981-994, Aug. 2014.
6. A. Aztiria, J. C. Augusto, R. Basagoiti, A. Izaguirre, D. J. Cook, "Learning frequent behaviors of the users in intelligent environments," IEEE Trans. Syst., Man, Cybern., Syst., vol. 43, no. 6, pp. 1265-1278, Nov. 2013.
7. B. W. Chen, C. Y. Chen, J. F. Wang, "Smart homecare surveillance system: Behavior identification based on state-transition support vector machines and sound directivity pattern analysis," IEEE Trans. Syst., Man, Cybern., Syst., vol. 43, no. 6, pp. 1279-1289, Nov. 2013.
8. P.-H. Tsai, Y.-J. Lin, Y.-Z. Ou, E. T.-H. Chu, "A framework for fusion of human sensor and physical sensor data," IEEE Trans. Syst., Man, Cybern., Syst., vol. 44, no. 9, pp. 1248-1261, Sep. 2014.
9. I. Vlasenko, I. Nikolaidis, E. Stroulia, "The Smart-Condo: Optimizing sensor placement for indoor localization," IEEE Trans. Syst., Man, Cybern., Syst., vol. 45, no. 3, pp. 436-453, Mar. 2015.
10. C. H. Wu, Y. H. Chiu, K. W. Cheng, "Error-tolerant sign retrieval using visual features and maximum a posteriori estimation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 4, pp. 495-508, Apr. 2004.
11. T. Starner, J. Weaver, A. Pentland, "Real-time American sign language recognition using desk and wearable computer based video," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 12, pp. 1371-1375, Dec. 1998.
12. S. Liwicki and M. Everingham, "Automatic recognition of fingerspelled words in British sign language," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops (CVPR), Miami, FL, USA, Jun. 2009, pp. 50-57.
13. I. Infantino, R. Rizzo, S. Gaglio, "A framework for sign language sentence recognition by commonsense context," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 37, no. 5, pp. 1034-1039, Sep. 2007.
14. C. Wang, W. Gao, S. Shan, "An approach based on phonemes to large vocabulary Chinese sign language recognition," in Proc. IEEE Int. Conf. Autom. Face Gesture Recognit., Washington, DC, USA, 2002, pp. 393-398.
15. J. S. Kim, W. Jang, Z. Bien, "A dynamic gesture recognition system for the Korean sign language (KSL)," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 26, no. 2, pp. 354-359, Apr. 1996.
16. T. Shanableh, K. Assaleh, M. Al-Rousan, "Spatio-temporal feature extraction techniques for isolated gesture recognition in Arabic sign language," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 37, no. 3, pp. 641-650, Jun. 2007.
17. Y.-H. Chiu, C.-H. Wu, H.-Y. Su, C.-J. Cheng, "Joint optimization of word alignment and epenthesis generation for Chinese to Taiwanese sign synthesis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 1, pp. 28-39, Jan. 2007.
18. C.-H. Wu, Y.-H. Chiu, C.-S. Guo, "Text generation from Taiwanese sign language using a PST-based language model for augmentative communication," IEEE Trans. Neural Syst. Rehabilit. Eng., vol. 12, no. 4, pp. 441-454, Dec. 2004.
19. J. L. Hernandez-Rebollar, N. Kyriakopoulos, R. W. Lindeman, "A new instrumented approach for translating American sign language into sound and text," in Proc. IEEE Int. Conf. Autom. Face Gesture Recognit., Seoul, Korea, 2004, pp. 547-552.
20. R. H. Liang and M. Ouhyoung, "A real-time continuous alphabetic sign language to speech conversion VR system," Comput. Graph. Forum, vol. 14, no. 3, pp. 67-76, 1995.
21. W. Gao et al., "HandTalker: A multimodal dialog system using sign language and 3-D virtual human," in Proc. Int. Conf. Adv. Multimodal Interfaces, Beijing, China, 2000, pp. 564-571.
22. N. Habili, C. C. Lim, A. Moini, "Segmentation of the face and hands in sign language video sequences using color and motion cues," IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 8, pp. 1086-1096, Aug. 2004.
23. Q. Wu, Z. Wang, F. Deng, Z. Chi, D. D. Feng, "Realistic human action recognition with multimodal feature selection and fusion," IEEE Trans. Syst., Man, Cybern., Syst., vol. 43, no. 4, pp. 875-885, Jul. 2013.
24. K. Assaleh, T. Shanableh, M. Fanaswala, H. Bajaj, F. Amin, "Visionbased system for continuous Arabic sign language recognition in user dependent mode," in Proc. 5th Int. Symp. Mechatronics Appl., Amman, Jordan, 2008, pp. 1-5.
25. S. A. Mehdi and Y. N. Khan, "Sign language recognition using sensor gloves," in Proc. Int. Conf. Neural Inf. Process., vol. 5. Singapore, 2002, pp. 2204-2206.
26. G. Fang, W. Gao, D. Zhao, "Large-vocabulary continuous sign language recognition based on transition-movement models," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 37, no. 1, pp. 1-9, Jan. 2007.
27. V. E. Kosmidou, L. J. Hadjileontiadis, S. M. Panas, "Evaluation of surface EMG features for the recognition of American sign language gestures," in Proc. IEEE 28th Annu. Int. Conf. Eng. Med. Biol. Soc., New York, NY, USA, Aug. 2006, pp. 6197-6200.
28. T. D. Bui and L. T. Nguyen, "Recognizing postures in Vietnamese sign language with MEMS accelerometers," IEEE Sensors J., vol. 7, no. 5, pp. 707-712, May 2007.
29. V. E. Kosmidou and L. J. Hadjileontiadis, "Sign language recognition using intrinsic mode sample entropy on sEMG and accelerometer data," IEEE Trans. Biomed. Eng., vol. 56, no. 12, pp. 2879-2890, Dec. 2009.
30. X. Zhang et al., "A framework for hand gesture recognition based on accelerometer and EMG sensors," IEEE Trans. Syst., Man, Cybern., A, Syst., Humans, vol. 41, no. 6, pp. 1064-1076, Nov. 2011.
31. J. Lichtenauer, E. Hendriks, M. Reinders, "Sign language recognition by combining statistical DTW and independent classification," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 11, pp. 2040-2046, Nov. 2008.
32. M. C. Kao and T. H. S. Li, "Design and implementation of interaction system between humanoid robot and human hand gesture," in Proc. IEEE/SICE, Taipei, Taiwan, Aug. 2010, pp. 1616-1621.
33. C. Alippi, D. Liu, D. Zhao, L. Bu, "Detecting and reacting to changes in sensing units: The active classifier case," IEEE Trans. Syst., Man, Cybern., Syst., vol. 44, no. 3, pp. 353-362, Mar. 2014.
34. P. Vamplew, "Recognition of sign language gestures using neural networks," in Proc. Eur. Conf. Disabil. Virtual Real. Assoc. Technol., Maidenhead, U.K., 1996, pp. 27-33.
35. L. R. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition," Proc. IEEE, vol. 77, no. 2, pp. 257-286, Feb. 1989.
36. R. H. Liang and M. Ouhyoung, "A sign language recognition system using hidden Markov model and context sensitive search," in Proc. ACM Symp. Virtual Real. Softw. Technol., Hong Kong, 1996, pp. 59-66.
37. W. Gao, J. Ma, J. Wu, C. Wang, "Sign language recognition based on HMM/ANN/DP," Int. J. Pattern Recognit. Artif. Intell., vol. 14, no. 5, pp. 587-602, 2000.
38. G. Fang, W. Gao, D. Zhao, "Large vocabulary sign language recognition based on fuzzy decision trees," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 34, no. 3, pp. 305-314, May 2004.
39. D. Bouchaffra, "Conformation-based hidden Markov models: Application to human face identification," IEEE Trans. Neural Netw., vol. 21, no. 4, pp. 597-608, Apr. 2010.
40. L. Antwarg, L. Rokach, B. Shapira, "Attribute-driven hidden Markov model trees for intention prediction," J. Syst. Eng. Electron., vol. 24, no. 3, pp. 1103-1119, Nov. 2012.
41. C. H. Wu, J. C. Lin, W. L. Wei, "Two-level hierarchical alignment for semi-coupled HMM-based audiovisual emotion recognition with temporal course," IEEE Trans. Multimedia, vol. 15, no. 8, pp. 1880-1895, Dec. 2013.
42. H. Li, Y. Yi, X. Li, Z. Guo, "Human activity recognition based on HMM by improved PSO and event probability," J. Syst. Eng. Electron., vol. 24, no. 3, pp. 545-554, Jun. 2013.
43. C. Rao, A. Yilmaz, M. Shah, "View-invariant representation and recognition of actions," Int. J. Comput. Vis., vol. 50, no. 2, pp. 203-226, 2002.
44. D. Malyszko and J. Stepaniuk, "Rough entropy based k-means clustering," in Proc. 12th Int. Conf. Rough Sets Fuzzy Sets Data Min. Granular Comput., Delhi, India, 2009, pp. 406-413.
45. X. Bai, S. Luo, Y. Zhao, "Entropy based soft K-means clustering," in Proc. IEEE Int. Conf. Granular Comput., Hangzhou, China, 2008, pp. 107-110.
46. M. Garcia, H. Hidalgo, E. Chavez, "Contextual entropy and text categorization," in Proc. 4th IEEE Comput. Soc. Latin Amer. Web Congr. (LA-WEB), Cholula, Mexico, 2006, pp. 147-153.
47. [Online]. Available: http://cs.joensuu.fi/sipu/datasets/
48. T. M. Cover and J. A. Thomas, "Entropy, relative entropy and mutual information," in Elements of Information Theory. New York, NY, USA: Wiley, 1991, pp. 12-49.
49. L. E. Baum, T. Petrie, G. Soules, N. Weiss, "A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains," Ann. Math. Stat., vol. 41, no. 1, pp. 164-171, 1970.
50. D. Karaboga, "An idea based on bee swarm for numerical optimization," Dept. Comput. Eng., Erciyes Univ., Kayseri, Turkey, Tech. Rep. TR06, 2005.
51. [Online]. Available: http://www.x-io.co.uk/
52. S. O. H. Madgwick, A. J. L. Harrison, R. Vaidyanathan, "Estimation of IMU and MARG orientation using a gradient descent algorithm," in Proc. IEEE Int. Conf. Rehabilit. Robot., Zurich, Switzerland, Jun. 2011, pp. 1-7.
53. H.-D. Yang, A.-Y. Park, S.-W. Lee, "Gesture spotting and recognition for human-robot interaction," IEEE Trans. Robot., vol. 23, no. 2, pp. 256-270, Apr. 2007.
54. C.-H. Moon and Y.-C. Kim, "Hybrid gesture classifying method using K-NN and DTW for smart remote control," in Proc. Int. Conf. Inf. Sci. Electron. Elect. Eng. (ISEEE), Sapporo, Japan, 2014, pp. 1298-1300.
55. G. Poli, A. L. M. Levada, J. F. Mari, J. H. Satio, "Voice command recognition with dynamic time warping (DTW) using graphics processing units (GPU) with compute unified device architecture (CUDA)," in Proc. 19th Int. Symp. Comput. Archit. High Perform. Comput. (SBACPAD), Rio Grande do Sul, Brazil, 2007, pp. 19-25.