Dynamic sign language recognition for smart home interactive application using stochastic linear formal grammar

IEEE Transactions on Instrumentation and Measurement

Volumn 64, Issue 3, 2015, Pages 596-605

  Abid, Muhammad Rizwan ^a   Petriu, Emil M ^a   Amjadian, Ehsan ^b  

^a UNIVERSITY OF OTTAWA   (Canada)

^b CARLETON UNIVERSITY   (Canada)

Author keywords

Dynamic hand gesture; dynamic sign language; formal languages; image processing (IP); local part model; machine learning; stochastic linear formal grammar (SLFG); syntactic pattern recognition

Indexed keywords

ARTIFICIAL INTELLIGENCE; AUTOMATION; COMPUTATIONAL GRAMMARS; COMPUTATIONAL LINGUISTICS; FORMAL LANGUAGES; IMAGE PROCESSING; INTELLIGENT BUILDINGS; INTERACTIVE DEVICES; LEARNING SYSTEMS; PATTERN RECOGNITION; STOCHASTIC MODELS; STOCHASTIC SYSTEMS; SYNTACTICS;

FORMAL GRAMMARS; HAND GESTURE; LOCAL PARTS; SIGN LANGUAGE; SYNTACTIC PATTERN RECOGNITION;

GESTURE RECOGNITION;

EID: 85027949418     PISSN: 00189456     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIM.2014.2351331     Document Type: Article

References (35)

1. H. Wang, M. M. Ullah, A. Kläser, I. Laptev, and C. Schmid, "Evaluation of local spatio-temporal features for action recognition," in Proc. BMVC, 2009, pp. 124.1-124.11.
2. A. Kläser, M. Marszalek, and C. Schmid, "A spatio-temporal descriptor based on 3D-gradients," in Proc. Brit. Mach. Vis. Conf. (BMVC), 2008, pp. 995-1004.
3. P. Dollar, V. Rabaud, G. Cottrell, and S. Belongie, "Behavior recognition via sparse spatio-temporal features," in Proc. 2nd Joint IEEE Int. Workshop VS-PETS, Oct. 2005, pp. 65-72.
4. H. Jhuang, T. Serre, L. Wolf, and T. Poggio, "A biologically inspired system for action recognition," in Proc. ICCV, Oct. 2007, pp. 1-8.
5. I. Laptev and T. Lindeberg, "Space-time interest points," in Proc. ICCV, Oct. 2003, pp. 432-439.
6. A. Oikonomopoulos, I. Patras, and M. Pantic, "Spatiotemporal salient points for visual recognition of human actions," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 36, no. 3, pp. 710-719, Jun. 2006.
7. G. Willems, T. Tuytelaars, and L. Van Gool, "An efficient dense and scale-invariant spatio-temporal interest point detector," in Proc. 10th ECCV, Oct. 2008, pp. 650-663.
8. K.-Y. K. Wong and R. Cipolla, "Extracting spatiotemporal interest points using global information," in Proc. ICCV, Oct. 2007, pp. 1-8.
9. I. Laptev and T. Lindeberg, "Local descriptors for spatio-temporal recognition," in Proc. 1st Int. Workshop Spatial Coherence Vis. Motion Anal., 2004, pp. 91-103.
10. I. Laptev, M. Marszalek, C. Schmid, and B. Rozenfeld, "Learning realistic human actions from movies," in Proc. CVPR, Jun. 2008, pp. 1-8.
11. P. Scovanner, S. Ali, and M. Shah, "A 3-dimensional sift descriptor and its application to action recognition," in Proc. ACM Int. Conf. Multimedia, 2007, pp. 357-360.
12. G. Willems, T. Tuytelaars, and L. Van Gool, "An efficient dense and scale-invariant spatio-temporal interest point detector," in Proc. ECCV, 2008, pp. 650-663.
13. D. Arthur and S. Vassilvitskii, "k-means++: The advantages of careful seeding," in Proc. 18th Annu. ACM-SIAM Symp. Discrete Algorithms, 2007, pp. 1027-1035.
14. F. Shi, E. M. Petriu, and A. Cordeiro, "Human action recognition from local part model," in Proc. IEEE Int. Workshop Haptic Audio Vis. Environ. Games (HAVE), Oct. 2011, pp. 35-38.
15. A. Chaudhary, J. L. Raheja, K. Das, and S. Raheja, "A survey on hand gesture recognition in context of soft computing," in Proc. CCSIT, vol. 133. Jan. 2011, pp. 46-55.
16. C. Nolker and H. Ritter, "Visual recognition of continuous hand postures," IEEE Trans. Neural Netw., vol. 13, no. 4, pp. 983-994, Jul. 2002.
17. A. El-Sawah, N. D. Georganas, and E. M. Petriu, "A prototype for 3-D hand tracking and posture estimation," IEEE Trans. Instrum. Meas., vol. 57, no. 8, pp. 1627-1636, Aug. 2008.
18. C. Hu, Q. Yu, Y. Li, and S. Ma, "Extraction of parametric human model for posture recognition using genetic algorithm," in Proc. IEEE Int. Conf. Autom. Face Gesture Recognit., Mar. 2000, pp. 518-523.
19. R. Akmeliawati et al., "Towards real-time sign language analysis via markerless gesture tracking," in Proc. Instrum. Meas. Technol. Conf., May 2009, pp. 1200-1204.
20. Q. Chen, N. D. Georganas, and E. M. Petriu, "Real-time vision-based hand gesture recognition using Haar-like features," in Proc. Instrum. Meas. Technol. Conf., May 2007, pp. 1-6.
21. Q. Chen, N. D. Georganas, and E. M. Petriu, "Hand gesture recognition using Haar-like features and a stochastic context-free grammar," IEEE Trans. Instrum. Meas., vol. 57, no. 8, pp. 1562-1571, Aug. 2008.
22. N. H. Dardas and N. D. Georganas, "Real-time hand gesture detection and recognition using bag-of-features and support vector machine techniques," IEEE Trans. Instrum. Meas., vol. 60, no. 11, pp. 3592-3607, Nov. 2011.
23. A. R. Varkonyi-Koczy and B. Tusor, "Human-computer interaction for smart environment applications using fuzzy hand posture and gesture models," IEEE Trans. Instrum. Meas., vol. 60, no. 5, pp. 1505-1514, May 2011.
24. C. Joslin, A. El-Sawah, Q. Chen, and N. Georganas, "Dynamic gesture recognition," in Proc. IEEE IMTC, May 2005, pp. 1706-1711.
25. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," in Proc. IJCV, Nov. 2004, pp. 91-110.
26. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2005, pp. 886-893.
27. C.-C. Chang and C.-J. Lin, "LIBSVM: A library for support vector machines," ACM Trans. Intell. Syst. Technol., vol. 2, no. 3, pp. 1-27, 2011.
28. M. R. Abid, L. B. S. Melo, and E. M. Petriu, "Dynamic sign language and voice recognition for smart home interactive application," in Proc. IEEE Int. Symp. Med. Meas. Appl. (MeMeA), May 2013, pp. 139-144.
29. W. J. M. Levelt, An Introduction to the Theory of Formal Languages and Automata. Amsterdam, The Netherlands: John Benjamins Pub., 2008.
30. N. Comsky, "On certain formal properties of grammars," Inf. Control, vol. 2, no. 2, pp. 137-167, 1959.
31. S. Shiravandi, M. Rahmati, and F. Mahmoudi, "Hand gestures recognition using dynamic Bayesian networks," in Proc. 3rd Joint Conf. AI Robot. 5th RoboCup Iran Open Int. Symp. (RIOS), Apr. 2013, pp. 1-6.
32. T. Wenjun, W. Chengdong, Z. Shuying, and J. Li, "Dynamic hand gesture recognition using motion trajectories and key frames," in Proc. 2nd Int. Conf. Adv. Comput. Control (ICACC), Mar. 2010, pp. 163-167.
33. J. Bao, A. Song, Y. Guo, and H. Tang, "Dynamic hand gesture recognition based on SURF tracking," in Proc. Int. Conf. Elect. Inf. Control Eng. (ICEICE), Apr. 2011, pp. 338-341.
34. Z. Yang, Y. Li, W. Chen, and Y. Zheng, "Dynamic hand gesture recognition using hidden Markov models," in Proc. 7th Int. Conf. Comput. Sci. Edu. (ICCSE), Jul. 2012, pp. 360-365.
35. P. K. Pisharady and M. Saerbeck, "Robust gesture detection and recognition using dynamic time warping and multi-class probability estimates," in Proc. IEEE Symp. Comput. Intell. Multimedia, Signal Vis. Process. (CIMSIVP), Apr. 2013, pp. 30-36.